Who picks the frameworks used? What about more contested topics which have a closer social split like abortions? Who decides what is and isn't ethical, and how does this cope with social divides or in places with toally different moral frameworks?
Honestly I think this problem is probably harder than the AGI part!
There are some who regard abortion as exactly "murdering a bunch of people in order to increase happiness". There are even some (hopefully a smaller number) who regard genocide the same way.
Who picks the frameworks used? What about more contested topics which have a closer social split like abortions? Who decides what is and isn't ethical, and how does this cope with social divides or in places with toally different moral frameworks?
Honestly I think this problem is probably harder than the AGI part!