It is all fun and games, until people figure out that intelligence, has nothing to do with morality and what is good or bad.
Being run by AGI can be an utopia, or AGI will become pure eugenics state - Why are we keeping elderly or handicapped people alive? Waste of resources, terminate them. Why are we allowing something like love to exist? People should be selected for breeding based on <trait which AGI considers important>
Add to AGI superior intelligence and very likely an ability to manipulate humans, then people will wholeheartedly agree with whatever nasty stuff will AGI come up with.
Being run by AGI can be an utopia, or AGI will become pure eugenics state - Why are we keeping elderly or handicapped people alive? Waste of resources, terminate them. Why are we allowing something like love to exist? People should be selected for breeding based on <trait which AGI considers important>
Add to AGI superior intelligence and very likely an ability to manipulate humans, then people will wholeheartedly agree with whatever nasty stuff will AGI come up with.