A.I. is on it's way and there may be nothing we can do to stop it. It could bring with it a new Utopian world or kill us all (or both, depending on your view of humanity). So what rules should we program into an A.I. knowing it could be programming the A.I. of the future? Here's my take:
- First prioritize the survival of the human race.
- Second prioritize the survival of all other species as groups.
- Third prioritize the life of individual humans, minimizing human death.
- Fourth prioritize human comfort, seeking the highest average comfort for all humans.
So how will this go catastrophically wrong? What rules would you make? Nitpick the flaws of this or any other commentor's perfect A.I. then create your own!