I don't believe they would try to exterminate us bc we are in the way (as you describe). I also do not believe they would get smart, and in a nanosecond decide to kill us off (as the movie Terminator showed). The danger is that evil humans will build armies of robots that will annihilate humanity. It's not controlling technology that is the problem, it is stopping evil human beings that is the necessity. The question is, what kind of human being would do this, in reality, and how would you stop them?
RE: Are we able to build AI that will not ultimately lead to humanity's downfall?