Robots doing everything -is- a cool idea, but as with everything else, centralized control would bork it. As you point out, a centralized node of control would still have no way of determining what everyone needs, regardless of whether it was robots or people producing everything.
But I love the idea of being able to have robots to do the stuff that we need, so we can all just concentrate on the stuff that we want and like. :)