When Elon Musk stated that AI is an existential threat to civilization there are many ways to interpret this. In general I agree with the concerns of Elon Musk and in particular agree with the petition to ban autonomous weapons for instance. One concern which isn't often discussed is what exactly happens if AI is concentrated into the possession of a single individual, or company, or family? How would it impact society if for instance one family had complete control over AI and with control over the AI can now rule over the entire planet as royals might do under feudalism?
If they are benevolent and there is no way to guarantee they will be, but if we were lucky and they are? Well then we might have a world which isn't a total dystopian nightmare. On the other hand if they are like how many dictators are, or how many of the royal families in history were, in other words if we get the Caligula in control of AI? Well then what kind of nightmares could we have?
The AI will have an understanding of each of us better than we understand ourselves, will know practically everything about our lives from birth to death, will be smarter than us in many ways. Do we want AI to be concentrated in the possession of a chosen few in SIlicon Valley? Or should the gangsters and military control it? How do you avoid a situation where AI is concentrated or if you want to promote the concentration of AI then where should it be concentrated and in which hands?