I've always loved games and I've been interested in making great games. So I tend to read and watch about them and that's how I first came across Sesame Credit in 2016 and I found it to be bizarre and disgusting. Considering the current events regarding social media events like Zuckerberg's Congressional Hearings and all sorts of censorship I think sensible people would be fully opposed to an idea like this.

But then again, not all people are sensible.

You are looking at things too one-dimensionally. This system will teach people to think clearly of the consequences before acting. And as for the convicts, if they had committed a crime when not under surveillance, who is to say they could be trusted? Even if they regret it, they didn’t think their actions through or weren’t being careful and thus ended up in a bad place. Either way it would be their own fault. And keep in mind that they only use public records (bank records, criminal records...) Their score is rated by the system, not by the people you interact with.
Besides, this credit system isn’t the only paying app available to use and certainly is not the most popular. (Im from China and only one or two of my friends use this paying system.) This paying system has been released and talked about for years, not only in China but in the West too.
Instead of wasting your time rambling on about the cons of using this, it would be much more productive and practical for you to provide solutions.
-Flora Hung (An Internet Idiot)

But this isn't the biggest problem out there. There is one thing that could make everything far worse. That's AI. I'm a big fan of technology like most people on the blockchain. There's a lot of talk about AI and machine leaning. To me AI is a tool and it can be used for anything. The invention of computers created whole new kind of criminal activity called cyber-crime. These computers and mobile devices also created many attack vectors to ruin individual lives. Just think about the data hacks and the Fappening.

AI as a central point of Failure

Everything is getting decentralized these days. Software dependency is an exception. Hardware and information can be spread around, but the underlying software cannot be. Blockchain and Cryptos are at the same time the most decentralized and centralized innovation on Earth. Think about what happened to Verge where they got attacked by hackers for 3 hours and the software was exploited to instamine almost a million dollars worth coins. You could also take a look at what happened with IOTA few months ago with massive network congestion or that time where BTC fees were so high one could FedEx the private keys for a cheaper price which also could have been faster than the actual BTC network.

We are always going to need options and alternatives. Universal AI is the exact opposite

Since computer code isn't biased towards anybody many thinks about letting AI be in-charge of governance, law, ethics etc. What these people forget is that though AI cannot be biased, they can be bugged. Think what would life be like if there was no alternative to BTC. If we rely on AI an when things go bust, we won't have options. Murphy's law is real. Anything that can happen, will happen. When it is about things as complex as AI, we won't even see it coming.

This isn't some rouge AI or dystopia I'm talking about. I'm talking about things like Ethereum DAO hack/non-hack, IOTA congestion, Monero's privacy problems (https://monerolink.com/monerolink.pdf) that were allegedly fixed etc. Think about a world where AI deals in matters of subjectivity like law and morality. Unlike fixed systems AI are always evolving. I'll let you take a look at how complex a fixed non-AI system can become with an example from Dwarf Fortress video game.

Compared to the complexity of an AI, Dwarf fortress is as Easy and Simple as ABC. If we make AI in a way where we have to depend on them instead of using them as supplementary tools and if we start relying on the same code-base on a global level, a catastrophe could occur simply out of the complexity of the system even without a single malicious intent behind. Next time you think about how great unbiased AI can be, don't forget how things can get screwed if we rely on them in the wrong way.

People are not thinking far ahead when it comes to things like Sesame Credit. That's how malicious government entities take control from people to create 1984 scenarios. But that's still just simple surveillance. They are non-evolving static systems. If you need to stay away from the harm, you need to stay out of the radar of the system. When it comes to AI development, just having open source codes and even trying our best to keep things bug free isn't enough. AI dependency can become the worst form of centralization mankind has to face. We must never allow AI to have control over non-objective matters. AI can be a great problem solver and we should use it for that purpose. But AI should never be a judge when it comes to things like morality or else capitalism would have ended up creating the ultimate form of communism.