Back to list

AI Business虎嗅

Once AI Is Smarter Than Humans, Will It Really Control Humanity?

虎嗅1 min read
Read original
Once AI Is Smarter Than Humans, Will It Really Control Humanity?

AI Summary

A researcher who helped train large models left over concerns that superintelligence could slip out of control. But between being smarter and holding real power lie capital, organizations, laws, institutions, and countless human actions. The real issue is how AI can use existing markets, companies, and competition to accumulate resources, and whether humans will gradually hand over judgment as AI proves ever more accurate and efficient.

AI Insights

The article argues that AI control is less about raw intelligence than about how capital, corporate competition, and institutional incentives channel resources toward AI systems. The more realistic risk is gradual delegation: humans voluntarily ceding judgment to systems that are increasingly accurate and efficient, rather than a sudden takeover. For AI and tech firms, this points to the need for governance frameworks that keep human decision-making authority explicit and accountable.

Analysis written by AI from the original article. Check it against the source.

Translated text

A researcher who had taken part in training large models left his job because he feared superintelligence could get out of control. Yet between being smarter and holding real power there remain capital, organizations, law, institutions, and the actions of countless people. The question worth discussing is how AI can use the markets, companies, and competitive mechanisms that already exist in modern society to keep acquiring more resources. A deeper question is whether, as AI repeatedly proves more accurate and efficient, we will voluntarily hand over more and more of our judgment. Real control may not be a machine suddenly taking over the world, but humans gradually giving up their judgment about the goals themselves.

Related News

3