UN chief warns against concentrated AI power

UN Secretary-General António Guterres has called for AI to be governed through broad international cooperation rather than shaped by a small group of governments and technology companies. Speaking at the opening of the World Artificial Intelligence Conference in Shanghai, he described AI as “humanity’s greatest opportunity in the 21st century”, while warning that it could also become “one of its greatest risks”.

“Technology that will shape the future of humanity must be shaped by all of humanity”, Guterres said. He stressed that AI governance cannot be governed by a handful of countries or companies” and that “every nation needs a seat at the table”. Recent UN efforts include the Global Digital Compact, the Independent International Scientific Panel on AI and the first Global Dialogue on AI Governance, held in Geneva earlier in July.

AI could support medical research, education, food systems, employment and progress towards the sustainable development goals, but unequal access remains a major concern. “One-third of humanity is still offline,” Guterres noted, warning that concentrated computing capacity, expertise and investment could produce “greater inequalities, greater divides in income, in opportunity, in security”. More than 20 countries have nominated centres for a UN-supported capacity-building network, while recommendations for a Global Fund for AI are also expected.

The UN chief identified capacity development, common safety standards and environmental sustainability as central priorities. “Human rights must be protected”, the UN chief said. “Humans must keep control over every life-and-death decision.” He also stressed that “no AI system should be put in a child’s hands before it has been proven safe”.

Guterres called on major AI companies to disclose their environmental impact and use renewable energy by 2030. “The defining question is whether that transformation will reduce inequalities or reinforce them,” he said. “Whether it will concentrate power or expand opportunity.”

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!