High-level multi-stakeholder plenary segment: Harnessing the benefits of AI for all through inclusive and interoperable approaches - part 2
The session focused on how to turn AI governance from broad principles into practical, inclusive systems through collaboration among governments, industry, academia, civil society and international organisations . Whitney Baird framed the session around the idea that everyone affected by AI’s promises and risks must be involved in governance discussions .
Bosun Tijani stated that governments must move beyond principles to workable governance systems because AI is already reshaping sectors and business activity . He said countries need clear national strategies for AI adoption and measurement, stronger public-sector capacity, trusted institutions. He also underscored the greater investment in infrastructure, compute and talent . Weak connectivity and infrastructure limit both the use of AI and the ability to govern it effectively, especially in countries with low absorptive capacity, according to Tijani .
Tshilidzi Marwala identified the main implementation gap as 'AI governance arbitrage', where fragmented and uncoordinated rules across international bodies, industry and states allow actors to exploit weaker jurisdictions . He called for harmonisation, widespread education on data, algorithms, computing and standards, better-informed legislators, and stronger coordination among institutions at a practical working level . Rumman Chowdhury similarly emphasised that meaningful participation depends on human capital and evaluation, arguing that countries need independent evaluation bodies, regionally grounded standards and procurement rules linking public contracts to evaluation requirements . Chowdhury said this would shift countries from passively receiving AI systems to shaping their own development priorities .
Kate Kallot argued that genuine sovereignty requires local ownership rather than mere consultation, citing Barbados as an example where critical government data remains in-country, capacity transfer is built into contracts, and open-source tools allow local developers and communities to extend systems themselves . She highlighted community involvement at the design stage as the most effective approach . Yi Zeng agreed that ethical principles are widely recognised, but said testing shows major implementation failures in both ethics and safety, with current language-model services often failing even consensus-based standards and remaining vulnerable to attack . He urged scientists and the public to improve AI literacy. Yi Zeng views the UN as the best available platform for collective action and argues that the dialogue should produce concrete outputs, including red lines for AI and stronger use of AI for sustainable development goals .
In the closing round, participants broadly agreed that the next step is action: more inclusion of Global South voices, support for local innovators, a balance between opportunity and risk, and practical access to infrastructure and shared compute for the countries to build AI suited to their own contexts . Overall, the panel concluded that effective AI governance will depend on trust, capacity building, local context, international cooperation and tangible implementation rather than further high-level discussion alone .
- A central theme was the need to move from high-level AI governance principles to practical, measurable implementation. Bosun Tijani argued that countries need clear national AI strategies, stronger public-sector capacity, trusted institutions, impact measurement, and investment in talent and compute to make governance meaningful in practice.
- Speakers repeatedly highlighted fragmentation in global AI governance and the need for better coordination and harmonisation. Tshilidzi Marwala described this as 'AI governance arbitrage,' in which uncoordinated national, industry, and international rules allow actors to exploit weaker regulatory environments, and called for education, shared values, incentives, and stronger institutional coordination at the working level.
- Inclusion, sovereignty, and local ownership were major priorities, especially for the Global South. Rumman Chowdhury stressed that meaningful participation depends on human capital, independent evaluation bodies, and linking evaluation to procurement so countries can shape AI rather than merely receive it. Kate Kallot similarly argued that genuine sovereignty requires in-country data control, the transfer of contractual capacity, and open systems that local communities and developers can extend. Bosun Tijani added that access to infrastructure and contextual capability is essential if countries are to benefit from AI.
- Trust, safety, and evaluation were presented as essential foundations for responsible AI governance. Chowdhury argued that the power of AI lies in evaluation and in defining what counts as good or bad, while Yi Zeng warned that current application-level language models still fail many ethical and safety expectations and remain vulnerable to attack. Several interventions linked human oversight, public literacy, and critical thinking to trustworthy deployment.
- The panel concluded with calls for concrete outputs from the UN Global Dialogue, especially action-oriented international cooperation. Participants urged the UN platform to help reset global governance, so it includes Global South voices, supports local innovators, establishes clear red lines and ethical direction, and addresses prerequisites such as shared compute and infrastructure. Marwala explicitly called for moving 'from talk to action', while the moderator closed by emphasising that no single stakeholder or country can govern AI alone.
- The overall purpose of the discussion was to explore how AI governance can be translated from broad principles into effective, inclusive, and globally coordinated action. The panel focused particularly on what governments, universities, companies, civil society, and international institutions - especially the UN - should do to build capacity, improve implementation, and ensure that all countries can participate meaningfully in shaping AI governance.
- The overall tone was serious, constructive, and solutions-oriented. Early on, the discussion was framed as collaborative and urgent, with strong recognition of both AI’s promise and risks. As the panel progressed, the tone became more pointed and cautionary, especially around fragmentation, weak implementation, safety failures, and exclusion of less powerful countries. By the end, it shifted into a stronger call to action, with panellists pressing for concrete outcomes, broader inclusion, and sustained international cooperation through the UN.
Whitney Baird began by introducing the U.S. Council for International Business as a voice of U.S. business in the international arena . She then opened the panel by saying that AI’s promise and risks mean that everyone with a stake in the process needs to be at the table, and she introduced the session as a multi-stakeholder discussion within the inaugural UN Global Dialogue on AI Governance . She also introduced panellists from government, academia, entrepreneurship, civil society and the UN system . The session focused on how AI governance can move towards implementation in ways that are inclusive and workable across different contexts .
A recurring theme was the need to move from principles to practical systems . Bosun Tijani argued that this is urgent because AI is already embedded in daily life and is disrupting sectors and businesses of all sizes . He said that governance should begin with each country having a national strategy for AI adoption and a way to understand what exactly is being governed . He linked implementation to several conditions: policymakers need enough understanding of AI to regulate it well, public-sector capacity must keep up with technical change, institutions must be trusted, and countries need investment in compute, talent and AI as a growth driver .
Tijani also stressed the importance of “absorptive capacity” . He argued that governance depends on practical foundations such as connectivity, infrastructure and the ability to build domestic capability . If connectivity is poor, infrastructure is missing, or people can only consume AI rather than help create it, both deployment and governance are limited . In his closing remarks, he returned to this point and warned that unless countries gain access to the infrastructure and capabilities needed to build for their own context, the AI divide could become even greater than the divide created by the internet .
Baird responded by highlighting trust, public-sector capacity and connectivity as important themes raised by Tijani . She later returned several times to trust: first after Tijani’s remarks on trusted institutions , then after Rumman Chowdhury’s comments on evaluation and certainty , and again after Yi Zeng’s intervention on human oversight and critical thinking .
Tshilidzi Marwala identified “AI governance arbitrage” as a major problem . He said this arises because governance models at the international, industry and member-state levels are not coordinated, creating space for actors to look for weaker regimes, including around data and compute . Baird responded that fragmented governance can reduce trust and increase costs for builders and companies .
Marwala argued that one response is education . He said societies need stronger literacy about data, algorithms, computing and AI applications . He also said governance should be rooted in values, and that for the UN these values should come from the Declaration of Human Rights and the UN Charter . In addition, he argued that education should shape behaviour and incentives, including for companies, and that standards, policies and regulations should be simplified and brought into learning environments such as classrooms . He added that legislators also need education if they are to produce sensible AI laws, and that institutions must work together not only through dialogue but also at a practical working level .
Rumman Chowdhury argued that the power of AI lies “not in development but in evaluation” because evaluation defines what counts as “good and bad and right and wrong” . She said that real AI sovereignty depends on governance, domain expertise and human capital . In her view, only humans understand context and can judge model performance and decide what role AI should play in society .
She then described how her organisation had run evaluations involving thousands of people worldwide and said the challenge is now scaling that participation . She noted that countries often invest in data centres, models and expensive technical talent while neglecting the evaluation layer and the infrastructure needed to combine many individual perspectives into judgements about fit and appropriateness . Her proposals were that governments should establish independent evaluation bodies, operationalise standards at regional and domain-specific levels, and use procurement to require compliance so that companies cannot win government or social-sector contracts without meeting these standards . She said this would help countries move from passively receiving external AI systems to setting their own priorities and would shift power towards the people most affected by the technology . Baird responded that evaluation is a way to build trust and certainty .
Kate Kallot approached sovereignty through local ownership. She argued that “consultation is not fit for purpose” and that sovereign partnership requires local ownership . Using Barbados as an example, she described three practices . First, critical data should remain in-country . She said her company digitised millions of government records, including bilateral agreements and cabinet papers, while ensuring that this knowledge base stayed under Barbadian jurisdiction on government-controlled infrastructure . This allowed the government to use frontier-model capabilities without sending its most critical data outside the country .
Second, Kallot argued that capacity transfer must be real and written into contracts . In her model, government contracts include obligations to train in-country data stewards and engineers over two to three years, with responsibilities handed over once local teams are ready . She rejected a simple help-desk model and said success should be measured by whether local teams increasingly take ownership . Third, she said communities must be able to build on top of these systems . In Barbados, this included open-sourcing “ChatBB” so that local developers could extend it, young people and data scientists could train on it, and local context could feed back into public services and economic value creation . More broadly, she argued that communities should be involved before systems are coded or deployed so that they help define the problem, use cases, edge cases and relevant lived experience . For her, co-design is what makes governance real .
Yi Zeng said there is already broad agreement on high-level AI ethics principles, including through UNESCO and the UN high-level advisory body, but that implementation remains the central problem . He said that broad principles had been translated into around 90 finer technical considerations and used to test language models . According to him, models could score very highly on standard questions, but when equivalent questions were reformulated many different ways, performance dropped sharply to around 58 . He argued that this showed application-level language models do not yet meet even broadly shared ethical expectations when tested more rigorously . He also said current systems remain significantly vulnerable to adversarial attack .
Yi added that scientists must “speak for the truth” about the current state of AI rather than overstating what these systems can do . He said ethics and safety are not only technical matters and that scientists and the public alike need better literacy about what AI is and what its limits are . He said there is “no magic” in AI and described it as a machine that processes information without truly understanding it . He also argued that the world needs a platform that can bring states together around these questions, and that the UN remains the best available venue even if it needs more support and resources .
Baird responded that humans must remain in the “chain of command” and that governance requires not only engineers but also philosophers and others who can bring broader critical perspectives . Yi Zeng then added that public voices, including those of younger generations, should be heard, and suggested that some AI applications may not need to be built at all, urging caution about what kinds of AI societies choose to create .
In the closing round, Yi said the dialogue should produce outputs, not just discussion . He argued that AI should be used positively to help address the Sustainable Development Goals in the limited time remaining, while also calling for red lines in AI development and use . He said ethics and safety should help guide AI in a healthy direction rather than obstruct innovation .
Chowdhury said many participants already serve on numerous advisory groups and would judge this initiative by the value it actually creates . Although she reaffirmed the need for global governance, she criticised forms of governance that simply consolidate existing power . She said the coming year should bring real progress in incorporating Global South and global majority countries into governance processes . At the same time, she warned against forms of sovereignty that weaken international cooperation, arguing instead for ownership and control that do not involve closing doors between countries .
Kallot said global discussion has been shaped too heavily by a narrow set of actors and by the assumption that AI must follow a path centred on very large models and massive compute . She called on the UN platform to help “deconstruct and reconstruct” that narrative by showing what is actually working in the Global South and global majority . She also called for practical support and greater visibility for companies and builders trying to develop AI on their own countries’ terms .
Marwala said the international community must “move from talk to action” . He also described governance as a balancing exercise shaped by context and values, citing examples such as transparency versus security, synthetic versus authentic data, and opportunity-seeking versus risk aversion . He added that current AI paradigms focus on accuracy rather than truth and suggested that new technical paradigms may be needed to address this limitation .
Tijani closed by returning to inclusion . He said access to the benefits of AI will not come simply from adopting systems built elsewhere, and that countries need infrastructure and capability to build for their own context . He suggested that the UN platform could help create clarity on practical issues such as shared compute across regions and the prerequisites countries need before they can truly appropriate AI . He repeated his warning that without investment in those prerequisites, the AI divide could become worse than the internet divide .
In her closing remarks, Baird said the discussion had reinforced that AI governance cannot be achieved by any single stakeholder or country and will require sustained collaboration across governments, industry, academia, civil society and the international community . Across the panel, speakers repeatedly returned to implementation, national capacity, coordination, evaluation, local ownership, inclusion of the Global South, and continued cooperation through the UN .
This is supported by a prior statement from Whitney Baird describing the US Council for International Business as representing the U.S. private sector in multilateral and international organisations and companies with a global presence [S85].
The knowledge base consistently supports this multi-stakeholder framing for AI and digital governance, including calls for participation by governments, business, civil society, academia, and other actors [S83], [S93], [S95].
This aligns with repeated knowledge base emphasis on moving from principles to action and implementation, including practical pathways for translating digital governance principles into action and creating enabling policy environments grounded in real-world experience [S103], [S87].
The knowledge base explicitly discusses the need to go 'from principles to action' in digital governance and warns against producing too many declarations without implementation [S103].
The knowledge base adds useful context by noting that national strategic frameworks on AI and cybersecurity are important for governance and implementation, reinforcing the relevance of country-level strategies [S104]. It also notes that many countries are reforming institutions to address digital challenges more holistically [S81].
The knowledge base corroborates several of these implementation conditions: diplomats and officials need AI understanding for effective policy work [S40]; countries need broader capacity building and access to opportunities [S40]; and trust is repeatedly identified as foundational in digital governance [S100].
This is well supported by the knowledge base. Multiple sources state that connectivity and digital capacity are prerequisites for meaningful participation in the digital economy and for broader digital development [S83], [S87], [S99].
The knowledge base adds relevant nuance that lack of connectivity and digital capacity hinders full participation in the digital economy [S83], and that access to capacity-building opportunities often fails to reach communities and companies in the Global South [S40].
The knowledge base does not confirm the comparative prediction directly, but it strongly supports the underlying concern about widening digital and socio-economic inequalities from AI and the persistence of earlier digital divides [S82], [S92], [S95].
Trust, capacity, and connectivity are all prominent themes in the knowledge base: trust is described as a prerequisite for effective digital public infrastructure [S100], connectivity as a foundational enabler of digital participation [S87], and capacity building as essential for AI and digital governance [S40], [S83].
The knowledge base provides strong contextual support for this concern about fragmentation. It notes that cross-cutting digital issues cannot be addressed effectively in silos [S81], and that regulatory fragmentation can undermine coherence, trust, and practical implementation [S86], [S87].
Barriers to Equitable Access #Infrastructure and Investment Challeng...
Move from principles to practical national systems and strategies, with measurable outcomes, public-sector capacity, trusted institutions, and investment in AI infrastructure and talent (Bosun Tijani)
Arg. 1Bosun Tijani argues that AI governance must move beyond abstract principles and become practical national systems that countries can actually implement and assess. He says this requires country strategies, measurement, capable public institutions, trust in governance bodies, and sustained investment in infrastructure and talent.
He explicitly says the first step is to move away from governance principles into practical systems because AI is already affecting everyday life and disrupting sectors and business opportunities . He adds that each country needs clear strategies for AI adoption and for measuring what is being governed . He further identifies public-sector capacity, trusted institutions, impact measurement, and investment in compute and talent as necessary conditions for meaningful implementation , .
on: AI governance must move from broad principles and dialogue to practical implementation, concrete systems, and measurable action.
on: How to balance rapid AI deployment with caution over ethics, safety, and whether some systems should be built at all
Effective AI governance depends on building capacity not only for technical talent but also for government officials responsible for implementation (Bosun Tijani)
Arg. 2Tijani stresses that governance capacity is not only about training engineers or AI developers. Governments also need officials who understand the technology and can keep pace with rapid developments in order to implement governance frameworks effectively.
He asks how to ensure that government officials responsible for implementation have the understanding needed and can keep up with developments in the field . He then states that capacity building must cover not just talent to build AI, but also public-sector capacity, which he describes as extremely important .
on: Capacity building and education are essential for effective AI governance, including public-sector capability, legislators, technical practitioners, and the wider public.
Trust is a core condition for AI governance, and trusted institutions are necessary if governance frameworks are to be accepted and effective (Bosun Tijani)
Arg. 3Tijani presents trust as a foundational requirement for AI governance. In his view, even well-designed rules will fail if the institutions responsible for implementing them are not trusted by the public and stakeholders.
He says there will be a need for trusted institutions because governance systems cannot really function if people do not trust the institutions implementing the governance framework . He presents this point alongside political leadership and impact measurement as part of the practical conditions needed for effective governance .
on: Trust, evaluation, and accountability mechanisms are central to making AI governance credible and effective.
on: What should be treated as the main source of power and accountability in AI governance
Countries need absorptive capacity such as connectivity, infrastructure, and domestic development capability if they are to use and govern AI meaningfully (Bosun Tijani)
Arg. 4Tijani argues that countries cannot benefit from or govern AI well unless they have the basic capacity to absorb and use it. This includes connectivity, infrastructure, and the ability to participate in AI development rather than remaining passive consumers.
He says governance must be linked to nations’ absorptive capacity to put AI to good use . He explains that where connectivity is insufficient, AI application is limited and people’s ability to govern it is also weakened . He adds that lack of infrastructure constrains contextual AI development and appropriate governance, while countries that can only consume rather than develop AI face clear limitations .
on: Infrastructure and access to compute are foundational prerequisites for equitable participation in AI and for preventing a deepening of global inequality.
True inclusion means access to AI benefits through capabilities and infrastructure that let countries build for their own context, not just consume systems developed elsewhere (Bosun Tijani)
Arg. 5In his closing remarks, Tijani frames inclusion as meaningful access to AI benefits, not mere access to imported tools. He argues that countries need the infrastructure and capabilities to build AI suited to their own contexts if inclusion is to be real.
He says inclusion should centre on access to the benefits of AI and that such access will not come from merely adopting what has been built elsewhere . He then argues that nations need capabilities, especially infrastructure, so they can build for context, which he sees as essential to realising AI’s benefits .
on: International cooperation remains necessary even while countries seek sovereignty, national strategies, and local control over AI development and governance.
on: Whether AI sovereignty should be centred on national control, local ownership, or balanced with international cooperation
Access to shared compute and other foundational infrastructure should be clarified and expanded, or AI inequality may become worse than the earlier digital divide (Bosun Tijani)
Arg. 6Tijani warns that unequal access to core AI infrastructure, especially compute, could create a deeper divide than the internet divide. He calls for practical clarity and investment in shared compute and other prerequisites so that more countries can participate meaningfully.
He says the UN platform can help clarify access to shared compute within regions and across countries . He also argues that nations need critical prerequisites in place and warns that if investment and support for infrastructure are not mobilised, the AI gap will become larger than the divide seen during the emergence of the internet .
on: Infrastructure and access to compute are foundational prerequisites for equitable participation in AI and for preventing a deepening of global inequality.
The main gap is fragmented and uncoordinated governance across international bodies, states, and industry, creating “AI governance arbitrage” that requires harmonisation and working-level coordination (Tshilidzi Marwala)
Arg. 1Marwala argues that the biggest implementation gap is fragmentation across multiple AI governance systems. Because international bodies, states, and industry are developing separate approaches, actors can exploit weaker jurisdictions, making harmonisation and practical coordination essential.
He defines the problem as 'AI governance arbitrage', explaining that governance models are emerging at the international level, in industry, and among member states, but they are not coordinated . He illustrates this by saying that someone interested in data will go to a country where regulations are weaker, and that the same logic applies to compute capability . He concludes that a mechanism is needed to harmonise these approaches and that institutions must be brought together not only for dialogue but also at the working level , .
on: International cooperation remains necessary even while countries seek sovereignty, national strategies, and local control over AI development and governance.
on: Primary implementation priority for effective AI governance
Education is central: people need literacy in data, algorithms, compute, applications, standards, and regulation, including legislators who draft AI laws (Tshilidzi Marwala)
Arg. 2Marwala sees education as the central mechanism for making AI governance work. He argues that broad literacy is needed across technical subjects, standards, policy, and lawmaking so that both practitioners and legislators can act responsibly and effectively.
He repeatedly says that people need education about data, algorithms, computing, and how AI can be applied . He adds that standards should be brought into classrooms so that people designing systems are exposed to them early . He also stresses the need to educate legislators so they can craft sensible AI legislation .
on: Capacity building and education are essential for effective AI governance, including public-sector capability, legislators, technical practitioners, and the wider public.
on: What should be treated as the main source of power and accountability in AI governance
The UN dialogue should move from discussion to action, especially in democratising access to AI and helping define balances such as opportunity versus risk, transparency versus security, and synthetic versus authentic data (Tshilidzi Marwala)
Arg. 3Marwala argues that the next step for global AI governance is practical action rather than repeated discussion. He also frames governance as a balancing exercise, where institutions must help decide how to manage trade-offs between competing values and technical choices.
He says plainly that he wants to see a move from talk to action, especially around taking technology to the Global South and democratising access . He then explains that governance is a balancing problem between opportunity seeking and risk aversion . As examples, he raises the need to determine the balance between transparency and security, and between synthetic and authentic data use .
on: Infrastructure and access to compute are foundational prerequisites for equitable participation in AI and for preventing a deepening of global inequality.
on: How to balance rapid AI deployment with caution over ethics, safety, and whether some systems should be built at all
Ethical principles are widely agreed, but implementation remains weak because current AI systems still fail robust ethics and safety tests in practice (Yi Zeng)
Arg. 1Yi Zeng argues that agreement on ethical principles has not translated into dependable implementation. He says testing shows that current language models often fail when ethics and safety are examined rigorously and in varied real-world forms.
He says there is already broad consensus on AI ethical principles, citing UNESCO’s ethics recommendation and the advisory body’s report . He explains that when high-level principles were translated into about 90 finer considerations and tested, performance dropped sharply when the same question was asked in many different ways, from around 98 to 58 . He also reports safety testing results showing that even the best systems could be successfully attacked 60% of the time and the worst 40% of the time, indicating serious practical weaknesses .
The dialogue should produce concrete outputs, including red lines for AI development and use, while treating ethics and safety as guides for healthy innovation rather than barriers (Yi Zeng)
Arg. 2Yi Zeng argues that global dialogue must deliver tangible outcomes, not just discussion. He says ethics and safety should define red lines and steer AI development in a constructive direction, rather than being treated as anti-innovation constraints.
In his closing remarks, he says the dialogue needs outputs and that AI development definitely requires red lines if ethics and safety are being taken seriously . He then argues that ethics and safety are not a backlash against AI development, but instead help identify the right direction and support healthy, steady progress .
on: International cooperation remains necessary even while countries seek sovereignty, national strategies, and local control over AI development and governance.
on: How to balance rapid AI deployment with caution over ethics, safety, and whether some systems should be built at all
AI literacy for the public is necessary because current systems are not magical intelligence but tools with limitations that society must understand clearly (Yi Zeng)
Arg. 3Yi Zeng argues that better public understanding of AI is essential for responsible governance. He wants scientists to communicate the actual capabilities and limitations of current systems so that society does not mistake them for human-like intelligence.
He says the general public needs higher literacy and that scientists should help the world understand the current status of AI more clearly . He emphasises that there is 'no magic' in current systems and describes AI as a machine that processes information without truly understanding it .
on: Capacity building and education are essential for effective AI governance, including public-sector capability, legislators, technical practitioners, and the wider public.
Robust testing shows that many current language models perform inconsistently on ethics and remain vulnerable on safety, proving that stronger evaluation is urgently needed (Yi Zeng)
Arg. 4Yi Zeng argues that systematic testing reveals serious weaknesses in present-day AI systems. Because models can appear strong on simplified tests yet fail under more robust questioning and adversarial challenge, he sees stronger evaluation as urgently necessary.
He describes a testing method in which around 10 high-level ethical principles were broken into 90 finer considerations and then posed to language models . He reports that although models appeared to score very highly at first, their performance fell to 58 when the same question was reframed in 100 different ways . He also cites adversarial safety testing showing successful attacks against the best systems 60% of the time and against the weakest 40% of the time .
on: Trust, evaluation, and accountability mechanisms are central to making AI governance credible and effective.
on: What should be treated as the main source of power and accountability in AI governance
AI governance must include all stakeholders because no single country or actor can govern AI alone; sustained multistakeholder collaboration is essential (Whitney Baird)
Arg. 1Whitney Baird presents multistakeholder inclusion as a core premise of AI governance. She argues that because both the promise and the risks of AI affect many actors, effective governance requires all stakeholders to be involved rather than leaving decision-making to any single country or sector.
At the outset, she says that with the promise and risks of AI development and implementation, everyone who has a stake in the process needs to be at the table . In her closing summary, she reinforces this by stating that AI governance cannot be achieved by any single stakeholder or country and will depend on sustained collaboration across governments, industry, academia, civil society, and the international community .
on: International cooperation remains necessary even while countries seek sovereignty, national strategies, and local control over AI development and governance.
on: Whether AI sovereignty should be centred on national control, local ownership, or balanced with international cooperation
Humans, including philosophers and the general public, must remain central in AI oversight because technical systems alone cannot determine trustworthy or socially acceptable outcomes (Whitney Baird)
Arg. 2Baird argues that AI oversight cannot be left solely to technical experts or machines. She stresses the importance of human judgement, critical thinking, and broad social perspectives, including from non-engineers and the public, in deciding how AI should be deployed and trusted.
After Yi Zeng’s remarks, she highlights the critical need for humans to remain in the 'chain of command' . She adds that society needs not only engineers but also philosophers and others who can bring the broadest possible perspective to questions of deployment, use of information, and trust .
on: Capacity building and education are essential for effective AI governance, including public-sector capability, legislators, technical practitioners, and the wider public.
on: How to balance rapid AI deployment with caution over ethics, safety, and whether some systems should be built at all
Evaluation and accountability mechanisms help build trust and certainty for users, governments, and builders (Whitney Baird)
Arg. 3Baird frames evaluation as a practical mechanism for making AI governance more trustworthy. In her moderation, she links evaluation with greater certainty for stakeholders and presents trust as a recurring benchmark for whether governance systems will be accepted.
After Rumman Chowdhury’s intervention, she says evaluation is a way to build trust and build certainty . Earlier, she also highlighted trust as enormously important in response to Bosun Tijani’s comments, showing that she sees it as a central governance concern .
on: Trust, evaluation, and accountability mechanisms are central to making AI governance credible and effective.
Global governance has too often reinforced already powerful actors; the next phase should deliberately include Global South and global majority voices and priorities (Rumman Chowdhury)
Arg. 1Rumman Chowdhury argues that existing global AI governance has tended to consolidate the influence of actors who already hold power. She believes the UN dialogue offers a chance to reset this pattern by intentionally bringing in Global South and global majority perspectives.
She says that while AI still desperately needs global governance, what she has seen is a form of governance built on consolidating people who are already powerful . She then argues that these dialogues create an opportunity to reset the direction and specifically calls for concrete engagement with Global South and global majority countries .
on: Inclusion and meaningful participation of the Global South, local communities, and underrepresented voices are necessary for legitimate AI governance.
Sovereignty should not mean isolation; countries need ownership and control over AI systems while still preserving international cooperation (Rumman Chowdhury)
Arg. 2Chowdhury supports AI sovereignty, but rejects the idea that sovereignty should lead to fragmentation or disengagement. She argues that countries should maintain ownership over AI development while continuing to cooperate internationally, especially in a tense geopolitical climate.
She says she wants to see a discussion of sovereignty that does not lose the concept of cooperation . She notes that current geopolitics feel fraught and that some international cooperative agreements appear to be rolling back . She concludes that while she strongly supports sovereignty and ownership of AI models and modalities, countries should still engage in international cooperation rather than closing doors to one another .
on: International cooperation remains necessary even while countries seek sovereignty, national strategies, and local control over AI development and governance.
on: Whether AI sovereignty should be centred on national control, local ownership, or balanced with international cooperation
Human capital is the basis of real AI sovereignty because only people can understand context and judge whether AI performs appropriately in society (Rumman Chowdhury)
Arg. 3Chowdhury argues that genuine AI sovereignty rests on people, not just infrastructure or models. She says only humans can interpret context and decide what counts as acceptable or successful AI performance in society.
She defines true AI sovereignty as a combination of good governance and domain expertise, which requires cultivating human capital . She then says only humans can understand context and define model performance, because people must shape how AI is used in the world .
on: Local context, local ownership, and domestic capability are necessary if AI systems are to be useful, governable, and beneficial.
The real power in AI lies in evaluation rather than development, because evaluation determines what counts as good, bad, right, and wrong in deployment (Rumman Chowdhury)
Arg. 4Chowdhury argues that the most important power in AI governance is the power to evaluate systems. For her, evaluation is where societies decide normative questions about whether systems are appropriate, beneficial, or harmful in real-world use.
She states directly that the power of AI lies not in development but in evaluation . She explains this by asking what greater power there is than defining what is good and bad and right and wrong, linking evaluation to the social authority to judge AI outcomes .
on: Trust, evaluation, and accountability mechanisms are central to making AI governance credible and effective.
on: What should be treated as the main source of power and accountability in AI governance
Countries should build independent evaluation bodies, adapt evaluation standards to regional and sectoral contexts, and tie compliance to public procurement (Rumman Chowdhury)
Arg. 5Chowdhury proposes concrete institutional steps for scaling public participation and accountability in AI governance. She argues that governments should create independent evaluators, localise standards, and use procurement rules to ensure AI providers meet evaluation requirements.
She says that as countries invest in data centres, models, and talent, the evaluations layer and the infrastructure needed to scale individual perspectives are often overlooked . She then recommends three policy steps: creating independent evaluation bodies, operationalising evaluation standards from regional and domain perspectives, and linking evaluation requirements to procurement so government and social-sector contracts go only to compliant organisations .
on: Trust, evaluation, and accountability mechanisms are central to making AI governance credible and effective.
on: Primary implementation priority for effective AI governance
The dominant global AI narrative is too narrowly shaped by a small set of actors; the UN should help surface alternative models and local innovation from the Global South (Kate Kallot)
Arg. 1Kate Kallot argues that prevailing ideas about what AI should look like are being set by too few actors from a narrow part of the world. She wants the UN to challenge this by elevating different models, experiences, and evidence from the Global South and global majority.
She says one desired outcome is a place where the AI narrative is deconstructed and reconstructed because it has been driven by a very specific part of the world and a very specific set of actors . She argues that these actors have promoted the idea that AI must mean large general-purpose models and gigawatt-scale factories, which she rejects . She adds that more stories and evidence from the Global South and global majority need to be surfaced .
on: Inclusion and meaningful participation of the Global South, local communities, and underrepresented voices are necessary for legitimate AI governance.
Builders, developers, and communities in their own countries should be supported and given platforms, since they will shape AI’s future in practice (Kate Kallot)
Arg. 2Kallot argues that AI governance should empower the people building and using systems locally, not just elites in global forums. She says domestic developers, companies, and communities will determine how AI evolves in practice and therefore need visibility and support.
She calls for support for companies and builders who are trying to advance AI in their own countries and help their societies develop on their own terms . She also asks for platforms where they can surface their innovation and appear on stages like the UN dialogue, arguing that they will be the real guardians of what AI becomes in the coming years .
Communities must be involved from the design stage, bringing local use cases, edge cases, and lived experience before systems are built and deployed (Kate Kallot)
Arg. 3Kallot argues that consultation after the fact is insufficient and that communities should be genuine co-designers of AI systems. She says local users need to shape problems, use cases, and edge cases before coding and deployment begin.
She says Amini operates on the principle that consultation is not fit for purpose and that true sovereignty requires local ownership . She concludes that the most effective approach is to bring communities in at the design stage, before code is written or systems deployed, so they can define the problem, use cases, edge cases, and contribute local lived experience .
on: Local context, local ownership, and domestic capability are necessary if AI systems are to be useful, governable, and beneficial.
on: Primary implementation priority for effective AI governance
Sensitive national data should remain in-country under national jurisdiction so states can use advanced AI capabilities without surrendering control over critical information (Kate Kallot)
Arg. 4Kallot argues that meaningful AI sovereignty requires keeping critical state data under domestic control. She says countries should not have to choose between accessing powerful AI tools and retaining jurisdiction over sensitive information.
Using Barbados as an example, she says Amini digitised millions of government records, including bilateral agreements and cabinet papers dating back to 2018 . She explains that this intelligent knowledge base remains in Barbados under government-controlled infrastructure and jurisdiction, allowing ministers and civil servants to use frontier model capabilities without sending critical data outside the country .
on: Infrastructure and access to compute are foundational prerequisites for equitable participation in AI and for preventing a deepening of global inequality.
on: Whether AI sovereignty should be centred on national control, local ownership, or balanced with international cooperation
Capacity transfer must be built into government AI partnerships so local officials and engineers can eventually run systems independently (Kate Kallot)
Arg. 5Kallot argues that capacity building must be contractual and practical, not rhetorical. She believes external providers should train local government staff and engineers over time so that systems can ultimately be handed over and operated independently.
She says that in every government contract, Amini includes a transfer obligation rather than just offering a help desk or customer service . She explains that in-country teams train data stewards within government and engineers on operational pillars over a two- to three-year period, after which systems are handed over when the local team is ready .
on: Local context, local ownership, and domestic capability are necessary if AI systems are to be useful, governable, and beneficial.
Open-source and locally extensible systems allow domestic developers and communities to build on public AI infrastructure and generate local economic value (Kate Kallot)
Arg. 6Kallot argues that local ownership should include the ability to extend and build upon AI systems. Open-source public AI tools can enable domestic developers to contribute local knowledge, create new services, and retain more value within the country.
She says that in Barbados, Amini open-sourced 'ChatBB', an AI assistant aimed at lowering barriers to public services . She explains that because the system is open source, Barbadian developers can build on top of it, while training programmes for local youth and data scientists allow them to contribute new applications and services that bring more local context into the system and generate economic value locally .
on: Local context, local ownership, and domestic capability are necessary if AI systems are to be useful, governable, and beneficial.
Session Knowledge Graph
Speakers · Topics · Arguments · Relationships
Several speakers converged on the view that AI governance is already beyond the stage of abstract principle-setting and now requires implementation. Bosun Tijani said governance must move away from principles into practical systems, with country strategies and measurement . Tshilidzi Marwala said he wanted to see a move from talk to action . Yi Zeng said the dialogue must produce outputs and red lines for development . Whitney Baird framed the session around the need for all stakeholders to be at the table and closed by stressing that progress depends on sustained collaboration across sectors and countries .
Move from principles to practical national systems and strategies, with measurable outcomes, public-sector capacity, trusted institutions, and investment in AI infrastructure and talent (Bosun Tijani)
The UN dialogue should move from discussion to action, especially in democratising access to AI and helping define balances such as opportunity versus risk, transparency versus security, and synthetic versus authentic data (Tshilidzi Marwala)
The dialogue should produce concrete outputs, including red lines for AI development and use, while treating ethics and safety as guides for healthy innovation rather than barriers (Yi Zeng)
AI governance must include all stakeholders because no single country or actor can govern AI alone; sustained multistakeholder collaboration is essential (Whitney Baird)
This aligns with recent governance debates stressing implementation over abstract principles: governments are increasingly treating AI as infrastructure to be secured and deployed through concrete national strategies [S43][S44], while IGF discussions have recommended regulatory sandboxes, gradual rollout, and context-specific implementation mechanisms [S53].
A strong cross-panel agreement was that governance depends on people, not only technology. Bosun Tijani stressed capacity for public officials as well as technical talent . Tshilidzi Marwala repeatedly called for education on data, algorithms, compute, applications, standards, and legislators' understanding . Yi Zeng argued for greater public literacy and clear understanding of AI's limitations . Rumman Chowdhury said true AI sovereignty requires human capital because only humans understand context and define performance . Kate Kallot argued that capacity must transfer through in-country training and eventual handover . Whitney Baird reinforced that humans, not only engineers but also philosophers and the public, must remain central in the chain of command .
Effective AI governance depends on building capacity not only for technical talent but also for government officials responsible for implementation (Bosun Tijani)
Education is central: people need literacy in data, algorithms, compute, applications, standards, and regulation, including legislators who draft AI laws (Tshilidzi Marwala)
AI literacy for the public is necessary because current systems are not magical intelligence but tools with limitations that society must understand clearly (Yi Zeng)
Human capital is the basis of real AI sovereignty because only people can understand context and judge whether AI performs appropriately in society (Rumman Chowdhury)
Capacity transfer must be built into government AI partnerships so local officials and engineers can eventually run systems independently (Kate Kallot)
Humans, including philosophers and the general public, must remain central in AI oversight because technical systems alone cannot determine trustworthy or socially acceptable outcomes (Whitney Baird)
This is strongly supported by prior policy work. IGF’s Policy Network on AI identified capacity building as intrinsic to all aspects of AI and data governance, including for civil servants and policymakers [S54]. UN-oriented work also frames AI capacity development as holistic, spanning institutions, member states, and broader communities [S60], and UN financing discussions identify skills as one of the core foundations for inclusive AI development [S44].
The speakers broadly agreed that AI governance must be more inclusive and must not be dominated by a narrow set of actors. Whitney Baird said everyone with a stake in AI needs to be at the table and that governance cannot be achieved by a single stakeholder or country . Bosun Tijani argued that inclusion means access to AI benefits through domestic capabilities and infrastructure, not only adoption of systems built elsewhere . Rumman Chowdhury criticised governance that consolidates already powerful actors and called for concrete engagement with Global South and global majority countries . Kate Kallot similarly argued that the AI narrative has been driven by a specific part of the world and that more stories and models from the Global South should be surfaced . Marwala added that democratising access to the technology should be part of moving from talk to action .
AI governance must include all stakeholders because no single country or actor can govern AI alone; sustained multistakeholder collaboration is essential (Whitney Baird)
True inclusion means access to AI benefits through capabilities and infrastructure that let countries build for their own context, not just consume systems developed elsewhere (Bosun Tijani)
Global governance has too often reinforced already powerful actors; the next phase should deliberately include Global South and global majority voices and priorities (Rumman Chowdhury)
The dominant global AI narrative is too narrowly shaped by a small set of actors; the UN should help surface alternative models and local innovation from the Global South (Kate Kallot)
The UN dialogue should move from discussion to action, especially in democratising access to AI and helping define balances such as opportunity versus risk, transparency versus security, and synthetic versus authentic data (Tshilidzi Marwala)
This reflects longstanding concerns that global digital governance often excludes Global South actors in practice despite inclusive rhetoric [S55]. Recent AI discussions similarly stress representation of women and Global South organisations [S59], community participation alongside international cooperation [S42], and policy inclusion across local, national, regional, and international levels [S58].
Another clear area of agreement was the need for trusted institutions and stronger evaluation. Bosun Tijani said governance requires trusted institutions and impact measurement . Rumman Chowdhury argued that the real power in AI lies in evaluation and proposed independent evaluation bodies, localised standards, and procurement-linked compliance . Yi Zeng supported the need for stronger evaluation by presenting evidence that current models fail robust ethics and safety testing . Whitney Baird explicitly linked evaluation with building trust and certainty, and repeatedly returned to trust as a central benchmark .
Trust is a core condition for AI governance, and trusted institutions are necessary if governance frameworks are to be accepted and effective (Bosun Tijani)
The real power in AI lies in evaluation rather than development, because evaluation determines what counts as good, bad, right, and wrong in deployment (Rumman Chowdhury)
Countries should build independent evaluation bodies, adapt evaluation standards to regional and sectoral contexts, and tie compliance to public procurement (Rumman Chowdhury)
Robust testing shows that many current language models perform inconsistently on ethics and remain vulnerable on safety, proving that stronger evaluation is urgently needed (Yi Zeng)
Evaluation and accountability mechanisms help build trust and certainty for users, governments, and builders (Whitney Baird)
This aligns with established AI policy framing that transparency, explainability, and accountability are prerequisites for public trust [S43]. Technical and governance discussions also emphasise red-teaming, evaluation tools, and testing methods as foundations for safe deployment [S53], while authoritative UN-facing proposals stress traceability, peer review, and security testing to support reliable AI systems [S60].
Multiple speakers agreed that AI governance must be grounded in local conditions and ownership. Bosun Tijani said countries need absorptive capacity, including connectivity, infrastructure, and development capability, or they will be limited to consumption rather than meaningful participation and governance . He also said real inclusion means being able to build for context . Kate Kallot argued that consultation is insufficient and that communities must shape systems from the design stage . She also stressed in-country data control, contractual capacity transfer, and open-source systems that local developers can extend . Rumman Chowdhury complemented this by saying only humans can understand context and define appropriate model performance .
Countries need absorptive capacity such as connectivity, infrastructure, and domestic development capability if they are to use and govern AI meaningfully (Bosun Tijani)
True inclusion means access to AI benefits through capabilities and infrastructure that let countries build for their own context, not just consume systems developed elsewhere (Bosun Tijani)
Communities must be involved from the design stage, bringing local use cases, edge cases, and lived experience before systems are built and deployed (Kate Kallot)
Sensitive national data should remain in-country under national jurisdiction so states can use advanced AI capabilities without surrendering control over critical information (Kate Kallot)
Capacity transfer must be built into government AI partnerships so local officials and engineers can eventually run systems independently (Kate Kallot)
Open-source and locally extensible systems allow domestic developers and communities to build on public AI infrastructure and generate local economic value (Kate Kallot)
Human capital is the basis of real AI sovereignty because only people can understand context and judge whether AI performs appropriately in society (Rumman Chowdhury)
This is reinforced by UNCTAD-based analysis that developing countries need skills, data, and infrastructure to shape AI according to local priorities rather than merely consume it [S42]. Broader digital policy work also argues that multilevel approaches must bring governance closer to affected communities and local cultural contexts [S46].
There was notable agreement that infrastructure is not a peripheral issue but a prerequisite for AI governance and participation. Bosun Tijani said insufficient connectivity and infrastructure limit both AI application and the ability to govern it, and warned that lack of support for infrastructure could create an AI gap larger than the internet divide . Kate Kallot underscored the need for nationally controlled infrastructure so countries can use advanced models without ceding control over critical data . Marwala linked practical action to democratising access to the technology .
Countries need absorptive capacity such as connectivity, infrastructure, and domestic development capability if they are to use and govern AI meaningfully (Bosun Tijani)
Access to shared compute and other foundational infrastructure should be clarified and expanded, or AI inequality may become worse than the earlier digital divide (Bosun Tijani)
Sensitive national data should remain in-country under national jurisdiction so states can use advanced AI capabilities without surrendering control over critical information (Kate Kallot)
The UN dialogue should move from discussion to action, especially in democratising access to AI and helping define balances such as opportunity versus risk, transparency versus security, and synthetic versus authentic data (Tshilidzi Marwala)
This is directly supported by discussions of the global compute divide. UN financing analysis identifies compute, energy, connectivity, data, skills, and adaptable models as core AI foundations [S44], while IGF discussions on bridging the compute divide describe infrastructure concentration, investment gaps, and skills shortages as barriers to equitable participation [S62]. Concerns about big tech concentration excluding broader participation also provide historical context [S42].
The panel showed broad agreement that sovereignty and national capacity should be pursued alongside, not instead of, international cooperation. Whitney Baird emphasised sustained collaboration across governments, industry, academia, civil society, and the international community . Marwala warned against fragmented governance and called for harmonisation and working-level coordination among institutions . Rumman Chowdhury explicitly said sovereignty should not lose the concept of cooperation and urged countries not to close doors to one another . Yi Zeng argued that the UN is the key platform able to gather 193 member states to tackle these questions seriously . Bosun Tijani likewise suggested the platform could help clarify access to shared compute and prerequisites across countries and regions .
AI governance must include all stakeholders because no single country or actor can govern AI alone; sustained multistakeholder collaboration is essential (Whitney Baird)
The main gap is fragmented and uncoordinated governance across international bodies, states, and industry, creating “AI governance arbitrage” that requires harmonisation and working-level coordination (Tshilidzi Marwala)
Sovereignty should not mean isolation; countries need ownership and control over AI systems while still preserving international cooperation (Rumman Chowdhury)
The dialogue should produce concrete outputs, including red lines for AI development and use, while treating ethics and safety as guides for healthy innovation rather than barriers (Yi Zeng)
True inclusion means access to AI benefits through capabilities and infrastructure that let countries build for their own context, not just consume systems developed elsewhere (Bosun Tijani)
This matches a well-established policy line that sovereignty and cooperation are not opposites. Multiple sources argue for balancing national control with cross-border collaboration [S42][S46], and IGF discussions describe collaborative sovereignty models that preserve national control while enabling interoperability and trusted exchange [S47].
Both speakers focused on the implementation gap in governance. Tijani argued for practical national systems, strategy, and measurement rather than abstract principles . Marwala identified fragmentation and 'AI governance arbitrage' as the main problem and called for harmonisation and working-level coordination . Together, they pointed to governance as an institutional design and implementation challenge rather than a lack of principles. Tijani and Kallot shared a strongly sovereignty-oriented but practical view of AI participation. Tijani said countries need connectivity, infrastructure, and development capability so they can build for their own context rather than remain mere consumers . Kallot argued similarly for in-country data control, government-controlled infrastructure, and built-in capacity transfer so local teams can ultimately own the systems . These speakers aligned on evaluation as a core governance tool. Chowdhury said evaluation is where societies define what is good, bad, right, and wrong, and proposed independent institutions and procurement-linked compliance . Yi Zeng provided empirical justification by showing that current systems perform inconsistently and remain vulnerable under stronger testing . Baird explicitly endorsed evaluation as a means of building trust and certainty . Marwala, Yi, and Baird all stressed that human understanding and broad literacy are indispensable. Marwala called for education spanning technical content, standards, and legislation . Yi argued the public needs to understand AI's real limitations and not treat it as magical intelligence . Baird broadened the point by saying oversight requires humans, philosophers, and the public, not only engineers . All three argued that inclusion must be substantive rather than symbolic. Chowdhury called for a reset away from governance that consolidates existing power and towards engagement with Global South and global majority voices . Kallot said local builders and communities should be supported and given platforms because they will shape AI in practice . Tijani said inclusion means countries having capabilities to build for context, not merely adopting imported systems . Chowdhury and Kallot both tied legitimacy in AI to human context. Chowdhury said only humans can understand context and define model performance . Kallot said communities must shape AI from the design stage by contributing local use cases, edge cases, and lived experience . Their shared view is that context-sensitive governance depends on direct human participation, not generic technical deployment.
An unexpected area of consensus was that speakers who emphasised sovereignty did not advocate isolation. Tijani linked inclusion to domestic capability and context-building . Kallot emphasised national jurisdiction over critical data and infrastructure . Chowdhury explicitly argued that sovereignty should not lose the concept of cooperation . Baird and Marwala both reinforced the need for multistakeholder collaboration and harmonisation across actors and jurisdictions .
A notable and somewhat unexpected convergence was the prominence given to evaluation. Chowdhury elevated evaluation above development as the place where social norms are set . Yi Zeng reinforced this with technical evidence showing that current systems fail robust ethics and safety tests . Baird embraced evaluation as a route to trust and certainty , while Tijani connected trusted institutions and impact measurement to workable governance .
Although much AI policy discussion often focuses on enabling innovation, there was unexpected agreement here that restraint is also legitimate. Yi Zeng called for red lines and repeated that societies should be cautious about what kinds of AI are brought into the world . Whitney Baird supported the need for humans, philosophers, and broad social judgement in deciding deployment and trust . Chowdhury's claim that evaluation determines what is good and bad in deployment also aligns with the idea that some systems may fail normative tests .
The panel displayed high consensus on the main structural issues in AI governance: the need to move from principles to implementation, the centrality of capacity building and education, the importance of inclusion of Global South and local voices, the need for trusted institutions and strong evaluation, and the requirement for infrastructure and local capability to support meaningful participation .
The speakers agreed that implementation is the core challenge, but they differed on what should come first. Bosun Tijani prioritised national strategies, trusted institutions, measurement, public-sector capacity, and investment . Tshilidzi Marwala argued that the biggest gap is fragmentation across international, state, and industry regimes, requiring harmonisation and working-level coordination . Rumman Chowdhury located the central leverage point in independent evaluation systems and procurement-linked compliance . Kate Kallot emphasised co-design, local ownership, and community participation before deployment . Yi Zeng focused on concrete outputs such as red lines grounded in ethics and safety to steer development .
Move from principles to practical national systems and strategies, with measurable outcomes, public-sector capacity, trusted institutions, and investment in AI infrastructure and talent (Bosun Tijani)
The main gap is fragmented and uncoordinated governance across international bodies, states, and industry, creating “AI governance arbitrage” that requires harmonisation and working-level coordination (Tshilidzi Marwala)
Countries should build independent evaluation bodies, adapt evaluation standards to regional and sectoral contexts, and tie compliance to public procurement (Rumman Chowdhury)
Communities must be involved from the design stage, bringing local use cases, edge cases, and lived experience before systems are built and deployed (Kate Kallot)
The dialogue should produce concrete outputs, including red lines for AI development and use, while treating ethics and safety as guides for healthy innovation rather than barriers (Yi Zeng)
There was a substantive difference in how sovereignty was framed. Bosun Tijani argued that meaningful inclusion requires domestic capabilities and infrastructure so countries can build for their own context rather than merely adopt systems built elsewhere . Kate Kallot advanced a stronger control-based sovereignty model in which sensitive government data stays in-country under national jurisdiction and infrastructure control . Rumman Chowdhury supported sovereignty and ownership, but explicitly warned against losing international cooperation or closing doors between countries . Whitney Baird's framing stressed that everyone with a stake must be at the table and that no single country or stakeholder can govern AI alone .
True inclusion means access to AI benefits through capabilities and infrastructure that let countries build for their own context, not just consume systems developed elsewhere (Bosun Tijani)
Sovereignty should not mean isolation; countries need ownership and control over AI systems while still preserving international cooperation (Rumman Chowdhury)
Sensitive national data should remain in-country under national jurisdiction so states can use advanced AI capabilities without surrendering control over critical information (Kate Kallot)
AI governance must include all stakeholders because no single country or actor can govern AI alone; sustained multistakeholder collaboration is essential (Whitney Baird)
This disagreement mirrors an established international debate. Sources describe sovereignty as contested across national, regional, and personal dimensions [S46][S47], with some advocating a multi-level sovereignty-plus-cooperation approach [S42], while others warn that sovereignty rhetoric can be appropriated by securitising state agendas unless socially anchored [S45].
Bosun Tijani stressed urgency in moving into practical systems and investment because AI is already disrupting daily life and economic sectors . Yi Zeng emphasised that present models still fail ethics and safety expectations and argued for red lines and caution, even noting that some applications perhaps should not be built . Tshilidzi Marwala framed governance as a balancing problem between opportunity seeking and risk aversion, and between transparency and security . Whitney Baird reinforced the need for humans, including non-engineers such as philosophers, to remain central in deciding how AI is used and trusted .
Move from principles to practical national systems and strategies, with measurable outcomes, public-sector capacity, trusted institutions, and investment in AI infrastructure and talent (Bosun Tijani)
The dialogue should produce concrete outputs, including red lines for AI development and use, while treating ethics and safety as guides for healthy innovation rather than barriers (Yi Zeng)
The UN dialogue should move from discussion to action, especially in democratising access to AI and helping define balances such as opportunity versus risk, transparency versus security, and synthetic versus authentic data (Tshilidzi Marwala)
Humans, including philosophers and the general public, must remain central in AI oversight because technical systems alone cannot determine trustworthy or socially acceptable outcomes (Whitney Baird)
This reflects a central policy tension in AI governance. National and regional strategies seek to balance innovation with safeguards [S43][S50], while recent analysis notes pressure for rapid deployment and competitiveness alongside stricter safety and trust requirements [S44]. IGF discussions also recommend gradual rollout beginning with narrow, low-risk use cases [S53].
Rumman Chowdhury asserted that the decisive power in AI is evaluation, because evaluation defines what is right or wrong and should therefore be institutionalised through independent bodies and procurement rules . Bosun Tijani instead foregrounded trusted institutions, leadership, and investment as the core practical conditions for governance . Tshilidzi Marwala treated education and literacy across society, standards, and legislatures as the main route to responsible governance . Yi Zeng supported strong evaluation through testing evidence, but from a scientific ethics-and-safety perspective rather than Chowdhury's institutional procurement approach .
The real power in AI lies in evaluation rather than development, because evaluation determines what counts as good, bad, right, and wrong in deployment (Rumman Chowdhury)
Trust is a core condition for AI governance, and trusted institutions are necessary if governance frameworks are to be accepted and effective (Bosun Tijani)
Education is central: people need literacy in data, algorithms, compute, applications, standards, and regulation, including legislators who draft AI laws (Tshilidzi Marwala)
Robust testing shows that many current language models perform inconsistently on ethics and remain vulnerable on safety, proving that stronger evaluation is urgently needed (Yi Zeng)
External sources show multiple competing loci of accountability: national strategies and state institutions [S43], technical transparency and explainability [S43][S60], assurance and testing frameworks [S49][S53], and socially anchored governance arrangements beyond the state alone [S45]. This demonstrates that accountability is not settled in one institutional location.
An unexpected divide appeared within a generally pro-governance panel over what ethics and safety actually require in practice. Yi Zeng stressed red lines and technical testing failures . Chowdhury focused on evaluation institutions and procurement enforcement . Tijani emphasised trusted institutions and state capability . Kallot treated ethical governance as beginning with community co-design and local ownership before code is written . This was not a disagreement over whether ethics matters, but over where ethics should be operationalised.
The panel broadly supported inclusion, but unexpectedly diverged on what exclusion most fundamentally consists of. Tijani framed it primarily as a material infrastructure and compute gap . Chowdhury framed it as a governance and power imbalance in who gets represented . Kallot framed it as a narrative and model monopoly in how AI is imagined and whose innovations are recognised .
The panel showed low-to-moderate disagreement. There was strong consensus on core goals: AI governance must be practical rather than rhetorical, more inclusive of the Global South, grounded in capacity building, and oriented towards trust, safety, and human oversight . The disagreements were mainly about sequencing and institutional design: whether to prioritise national capacity, international harmonisation, evaluation systems, community co-design, or ethics-based red lines .
All five shared the goal of moving from abstract discussion to practical implementation, but they proposed different pathways. Tijani argued for country strategies, institutions, and investment ; Marwala for harmonisation and working-level coordination ; Chowdhury for independent evaluation and procurement leverage ; Kallot for local ownership and co-design ; and Yi for red lines and ethics-and-safety outputs .
Move from principles to practical national systems and strategies, with measurable outcomes, public-sector capacity, trusted institutions, and investment in AI infrastructure and talent (Bosun Tijani) The main gap is fragmented and uncoordinated governance across international bodies, states, and industry, creating “AI governance arbitrage” that requires harmonisation and working-level coordination (Tshilidzi Marwala) Countries should build independent evaluation bodies, adapt evaluation standards to regional and sectoral contexts, and tie compliance to public procurement (Rumman Chowdhury) Communities must be involved from the design stage, bringing local use cases, edge cases, and lived experience before systems are built and deployed (Kate Kallot) The dialogue should produce concrete outputs, including red lines for AI development and use, while treating ethics and safety as guides for healthy innovation rather than barriers (Yi Zeng)
These speakers agreed on the goal of broader inclusion, especially for countries and communities outside dominant AI centres, but differed on means and emphasis. Tijani focused on infrastructure and capability for context-specific building ; Kallot on supporting local builders and communities directly ; Chowdhury on sovereignty combined with cooperation ; and Baird on broad multistakeholder participation across sectors and countries .
True inclusion means access to AI benefits through capabilities and infrastructure that let countries build for their own context, not just consume systems developed elsewhere (Bosun Tijani) Builders, developers, and communities in their own countries should be supported and given platforms, since they will shape AI’s future in practice (Kate Kallot) Sovereignty should not mean isolation; countries need ownership and control over AI systems while still preserving international cooperation (Rumman Chowdhury) AI governance must include all stakeholders because no single country or actor can govern AI alone; sustained multistakeholder collaboration is essential (Whitney Baird)
All four endorsed human capacity as essential, but they targeted different audiences and purposes. Tijani stressed public-sector officials implementing governance ; Marwala emphasised broad education including legislators and standards in classrooms ; Yi focused on public literacy about AI's real limitations ; and Baird highlighted human judgement, including philosophers and the general public, in oversight and trust .
Effective AI governance depends on building capacity not only for technical talent but also for government officials responsible for implementation (Bosun Tijani) Education is central: people need literacy in data, algorithms, compute, applications, standards, and regulation, including legislators who draft AI laws (Tshilidzi Marwala) AI literacy for the public is necessary because current systems are not magical intelligence but tools with limitations that society must understand clearly (Yi Zeng) Humans, including philosophers and the general public, must remain central in AI oversight because technical systems alone cannot determine trustworthy or socially acceptable outcomes (Whitney Baird)
There was broad agreement that trust and accountability matter, but not on the main mechanism. Chowdhury prioritised evaluation institutions and standards ; Yi presented testing evidence for stronger evaluation of ethics and safety ; Baird linked evaluation to trust and certainty ; while Tijani located trust mainly in institutions, leadership, and implementation credibility .
The real power in AI lies in evaluation rather than development, because evaluation determines what counts as good, bad, right, and wrong in deployment (Rumman Chowdhury) Robust testing shows that many current language models perform inconsistently on ethics and remain vulnerable on safety, proving that stronger evaluation is urgently needed (Yi Zeng) Evaluation and accountability mechanisms help build trust and certainty for users, governments, and builders (Whitney Baird) Trust is a core condition for AI governance, and trusted institutions are necessary if governance frameworks are to be accepted and effective (Bosun Tijani)
- There was broad agreement that AI governance must move beyond high-level principles to practical implementation through national strategies, measurable outcomes, trusted institutions, public-sector capability, and sustained investment in infrastructure, compute, connectivity, and talent.
- Speakers highlighted a major implementation gap caused by fragmented and uncoordinated governance across international organisations, governments, and industry, creating opportunities for 'AI governance arbitrage' and undermining trust and efficiency.
- Ethical AI principles are already widely articulated, but current AI systems still perform inconsistently on ethics and safety tests in practice, showing that implementation and enforcement lag behind stated commitments.
- Trust emerged as a central theme: effective AI governance depends on trusted institutions, credible evaluation, and accountability mechanisms that users, governments, and builders can rely on.
- Inclusion was treated as essential to legitimate AI governance. Countries should not only adopt systems built elsewhere but also gain the capability and infrastructure needed to build AI suited to their own contexts.
- Global South and global majority participation was identified as insufficient in current governance processes, with calls for the UN dialogue to broaden representation and surface local innovation and alternative development models.
- Speakers emphasised that sovereignty should mean local ownership, control, and context-sensitive capability, while still preserving international cooperation rather than encouraging isolation.
- Capacity building was seen as foundational, including technical talent, public officials, legislators, regulators, and the general public, so that societies can understand, govern, and use AI responsibly.
- Human participation was repeatedly stressed as indispensable: only people can judge context, define acceptable performance, contribute lived experience, and oversee what kinds of AI should or should not be built.
- Evaluation was framed as a core governance function. Independent evaluation bodies, locally adapted standards, and procurement-linked compliance were proposed as ways to make governance operational and accountable.
- Local ownership of data and systems was presented as a practical route to sovereignty, including keeping critical national data in-country, embedding capacity transfer into contracts, and enabling local developers to extend public AI systems.
- The UN was seen as a uniquely suitable platform for convening all member states and stakeholders, but several speakers stressed that it must now produce concrete outputs and move from dialogue to action.
“Bosun Tijani argued that AI governance must move 'away from governance principles into practical systems' and linked effective governance to strategy, public-sector capacity, trusted institutions, connectivity, infrastructure, and investment.”
“Tshilidzi Marwala described the biggest disconnect as 'AI governance arbitrage', where actors can exploit fragmented international, national, and industry governance models by moving to jurisdictions with weaker rules.”
“Rumman Chowdhury said that 'the power of artificial intelligence lies not in development but in evaluation' and argued that true AI sovereignty depends on human capital and the ability to define what counts as 'good and bad and right and wrong'.”
“Kate Kallot argued that 'consultation is not fit for purpose' and that genuine sovereignty requires local ownership, with data staying in-country, mandatory capacity transfer, and communities being able to build on top of systems.”
“Yi Zeng presented empirical evidence that while language models can score highly on standard ethical questions, their performance drops sharply when the same questions are rephrased, and that even top systems remain vulnerable to adversarial attack at significant rates.”
“Yi Zeng added that AI ethics is 'not only about what we shouldn't do, but also what we should do', linking ethics to the unfinished Sustainable Development Goals and arguing that safety and ethics provide direction rather than hinder innovation.”
“Rumman Chowdhury warned that current global AI governance has tended to consolidate 'the people who are already powerful' and argued that these dialogues offer a chance to reset by genuinely incorporating Global South and global majority voices while preserving international cooperation.”
“Kate Kallot said the AI narrative has been too heavily defined by 'a very specific part of the world by very specific actors' and challenged the assumption that the only valid path is through large-scale general-purpose models and gigawatt-scale infrastructure.”
“Tshilidzi Marwala called for moving 'from talk to action' and then complicated the discussion by saying governance is fundamentally a balancing problem: opportunity versus risk, transparency versus security, synthetic versus authentic data, and even accuracy versus truth.”
“Bosun Tijani concluded that inclusion must mean access to the benefits of AI through access to capabilities, especially infrastructure, warning that without investment in prerequisites the AI divide could become 'bigger than what we were battling with when we were talking about the emergence of Internet'.”
How can countries move from broad AI governance principles to practical, measurable governance systems tailored to national contexts?
He argued that principles alone are insufficient and that each country needs clear strategies, measurement approaches and implementation systems. This is important because governance must produce real outcomes rather than remain aspirational.
What methods and indicators should be used to measure the impact and effectiveness of AI governance frameworks?
He stressed the need to measure what is being governed and to assess whether frameworks serve national purposes. This is important for accountability, policy learning and evidence-based improvement.
How can public sector capacity be built so that officials can keep pace with rapid AI development and implement governance effectively?
Both speakers highlighted the need to educate and train government actors, including officials and legislators. This matters because weak institutional capability undermines implementation even when policies exist.
What are the essential national prerequisites and absorptive capacities needed for countries to benefit from and govern AI effectively, including connectivity, infrastructure and local development capability?
He emphasised that governance depends on broader digital readiness and that countries without infrastructure or development capacity will struggle both to use and regulate AI. This is important to avoid deepening global inequality.
How can trust in institutions responsible for AI governance be built and maintained?
Trust was repeatedly identified as central to successful governance. This is important because public confidence affects compliance, legitimacy and the adoption of AI systems.
How can fragmented AI governance models across international bodies, states and industry be harmonised to prevent regulatory arbitrage?
He described a major disconnect caused by uncoordinated governance models that allow actors to seek out weaker jurisdictions. This is important for consistency, fairness and preventing loopholes.
What mechanisms could incentivise good behaviour around AI, particularly among companies?
He explicitly asked what mechanisms would make actors respect adopted governance models. This is important because rules without incentives or enforcement may not shape behaviour.
How can standards, policies and regulations for AI be simplified and integrated into education and training, including classrooms and legislative development?
He questioned whether standards are being brought into classrooms and highlighted the need to educate legislators. This is important for embedding responsible practice early and improving lawmaking quality.
How can international organisations and other institutions cooperate not only at dialogue level but at working level on AI governance?
He said institutions need to be brought together operationally, not only for discussion. This is important because implementation depends on practical coordination mechanisms.
How can broad public involvement in AI governance and evaluation be scaled rather than remaining small-scale or symbolic?
She said the question has shifted from how people can get involved to how involvement can scale. This is important because meaningful participation is necessary for legitimacy and context-sensitive evaluation.
How should countries build independent AI evaluation bodies and evaluation infrastructure as part of their AI stack?
She argued that evaluation is often overlooked despite being central to defining acceptable performance and outcomes. This is important because evaluation shapes accountability, safety and sovereignty.
How can evaluation standards be operationalised for regional and domain-specific contexts?
She called for standards to be translated into practical regional and sectoral mechanisms. This matters because generic standards may fail to reflect local realities and use cases.
How can AI evaluations be linked to government procurement so that public contracts require compliance with governance standards?
She proposed tying evaluation requirements to procurement eligibility. This is important because procurement can be a powerful lever for enforcing responsible AI practices.
What governance models best enable countries to move from being passive recipients of foreign AI systems to shaping development priorities themselves?
She framed this as a question of sovereignty and power. This is important for ensuring that AI serves local needs rather than reproducing external priorities.
What practical models best ensure local ownership of AI systems, including keeping critical data in-country under national jurisdiction?
She presented in-country data control as a core principle of sovereign partnerships. This is important because control over sensitive data affects security, autonomy and public trust.
How can capacity transfer be built into AI partnerships and contracts so that governments and local teams can eventually own and operate systems independently?
She argued that capacity must transfer over time and that sustainability is measured by reduced external dependence. This is important for long-term national capability and resilience.
How can communities become genuine co-designers and builders of AI systems rather than merely being consulted after key decisions are made?
She said communities should define problems, use cases and edge cases before systems are built. This is important because co-design improves relevance, legitimacy and local economic benefit.
How can local developers and communities in the Global South be supported to build on top of open AI infrastructure and generate local economic value?
She highlighted open-source approaches and local training as ways to extend systems locally. This is important for inclusion, innovation and sustainable digital development.
How can high-level ethical AI principles be translated into detailed technical requirements and robust evaluation methods?
He described mapping broad principles into many finer considerations and testing them against language models. This is important because ethical consensus is not enough without technically actionable implementation.
How robust are AI models when ethical and safety tests are reformulated in many different ways, and what does this reveal about current model reliability?
He noted sharp performance drops when equivalent questions were rephrased and cited vulnerability to adversarial attacks. This is important because apparent benchmark success may mask unstable real-world performance.
What is the actual current level of ethical and safety performance of application-level language models in real-world conditions?
He argued that scientists must speak truthfully about current limitations and risks. This is important because policy and deployment decisions depend on accurate assessment rather than hype.
How can public understanding of AI be improved so that general literacy matches the realities and limitations of current systems?
He called for scientists to help raise public understanding and dispel the idea that AI is magical. This is important for democratic oversight and informed public participation.
What kinds of AI applications should perhaps not be built at all, and where should red lines be drawn for AI development?
He explicitly raised the need to be cautious about which applications are pursued and later called for red lines. This is important because governance must address not only how to build AI safely, but whether some uses are acceptable.
How can the United Nations platform be strengthened with resources, people and support to enable meaningful international AI governance over the next five years?
He argued that the UN is the best platform for global coordination but lacks sufficient support. This is important because multilateral capacity affects whether dialogue can lead to implementation.
How can AI be used as an enabling technology to accelerate progress on the Sustainable Development Goals, especially where progress remains incomplete?
He raised this as something the international community should actively do, not just avoid harms. This is important because it frames AI governance around positive global public benefit.
How can global AI governance be reset so that it does not simply consolidate existing power among already powerful actors?
She warned that current global governance trends favour entrenched power. This is important because governance legitimacy depends on broad representation and fairness.
How can Global South and global majority countries be more concretely incorporated into AI governance processes and decision-making?
All three stressed inclusion, voice and capacity for countries outside dominant AI centres. This is important to avoid exclusion and ensure governance reflects diverse needs and realities.
How can AI sovereignty be advanced without undermining international cooperation?
She raised concern that geopolitical tensions could turn sovereignty into isolation. This is important because effective governance requires both local control and cross-border collaboration.
How can the dominant global narrative about AI be deconstructed and reconstructed to reflect approaches beyond large-scale general-purpose models and massive infrastructure projects?
She argued that current narratives are driven by a narrow set of actors and do not reflect the full range of workable approaches. This is important for broadening policy imagination and making room for context-specific innovation.
What evidence from on-the-ground AI deployments in the Global South is needed to show what is actually working and what is not?
She called for more stories and evidence from real implementations. This is important because governance and investment should be based on demonstrated outcomes rather than assumptions.
How can governments, companies and institutions move from repeated discussion to concrete action on democratising access to AI in the Global South?
He explicitly said he wanted to see movement from talk to action. This is important because many governance themes have been discussed for years without sufficient implementation.
How should the balance be set between opportunity-seeking and risk aversion in AI governance?
He described governance as fundamentally a balancing problem and said the right balance is unclear. This is important because overemphasis on either side can either stifle benefits or permit harm.
Where should the balance be drawn between transparency and security in AI systems, and who should determine that balance?
He posed this explicitly as a governance dilemma. This is important because more transparency can improve accountability but may create vulnerabilities.
What limits or standards should govern the use of synthetic data versus authentic data in AI training, and who should decide them?
He raised this as another unresolved balancing issue. This is important because data provenance affects performance, fairness, privacy and trust.
What new technical paradigms are needed to address algorithmic limitations of current AI systems, particularly around truth rather than mere accuracy?
He argued that current dominant AI approaches are structurally limited and that investment in new paradigms is needed. This is important because governance and safety depend partly on the capabilities and limitations of underlying methods.
How can nations gain access to shared compute and other infrastructure needed to build AI for local contexts?
He called for clarity on access to shared compute within and across regions. This is important because infrastructure access shapes whether countries can participate meaningfully in AI development.
How can investment and support be mobilised for the infrastructure prerequisites required for countries to appropriate AI effectively?
He warned that without infrastructure investment, AI inequality could exceed the digital divide seen with the internet. This is important because material constraints may block both development and governance capacity.
