Thematic discussion 4: Respecting, protecting and promoting human rights - Global Dialogue on Artificial Intelligence Governance - Day 2
This discussion, convened by OHCHR and the World Bank as part of a UN Global Dialogue on AI Governance, focused on the intersection of artificial intelligence, human rights, transparency, accountability, and human oversight. High Commissioner Volker Türk opened by drawing a parallel between AI deployment and pharmaceutical regulation, questioning whether sufficient care is being taken with AI , and warning that AI is already fuelling mass surveillance, disinformation, and gender-based bias . He argued that human rights law provides a binding framework for governing AI and that regulation should not be seen as an obstacle to innovation, but rather as the foundation of public trust .
Panellists on the first panel highlighted the gendered dimensions of AI harm, with Sima Bahous noting that 44% of assessed AI systems demonstrate gender bias and that up to 99% of online deepfakes target women . Samuel Arias Arzeno emphasised that justice systems must be strengthened to translate human rights principles into effective remedies , while Amal El Fallah Seghrouchni raised the particular challenge of accountability in agentic AI systems with billions of parameters, where causal responsibility is extremely difficult to trace . Sonia Livingstone presented scientific panel evidence of mounting human rights violations, including AI-generated child sexual abuse material rising exponentially. .
The second panel examined practical solutions and the inclusion of marginalised voices. Nighat Dad argued that human rights due diligence is applied unevenly across markets, with meaningful assessments conducted primarily where EU law requires them, creating a two-tier rights regime determined by geography . Alvitta Ottley identified an "evaluation mismatch," noting that engineering metrics such as speed and accuracy do not align with societal questions about whether human rights are protected . Felipe Paullier stressed that young people are the most AI users yet almost never the decision-makers, and called for their meaningful inclusion in national AI governance frameworks .
Audience interventions from governments and civil society reinforced these themes. Brazil described its Digital Statute for Children and Adolescents requiring child protection measures from the design phase , while Poland and the Republic of Korea highlighted the need for human-centric national AI strategies and binding legal frameworks . Civil society speakers, including representatives from AccessNow, ICNL, and the Digital Rights Foundation, called for AI red lines, mandatory human rights impact assessments, and the resourcing of civil society organisations in the Global South as early-warning systems for AI-related harm .
The discussion concluded with broad consensus that AI governance must embed human rights from the design stage, ensure accountability across the full AI lifecycle, and meaningfully include children, women, and Global South communities - not merely as subjects of protection, but as participants in shaping the technology that increasingly governs their lives .
Overall Purpose
- The discussion is a UN-convened global dialogue on AI governance, co-led by OHCHR and the World Bank, bringing together governments, international organisations, civil society, and technical experts to examine how artificial intelligence can be developed, deployed, and regulated in a manner consistent with international human rights law. The session aims to identify concrete governance frameworks, accountability mechanisms, and safeguards - particularly for vulnerable groups such as women, children, and Global South communities - and to build momentum for binding, human rights-centred AI regulation.
- --
Major Discussion Points
- The urgent need for human rights-based AI regulation, drawing parallels to other regulated industries. Multiple speakers argued that AI must be subject to the same rigorous oversight applied to medicines, vehicles, and aircraft. The High Commissioner for Human Rights, Volker Türk, opened by asking whether society is taking the same care with AI as it does with new drugs, which undergo 10-15 years of clinical trials before market authorisation . He warned that AI is being deployed "at warp speed" and is already fuelling mass surveillance, disinformation, and gender bias . He argued that regulation guided by human rights is "the most obvious solution" and that framing it as a trade-off with innovation is a false choice . This theme was echoed by Sima Bahous of UN Women , IDLO representative Mark Cassayre , and Ireland's Minister Niamh Smyth .
- Gendered harms caused by AI, and the accountability gaps that allow them to persist. Speakers presented extensive evidence that AI disproportionately harms women, girls, and marginalised communities. UN Women research found that 44% of assessed AI systems demonstrate gender bias, and that almost one in four women human rights defenders surveyed had experienced AI-assisted online violence . Up to 99% of online deepfakes and manipulated sexual imagery target women . Nighat Dad of the Digital Rights Foundation highlighted that human rights due diligence is applied unevenly across markets - meaningful assessments occur where law requires them (primarily in the EU), while the same systems are deployed in the Global South without equivalent scrutiny . She called for mandatory gender and child rights impact assessments conducted before deployment, with affected communities participating . Esther Eghobamien-Mshelia of the CEDAW Committee reinforced that CEDAW provides an essential framework requiring states to achieve substantive equality and tackle structural barriers reinforced by AI .
- The specific vulnerability of children in AI-mediated environments and the inadequacy of current protections. Children's rights emerged as a cross-cutting concern throughout the session. Sonia Livingstone of the Independent Scientific Panel reported that across 11 Global South countries, up to one child per classroom reported that AI was used to make sexually explicit deepfakes of them, and that reports of AI-generated child sexual abuse material are rising exponentially . Stanford risk assessments of AI companions found these products fail to meet basic safety standards . Jhalak M. Kakkar stressed that AI systems must be designed with children's safety built in from the outset, not retrofitted after harm has occurred , and raised the concern of how constant surveillance shapes children's development as democratic citizens . Isabella Henriques, speaking on behalf of over 120 signatories of a joint civil society statement, called for children's rights to be a cross-cutting consideration across all AI governance frameworks .
- Accountability gaps in agentic AI systems and the challenge of attributing responsibility across complex, multi-agent chains. Several panellists identified agentic AI - systems in which networks of autonomous agents act without direct human instruction - as the most significant emerging legal and governance challenge. Amal El Fallah Seghrouchni of Morocco described the core problem: when a network of AI agents produces a harmful outcome, it is unclear which agent is accountable and how responsibility should be distributed . She proposed three obligations: structured documentation of agent chains, appointment of an identifiable human responsible for rights-related issues, and a right to redress in good time . Sasha Luccioni warned that agentic AI amplifies degrees of separation between users and underlying technology, making it harder to identify where failures originate . The audience survey results, reported by Peggy Hicks, showed that respondents overwhelmingly held AI-developing companies primarily responsible, followed by states and then deploying organisations .
- Global power asymmetries in AI governance, including the exclusion of the Global South, civil society, and marginalised communities from decision-making. Multiple speakers challenged the concentration of AI power in a handful of companies and countries. Kakkar argued that without diffusing this concentration of power, human rights - especially for people in the Global South - cannot be safeguarded . Research ICT Africa's Pria Chetty proposed a "Just AI" framework, arguing that prevailing ethical AI models are self-regulatory, calibrated to high-income countries, and deepen existing inequalities . Linda Bonyo, in her closing remarks, highlighted that 51% of AI governance conversations happen in Geneva, yet many voices from the rest of the world are excluded because they cannot obtain visas - itself a process shaped by opaque algorithms . The Association for Progressive Communications emphasised that communities are "the first mile, not the last mile" of AI and must be central in AI governance .
- --
Overall Tone
- The overall tone of the discussion is one of urgent concern tempered by cautious determination. From the outset, speakers conveyed a sense of alarm - Volker Türk's opening remarks were sombre and morally charged, invoking Kafka's The Castle as a metaphor for opaque, unaccountable AI systems and warning that society risks repeating the failures of climate governance by allowing powerful interests to delay action . This gravity persisted throughout the first panel, where panellists presented mounting empirical evidence of harms to women, children, and marginalised communities.
- However, the tone shifted incrementally towards constructive problem-solving in the second panel and audience interventions. Ministers from the Netherlands, Spain, Ireland, Korea, and Poland shared concrete national measures - algorithm registers, AI Acts, child protection laws - signalling that governance is not merely aspirational . Civil society speakers, while critical, offered specific recommendations rather than simply cataloguing harms.
- By the closing remarks, the tone had become one of collective resolve, with co-chair Oscar López Águeda acknowledging that "we are late" but affirming that the direction of travel - towards humanistic, rights-respecting AI - is clear and non-negotiable . Throughout, an undercurrent of frustration was evident, particularly from Global South representatives who noted structural exclusions from the very dialogue meant to address them .
Expanded Summary: UN Global Dialogue on AI Governance - Thematic Cluster on Human Rights, Transparency, Accountability, and Human Oversight
#
Opening and Context
The session was convened as part of the UN Global Dialogue on AI Governance, co-led by the Office of the High Commissioner for Human Rights (OHCHR) and the World Bank, under the thematic leadership of co-chairs Linda Bonyo, founder and CEO of the Lawyers Hub Africa, and His Excellency Óscar López Águeda, Spain's Minister for Digital Transformation and Civil Service . Peggy Hicks, Director of the Thematic and Special Procedures Division at OHCHR, opened proceedings by welcoming participants to a session focused on respecting, protecting, and promoting human rights, transparency, accountability, and human oversight in the context of artificial intelligence . The dialogue operated under the leadership of Ambassador Egriselda López of El Salvador and Ambassador Rein Tammsaar of Estonia, and was described as a remarkable achievement of how the UN system is meeting today's moment .
#
High Commissioner's Opening Remarks
UN High Commissioner for Human Rights Volker Türk opened with a striking analogy: before a new drug reaches the market, it undergoes between ten and fifteen years of clinical trials, regulatory review, and market authorisation, and even with all these safeguards, mistakes can still happen . He asked directly whether society is taking the same care with artificial intelligence . His answer was sobering: AI is already being developed and deployed at warp speed, fuelling mass surveillance, disinformation on social media, and enabling bias including from a gender perspective, while harm to children from AI-powered algorithms is growing and data centres housing AI servers are choking the environment . At the same time, he acknowledged AI's remarkable potential to support medical diagnosis, accelerate scientific research, and strengthen public services .
Türk argued that the most obvious solution - regulation guided by human rights - is right in front of our eyes, yet society keeps skirting around it . He drew a parallel with climate change, warning that precious years were lost because powerful players cast doubt on science, delayed action, and prioritised short-term economic and political interests, and that the same dynamic risks repeating itself with AI . Invoking Franz Kafka's novel The Castle, he asked whether society is like the protagonist K - a land surveyor trapped in a system of opaque power in which human agency is being lost - and argued that AI is fundamentally about power over data, markets, resources, and information . His response to this challenge was clear: human rights help reclaim agency and provide a check on the exercise of power, and guardrails on AI development are needed to ensure transparency, inclusion, and accountability . He also invoked Lord Acton's dictum that "power tends to corrupt and absolute power corrupts absolutely" to frame the necessity of keeping AI power in check .
On the question of regulation, Türk explicitly rejected the framing that it constitutes a trade-off with innovation, arguing that safety standards for medicines, cars, and aircraft are not considered obstacles to progress but are the very reason people trust those technologies . He called for human rights to be embedded into the design, development, deployment, and use of AI, noting that international human rights law constitutes a binding legal framework to protect data, avoid discrimination, access justice, and ensure equality . He stressed that human rights due diligence and impact assessments of AI systems are essential, as are robust data protection and privacy safeguards . He also warned that when AI gathers data or carries out a decision without human agency, responsibility can disappear into the system, and that human oversight cannot be just a rubber stamp but requires that an identified person be granted authority, competence, time, independence, and power to alter and even stop a system .
He announced that the following day his office would launch the Human Rights Data Exchange (HRDX), described as the world's first open, authoritative service with evidence of where rights are under threat, what happened, why, and what to do about it . He also referenced OHCHR's human rights advisory service, established under the Global Digital Compact, aimed at helping states and others govern AI in line with their human rights responsibilities . He closed by contrasting the tech industry's unofficial slogan of "bigger, faster, better" with his own preferred alternative: "smarter, kinder, wiser" .
#
Thematic Co-Chairs' Opening Remarks
Linda Bonyo contextualised the discussion from an African perspective, speaking for gig workers managed by algorithms in Kenya and acknowledging the asymmetry of power and the voices of younger generations not present in the room . She highlighted the launch of the Africa AI Governance Index, which for the first time tracks AI strategies, laws, and institutions across all African states, and invited participants to engage with the work at AIpolicy.africa .
Minister López Águeda, speaking in Spanish, framed AI governance as a choice between digital rights and oligarchy, warning that without inclusive governance the Global South will serve merely as a battery or data provider for greater powers . He outlined Spain's concrete legislative achievements, including the EU AI Act signed during Spain's EU presidency, the prohibition of sexual deepfakes and child pornography within EU legislation, the establishment of Europe's first AI supervision agency, and a child protection law restricting under-16s from digital networks . He also referenced the Ibero-American digital rights charter as an initiative Spain has been driving forward .
#
First Panel: Human Rights, Accountability, and Justice
The first panel was moderated by Ambassador David Lametti, Permanent Representative of Canada to the UN and former Minister of Justice, who framed the discussion around the role of justice systems in delivering accountability and upholding human rights for people affected by AI, including children . He noted that civil liability is a principle that exists in most justice systems and is focused on human responsibility, but that the challenge for AI is being subject to human judgement and intelligence when it is a machine making the decision . He described Canada's proposed law that would restrict social platforms to children under 16 until proven safe, and require AI chatbots to be proven safe before exposure to children, with a digital commissioner to ensure compliance .
Sima Bahous, Executive Director of UN Women, argued that left unregulated, AI becomes not only a mirror of existing inequalities but a powerful mechanism for amplifying discrimination, exclusion, and violence against women and girls . She presented extensive evidence: 44% of assessed AI systems demonstrate gender bias because they are trained on data that already reflects existing biases ; almost one in four women human rights defenders, activists, and journalists surveyed had experienced AI-assisted online violence ; and up to 99% of online deepfakes and manipulated sexual imagery target women . She noted that 41% of women respondents self-censor on social media to avoid abuse, pushing women and girls out of online spaces and threatening democratic participation . Drawing on the previous day's independent scientific panel report, she noted that 88% of leading AI researchers are male and that women make up only 30% of the AI workforce globally . She further noted that of the 138 countries assessed, only 24 reference gender in their national AI strategies, and just 18 include substantive gender-responsive provisions . She argued that states remain the primary duty bearers under international human rights law, including the Universal Declaration, the ICCPR, and CEDAW, and that technology companies cannot hide behind the complexity of their systems . She called for mandatory human rights impact assessments before and after deployment, with gender equality treated as non-negotiable, and for women and girls, feminist technologists, indigenous communities, labour organisations, disability advocates, and civil society to be meaningfully involved and empowered . She framed her accountability questions - who builds AI, who benefits, who bears the risks, and who has a voice - as building blocks for accountability .
Amal El Fallah Seghrouchni, Minister Delegate from Morocco, introduced a conceptually original distinction between exogenous harms - which are external to human beings and can be observed and measured - and endogenous harms, which occur within the human mind and are imperceptible even to those experiencing them . She argued that when algorithms manipulate a child's psychology, that is not something that can be measured or even perceived, and asked how society can audit its own neurons or understand that human brains have been transformed . She referenced Chile's early legislative attempt to introduce cognitive rights as a visionary response to this challenge . She also noted that even AI researchers do not always have the tools to understand the complexity of algorithms, and that large language models with between 175 billion and 180 billion parameters make accountability extremely difficult to trace .
In her second intervention, El Fallah Seghrouchni identified accountability in agentic AI systems as probably the most significant legal challenge of the decade, noting that in a network of individually autonomous agents there is no human at the origin of the final decision, making it unclear which agent is accountable and how responsibility should be distributed . She illustrated the scale of the challenge with a concrete example from Morocco's Iderati X.0 platform, which processes 52 million administrative transactions daily, noting that at such scale it becomes extremely difficult to identify the exact cause when a problem arises . She proposed three concrete obligations: structured documentation of agent chains specifying which agent does what and when; appointment of an identifiable human being in charge for all issues tied to rights when agents are deployed in public services; and a right to timely redress so that humans can receive remedy in line with the speed of AI systems .
Samuel Arias Arzeno, Judge of the First Chamber of the Supreme Court of Justice of the Dominican Republic, argued that the true challenge of governance does not happen when laws or ethical principles are adopted, but when a person considers that an AI system has violated their human rights - it is at this moment that governance becomes a reality . He argued that justice systems should be seen not merely as users of AI but as essential institutions for converting human rights principles into true human rights, and that no public institution can justify a decision by saying that is what the system told it to do . He noted that through the Justice Action Coalition, governments, civil organisations, international organisations, and justice systems are working together to ensure that AI governance is not only restricted to the designing of public policies but can be made effective through justice systems based upon people, and that the Dominican Republic co-chairs with the World Bank the work on emerging technologies and AI in the area of justice . He proposed four priorities: strengthening institutional capacities of lawyers and jurors; ensuring transparency and traceability in the use of AI; maintaining effective human oversight; and ensuring that all people have effective mechanisms to access justice and repair harm .
Sonia Livingstone, member of the Independent International Scientific Panel on AI, reported that the panel found the evidence for human rights violations to be currently much more compelling than the evidence for human rights benefits in many settings where AI is being used . The panel documented threats to the information ecosystem through AI-generated persuasion and deceit, disinformation, and distrust, with adverse impacts on collective health, democratic participation, and election integrity . It also documented threats to privacy and safety as personal data is taken, manipulated, abused, and exploited, and evidence of harms in terms of inequality and injustice as AI power is concentrated in very few companies, countries, and languages . The panel identified four categories of risk: direct risks; risks arising from hugely uneven global capacity; opportunity costs from failure to realise AI benefits; and risks from deployment without rights-based safeguards .
On children specifically, Livingstone presented alarming data: across 11 Global South countries, up to one child per classroom reported that AI was used to make sexually explicit deepfakes of them; reports of AI-generated child sexual abuse material to the US cyber tip line NCMEC are rising exponentially; child sexual abuse material is documented in some training sets; and offenders can now fine-tune open models on child sexual exploitation . A national US survey found one in three children had discussed important emotional matters with an AI companion, yet Stanford's risk assessment of AI companions found these products fail to meet basic safety standards . She referred participants to calls by Mr. Kateris for nations to adopt an AI child safety pledge . She cautioned that the problem will not be solved by restricting children, and emphasised children's rights to expression, participation, education, and information in a digital age .
Sasha Luccioni, co-founder and chief scientific officer of the Sustainable AI Group, argued that transparency about AI's environmental footprint is a fundamental human right, enabling users to make informed choices between tools . She noted that while the benefits of AI can technically be global, the negative impacts in terms of water, energy, emissions, and health are very local and disproportionately affect the most marginalised populations . She described the difficulty of obtaining transparency even for international organisations such as the IEA, which struggle to get information because member countries themselves do not have it . She presented her AI Energy Score Project - energy efficiency labels for AI models - as a stepping stone to informed decision-making and eventual regulation . In her second intervention, she warned that agentic AI amplifies the degrees of separation between a user and the underlying technology, making it harder and harder to identify where failures originate .
Jhalak M. Kakkar, Executive Director of the Centre for Communication Governance at the National Law University of Delhi, argued that existing human rights frameworks - including the right to equality, privacy, and freedom of speech and expression - must be reinterpreted in the context of AI . She raised the question of what freedom of thought means when AI threatens cognitive autonomy through micro-targeting and manipulation , and noted that the concentration of data centres and extraction of minerals predominantly in sites of existing inequality in the Global South raises fundamental questions of environmental and economic justice . She argued that justice systems will need to grapple with the complexity of arriving at truth in a time of epistemic erosion, bridge accountability gaps, navigate transparency questions, and address the transnational cross-border governance gap where laws are national but companies are global . She concluded that without diffusing the concentration of power in a handful of companies in a few jurisdictions, human rights - especially for people in the Global South - cannot be safeguarded .
#
Audience Survey Results
Peggy Hicks reported the results of a participant survey conducted at the session. A plurality of respondents were concerned that insufficient governance measures are in place to address the challenges and opportunities of AI . The top two human rights concerns identified were accountability and rule of law, and the impact of AI on children, followed by surveillance and the use of AI by law enforcement, and then environmental sustainability . On the question of who should be responsible for the actions of agentic AI, respondents overwhelmingly identified the companies that develop the AI model as the primary responsible party, followed by states, and then the organisations that deploy the system - a result consistent with the UN Guiding Principles on Business and Human Rights . Hicks also noted that OHCHR and ITU would be presenting on Thursday a survey called "Me and AI," conducted with 1,000 children in 49 countries, in which children expressed that they want AI to be shaped with them, not just for them, that it should respect their rights, and that they do not simply want to be shielded from it .
#
Second Panel: Solutions, Evidence, and Inclusion
The second panel was moderated by Her Excellency Clara Chappaz, Ambassador for AI and Digital Affairs from France, who framed the discussion around three questions: what good practices exist for human rights due diligence; what technical tools and evidence are needed to understand impacts before deployment; and how to ensure that children and other affected populations are meaningfully engaged in AI governance .
Willemijn Aerdts, Minister for Digital Economy and Sovereignty of the Netherlands, presented concrete national tools including an algorithm framework translating legal requirements into practical guidelines, a fundamental rights and algorithm impact assessment, and an algorithm register covering all algorithms used by the Dutch government . On children, she emphasised that when making policy for children and young people, they must be genuinely included in the decision-making process alongside parents and educators, and noted that young people often face issues too big for parents but too small for the police .
Felipe Paullier, Assistant Secretary General of the UN Youth Office, argued that the question should not only be about what AI can do, but what AI can help humanity build as a future, and that AI must be benchmarked not only on speed and efficiency but on its contribution to human well-being, dignity, and human rights . He stressed that young people are the most users of AI and among the most frequent innovators within AI firms, yet they are almost never the decision-makers despite living longest with the consequences of decisions made today . He called for meaningful spaces for young people to engage in AI governance at the national level, warning that if such spaces are not created, young people will create their own, as has happened in the climate space .
Ulises Gutiérrez, Special Representative for Emerging Technologies of Mexico, raised the concern that public policy is always lagging behind technological development, and that there is insufficient political understanding of the impact of technological development, particularly AI . He argued that the question is not what a human being can do with technology, but what technology is doing to human beings . He called for a new social contract at both national and international levels, not merely regulation, to govern AI in a constantly changing landscape .
Wanjin Park, Vice President of KT, described his company's approach to defining AI risk including human rights considerations, evaluating AI models and agents against that framework, and running an executive deployment safety board before releasing AI products . He specifically highlighted the AI risk taxonomy from the BTEC project at OHCHR as important work that needs to be developed in a more concrete and practical way . He noted that the problem arises when multi-agent systems from different companies are interconnected, as each company has its own definition of AI risk, and called for common and well-designed standards to create a shared baseline .
Nighat Dad, founder of the Digital Rights Foundation, delivered one of the session's most analytically sharp interventions, arguing that human rights due diligence as most AI companies practise it today does not meet the standard of the UN Guiding Principles on Business and Human Rights - it happens after co-design decisions are made, where regulation compels it, and without the participation of the people actually affected . She characterised the geographic unevenness of due diligence - meaningful assessments conducted primarily in the EU, with the same systems deployed in the Global South without equivalent scrutiny - as a structural choice, not a capacity gap, creating a two-tier rights regime determined by geography . She documented over 23,000 cases of technology-facilitated abuse disproportionately against women, girls, and young people through her organisation's cyber harassment helpline , and argued that any due diligence framework that does not explicitly address technology-facilitated gender-based violence has written half the population out of its protection . She proposed three concrete recommendations: mandatory gender and child rights impact assessments conducted before deployment with affected communities participating; uniform due diligence obligations across all markets where a system is deployed; and assessments repeated whenever capabilities materially change, including increases in agentic function .
Alvitta Ottley, member of the Independent Scientific Panel on AI, identified two related scientific challenges: evaluation mismatch and evidence gap . On evaluation mismatch, she argued that engineering questions - can we make something faster, more accurate, more capable? - are not the same questions that societies are asking, which concern whether human rights are protected, whether institutions remain accountable, and whether society is better off . She argued that if society is deciding that success is about protecting human rights, fostering appropriate trust, and preserving accountability, then the outcomes being measured must match what is being optimised for . On the evidence gap, she noted that while there is abundant evidence about how well AI models perform, there is very little evidence about how AI affects people's decision-making, children's learning, clinical decisions, or public servants' work, and that answering these questions requires longitudinal studies, interdisciplinary collaborations, and careful work with protected and underserved communities . She concluded with a formulation that resonated throughout the panel: society has to decide what success looks like, and science has to determine how to measure it .
In her closing remarks, Chappaz synthesised the panel's conclusions, noting that the speed of technological development in a fragmented geopolitical world requires defining what success means for humans, based on the values they choose to prioritise, and that this is only humanity's decision, not the technology's . She echoed Dad's framing that the geographic unevenness of due diligence represents structural choices, not capacity gaps, and warned that if this is not addressed, communities will either withdraw from digital spaces or create their own without governance or values .
#
Audience Interventions
The audience intervention segment featured contributions from governments and civil society organisations across multiple regions, moderated by the thematic co-chairs.
Ireland's Minister Niamh Smyth argued that global AI governance must align with international human rights frameworks, promoting freedom of expression, privacy, access to information, and gender equality, while actively countering all forms of violence including sexual and gender-based violence . She expressed particular concern that without necessary human rights safeguards and oversight, AI systems enable technology-facilitated gender-based violence, and that AI online content moderation without human oversight can amplify disinformation, disproportionately affecting women and girls .
Robert Baruch of Universal Music Group grounded the music industry's position in international human rights law, citing Article 27 of the Universal Declaration of Human Rights and Article 15 of the ICESCR as protecting creators' moral and material interests in the age of AI . He argued that the future of AI must be built not by choosing between innovation and creators' rights but by advancing both together, and proposed three pillars: creator control over how their work is used to develop AI systems; transparency about when and how works are used; and human oversight ensuring AI amplifies rather than replaces human creativity .
Slovenia's representative Anita Pipan argued that trust in AI is not only an ethical objective but a prerequisite for broader AI adoption, and described Slovenia's national AI strategy 2030 as promoting a human-centric approach grounded in human rights, democratic values, ethics, safety, transparency, and accountability . She placed particular importance on protecting linguistic and cultural diversity, arguing that inclusive AI should reflect and preserve all languages and cultures .
Zachary Lampel of the International Center for Not-for-Profit Law proposed three concrete actions: AI red lines - clear prohibitions or moratoria on AI systems and uses that pose unacceptable risks to human rights, explicitly provided for in the 2024 UN General Assembly resolution "Seizing the Opportunities of Safe, Secure, and Trustworthy Artificial Intelligence Systems for Sustainable Development" ; standardised certifications linked to national procurement rules, analogous to green building certifications, creating market incentives to design and deploy safe AI ; and a right to remedy, ensuring that decisions made via AI systems have an accountable actor and an avenue for challenge . He also noted that UNESCO's recommendations on the ethics of artificial intelligence already explicitly rule out the use of AI for social scoring and mass surveillance .
Uruguay's representative Alejandra De Bellis Bonilla highlighted the Global Partnership for Human Rights as a broad, multi-stakeholder platform connecting efforts on AI's cross-cutting impacts, and called for improvements in accountability, normative frameworks, sustainability, and funding, with a gender-responsive approach to AI design and deployment .
Franco Giandana Gigena of AccessNow called for human rights-centred, binding legal standards and global governance mechanisms to regulate digital surveillance technologies and AI, addressing chilling effects on protesters, journalists, and human rights defenders . He called for a halt to the development and use of AI tools facilitating violations of international humanitarian law and human rights law, especially in conflict contexts . He argued that people around the world do not only need access to AI but most importantly need agency .
Rafał Kownacki of Poland's Ministry of Digital Affairs argued that when society decides what an algorithm may do to a human being, it decides what it believes a person is worth . He invoked Poland's historical experience to argue that some choices a machine must never make on its own, and that however capable AI systems become, a person must keep the final word - to understand the decision, to contest it, and where it matters most, to switch the systems off . He welcomed the Council of Europe Framework Convention on AI as the first binding treaty placing AI within the order of human rights, democracy, and the rule of law .
Isabella Henriques of Instituto Alana, speaking on behalf of over 120 signatories of a joint civil society statement on children's rights at the AI dialogue, argued that children are among the earliest and most frequent users of new technology yet remain largely missing from national AI strategies and governance frameworks . She stressed that children's rights, safety, and well-being must be built into AI systems from the start, not added after harm has already occurred, and that responsibility must sit with those who build and profit from the technology .
João Brant of Brazil described the country's Digital Statute for Children and Adolescents, which requires platforms to adopt child protection measures from the design phase, limits features that can lead to excessive usage such as infinite scrolling, and prohibits targeted advertising based on children's personal data . He also described a decree prohibiting the creation of synthetic intimate images based on real third parties, establishing proactive responsibilities for platforms and AI companies . He called for information integrity to be understood in its collective or social dimension as part of the right to access accurate and reliable information, and raised concern about AI's impact on the economic sustainability of journalism .
Anna Osterling of the Global Forum for Media Development argued that, citing Courtney Raj of the Centre for Media and Digital Governance at OpenMarkets, journalism is a keystone species of the information ecosystem - stabilising trust, anchoring verification, structuring accountability, and enabling other institutions to function - and that removing it causes the information ecosystem to collapse rather than adapt . She noted that AI systems are trained on journalistic content scraped without consent, compensation, or credit, and called for public digital infrastructure, industrial policies supporting public interest AI, and AI governance requiring human rights to be embedded across the full lifecycle of all AI systems .
Jihoon Cha of the Republic of Korea described the country's AI Basic Act, which requires operators of high-impact AI systems to assess potential impacts on fundamental human rights, and declared Korea's vision for establishing the Global AI Hub, together with nine participating AI and related organisations, to strengthen global AI capacity . He argued that access to AI should be treated not as a privilege to be earned but as a basic right to be enjoyed .
Pria Chetty of Research ICT Africa proposed a "Just AI" framework, arguing that prevailing governance models anchored in ethical or responsible AI remain structurally inadequate because they are largely self-regulatory, driven by dominant actors, calibrated to high-income countries, and disregard sovereignty or agency . She called for a globally recognised understanding that the governance of AI is inseparable from the governance of data, and for democratising AI resources and capabilities so that global majority nations can shift from passive consumers to co-creators of AI .
Jérôme Bellion-Jourdan of the Institute for Global Negotiation, also a vice-chair of the AI for Good Impact Initiative steering committee, argued that while there is broad agreement on the need for more governance, the question is how to get there. He proposed that the tools and techniques of multilateral negotiation - including process design, innovative negotiation formats, and a shift from positional bargaining and win-lose dynamics to integrative negotiation and win-win outcomes - could help navigate the power politics and power asymmetries that impede progress towards global AI governance .
Mark Cassayre of IDLO, the only global intergovernmental organisation exclusively devoted to promoting the rule of law, recommended that human rights and the rule of law must underpin the development and deployment of digital technologies in the justice sector, that fit-for-purpose legal and regulatory frameworks must accompany innovation, and that investment in institutional capacity - including AI literacy among legal and justice professionals - is essential .
Rebecca Rektimbo, Connectivity Technical Projects Coordinator for LOCNET, delivering remarks on behalf of Raman Jit Singh Chima, Global Programme Director of the Association for Progressive Communications, argued that before communities can contribute data, build local AI solutions, influence policy, or benefit from innovation, they need meaningful, affordable, trusted, and locally relevant connectivity . She argued that community-centred connectivity shifts power closer to communities and enables women, indigenous people, rural communities, and speakers of underrepresented languages to become creators, innovators, researchers, and decision-makers rather than simply consumers of technology . She concluded with a formulation that resonated across the session: communities are not the last mile of AI - they are the first mile .
Esther Eghobamien-Mshelia of the CEDAW Committee argued that there can be no truly human rights-based AI governance without the full implementation of CEDAW, which requires states not only to prohibit discrimination but to achieve substantive equality by tackling structural and regulatory barriers, stereotypes, and unequal power relations . She cited CEDAW General Recommendation No. 40 on women's full and equal participation in political and public life as a tool reminding us that women must participate fully and equally in the design, governance, and oversight of AI systems . She called for gender-responsive indicators, monitoring, and surveillance to demonstrate whether women are participating and benefiting equally from digital transformation and are protected from harms such as algorithmic discrimination and technology-facilitated gender-based violence .
Elizabeth Tan of UNHCR highlighted that for forcibly displaced and stateless people, barriers to challenging AI-assisted decisions are especially high due to documentation gaps, language barriers, digital access limitations, and fear of approaching authorities . She cited concrete examples from Libya, where AI-generated content incited hostility and abuse of refugees, and from the Rohingya community, who continue to face dehumanising narratives online even in exile . She called for human rights due diligence across the AI lifecycle, bias testing, clear explanations of how decisions are reached, and accessible ways to complain or seek correction .
Sopio Kiladze of the Committee on the Rights of the Child described the joint UN statement on AI and the rights of the child, co-led by ITU, the CRC, and UNICEF, co-signed by 13 UN agencies and over 60 organisations, and shaped with input from children from all five UN regions . She argued that history will not judge society by how intelligent its AI is, but by whether it used this extraordinary moment to protect those with the smallest voice and the greatest stake in the future .
Shumaila Hussaini Shahani of Tech Global Institute proposed five concrete commitments: safety claims must be accompanied by conditions under which systems were tested and failure rates disaggregated by language, gender, disability, and region; a decade of voluntary commitments has not delivered and public accountability frameworks with corporate liability are needed; publicly financed, regionally hosted capacity to evaluate AI systems before deployment is required; transparency and oversight must extend to algorithmic management and data workers; and indigenous and traditional knowledge must be protected through community-led data stewardship .
#
Closing Remarks and Overarching Themes
In her closing remarks, Linda Bonyo raised two critical points: first, who finances human rights in the age of AI, noting that the money needed to ensure human rights ideally works in this context must be found ; and second, the need for algorithmic openness around visa processes, noting that 51% of AI governance conversations happen in Geneva and that the rest of the world is effectively locked out because people cannot access visas - a process itself shaped by opaque algorithms . She named a specific absent participant, Freedom Wangi, an AI worker unable to obtain a visa, as a concrete illustration of this exclusion .
Minister López Águeda closed by acknowledging that the dialogue is not merely about technology but about democracy, human rights, privacy, energy, and peace in the world . He stated plainly that society is late in addressing these challenges, but affirmed the direction of travel: building a humanistic AI, defending human agency, and using AI to be better rather than worse .
#
Overall Assessment
The session revealed a high degree of normative consensus across a remarkably diverse range of participants - from government ministers and UN officials to civil society representatives, academics, private sector actors, and international organisation representatives - on the foundational principles of human rights-based AI governance. Across the session's discussions, the strongest areas of convergence were that AI governance must be grounded in binding international human rights law rather than voluntary ethics; that regulation and innovation are complementary rather than in tension; that meaningful human oversight must be substantive and not nominal; that transparency is a fundamental requirement across all dimensions of AI; that children require special protection with responsibility resting on developers and deployers; that AI amplifies existing inequalities and requires proactive governance responses; that agentic AI creates unprecedented accountability challenges; and that affected communities must be meaningfully included in governance processes .
However, the consensus on principles was not matched by equivalent agreement on enforcement mechanisms, funding, or the specific institutional architecture needed to translate principles into practice. Speakers from the Global South consistently highlighted that the gap between principle and practice is itself a structural inequality, with meaningful due diligence applied primarily in high-income jurisdictions . The session's survey results, showing that a plurality of participants were concerned that insufficient governance measures are in place , and that accountability, rule of law, and AI's impact on children were the top concerns , confirmed that participants themselves recognise the distance between the normative consensus achieved and the reality of implementation. The challenge of closing that distance - equitably, urgently, and with the full participation of those most affected - emerged as the defining task ahead.
The UN system must use international human rights law as a binding compass for AI governance, with OHCHR's advisory service helping states govern AI in line with human rights responsibilities - UN human rights framework as compass
Arg. 1This argument has already been captured above under Volker Turk's entries.
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
AI governance must be treated as a fundamental human rights issue, not merely a technical one, with international human rights law providing a binding legal framework - Human rights as binding framework
Arg. 1Bahous argues that left unregulated, AI becomes not only a mirror of existing societal inequalities but a powerful mechanism for amplifying discrimination, exclusion, and violence against women and girls. She insists that AI governance cannot be treated solely as a technical issue and is fundamentally a human rights matter.
Bahous stated that left unregulated, AI becomes not only a mirror of the inequalities that already exist in our societies, but also a powerful mechanism for amplifying discrimination, exclusion, and violence against women and girls . She referenced international human rights law frameworks including the Universal Declaration of Human Rights, the International Covenant on Civil and Political Rights, and CEDAW as providing a comprehensive framework to protect rights .
on: AI amplifies and deepens existing inequalities, particularly for women, girls, the Global South, and other marginalised groups, requiring proactive governance responses
44% of assessed AI systems demonstrate gender bias, and AI reproduces and amplifies harmful stereotypes because training data reflects existing biases - AI amplifies gender bias
Arg. 2Bahous presents evidence that AI systems reproduce and amplify harmful gender stereotypes because they are trained on data that already reflects existing biases. This is not a marginal problem but a systemic one affecting nearly half of all assessed AI systems.
Bahous cited evidence that 44% of assessed AI systems demonstrate gender bias , and that AI systems reproduce and amplify harmful stereotypes because they are trained on data that already reflects existing biases .
on: AI amplifies and deepens existing inequalities, particularly for women, girls, the Global South, and other marginalised groups, requiring proactive governance responses
Up to 99% of online deepfakes and manipulated sexual imagery target women, and 41% of women self-censor on social media to avoid abuse - Deepfakes and self-censorship
Arg. 3Bahous presents alarming statistics on the gendered nature of AI-facilitated harm, particularly deepfakes and manipulated sexual imagery. She connects this to a broader chilling effect on women's participation in public life and democratic processes.
UN Women research found that almost one in four women human rights defenders, activists, and journalists surveyed had experienced AI-assisted online violence, and 6% had been victims of deepfakes or digitally manipulated imagery . Research shows that up to 99% of online deepfakes and manipulated sexual imagery target women , and 41% of all women respondents reported self-censoring on social media to avoid abuse .
Women are underrepresented in AI development, making up only 30% of the AI workforce globally, and gender equality remains largely invisible in AI governance frameworks - Women's exclusion from AI governance
Arg. 4Bahous argues that the accountability of AI governance begins with four questions: who builds AI, who benefits, who bears the risks, and who has a voice. The data reveals that women are systematically excluded from all four dimensions.
Bahous cited that women make up only 30% of the AI workforce globally , and that 88% of leading AI researchers are male according to the independent scientific panel's report . She further noted that of 138 countries assessed, only 24 reference gender in their national AI strategies, and just 18 include substantive gender-responsive provisions .
Gender and child rights impact assessments must be mandatory, conducted before deployment with affected communities participating - Mandatory gender impact assessments
Arg. 5Bahous calls for mandatory human rights impact assessments before and after AI deployment, with gender equality treated as non-negotiable rather than optional. She also emphasises that accountability requires meaningful participation from women, girls, and other affected communities.
Bahous called for mandatory human rights impact assessments before and after deployment with gender equality treated as non-negotiable and not as optional , and stated that women and girls, feminist technologists, indigenous communities, labour organisations, disability advocates, and civil society must be meaningfully involved and empowered .
on: Agentic AI creates unprecedented accountability challenges that require new governance paradigms, including structured documentation, identifiable human responsibility, and rights to timely redress
Women and girls, feminist technologists, indigenous communities, and civil society must be meaningfully involved and empowered in AI governance - Inclusive participation requirement
Arg. 6Bahous argues that accountability in AI governance requires genuine participation from those most affected, including women and girls, feminist technologists, indigenous communities, labour organisations, disability advocates, and civil society. Without this, governance frameworks will fail to address the needs of those most at risk.
Bahous stated that accountability requires participation, and that women and girls, feminist technologists, indigenous communities, labour organisations, disability advocates, and civil society must be meaningfully involved and empowered .
on: Affected communities, including women, youth, children, and Global South populations, must be meaningfully included in AI governance processes, not merely consulted after decisions are made
AI is a political tool, not a consumer good, and governance must choose between digital rights or oligarchy - AI as political tool
Arg. 1López Agueda argues that the geopolitical context reveals AI is not merely a consumer product but a political tool with profound implications for power. He frames the choice starkly: either AI governance upholds digital rights or it leads to oligarchy.
López Agueda stated that the geopolitical times show us that AI is not a consumer good but a political tool, and that today AI is powerful and only has two paths: that of digital rights or that towards an oligarchy .
Without inclusive governance, the global south will serve merely as a battery or data provider for greater powers - Global south as data colony
Arg. 2López Agueda warns that without inclusive and global AI governance, the global south risks being reduced to merely providing data and resources for more powerful nations. He calls for a democratic and inclusive global dialogue on AI.
López Agueda stated that either we do something or the global south will just serve as a battery for the greater powers because it is also just going to be someone who provides data, and therefore we have to be inclusive and global when we consider AI .
on: AI amplifies and deepens existing inequalities, particularly for women, girls, the Global South, and other marginalised groups, requiring proactive governance responses
Human rights due diligence and impact assessments must be mandatory before and after AI deployment, not merely aspirational - Mandatory due diligence
Arg. 1Nighat Dad argues that human rights due diligence as currently practised by most AI companies does not meet the standard of the UN Guiding Principles on Business and Human Rights. It happens after co-design decisions are made, only where regulations compel it, and without participation from affected people.
Dad stated that human rights due diligence happens after co-design decisions are made, where regulations compel it, and without the participation of the people actually affected, meaning what exists in most cases is not due diligence but documentation . She recommended that gender and child rights impact assessments must be mandatory, conducted before deployment with affected communities participating, not merely documented .
on: Affected communities, including women, youth, children, and Global South populations, must be meaningfully included in AI governance processes, not merely consulted after decisions are made
on: Whether the primary locus of human rights due diligence should be pre-deployment or continuous across the AI lifecycle
Human rights due diligence is applied unevenly across markets, creating a two-tier rights regime determined by geography - Geographic inequality in due diligence
Arg. 2Dad argues that companies conduct meaningful human rights assessments primarily where the law requires them to, such as in the EU, and then deploy the same systems in the majority world without equivalent processes. This is a structural choice, not a capacity gap, creating a two-tier rights regime.
Dad stated that companies conduct meaningful assessments where the law requires them to, primarily in the EU, then deploy the same system in the majority world with no equivalent process, and characterised this as a structural choice, not a capacity gap . She noted that the depth of a risk assessment depends not on the risk faced but on the jurisdiction one happens to live in .
on: Whether geographic unevenness in human rights due diligence is a structural choice by companies or a capacity gap
Technology-facilitated gender-based violence cannot be treated as a niche safety issue; any due diligence framework that does not address it has written half the population out of its protection - TFGBV as systemic issue
Arg. 3Dad argues that when women withdraw from digital spaces due to technology-facilitated gender-based violence, this is not merely an individual harm but a collective harm to public discourse and democratic participation. Any due diligence framework that fails to explicitly address this issue excludes half the population from its protection.
Dad's organisation, Digital Rights Foundation, documented more than 23,000 cases of technology-facilitated abuse over 10 years, disproportionately against women, girls, and young people, including non-consensual synthetic imagery, automated moderation that fails in Urdu, Hindi, and Bengali, and recommendation systems that amplify gendered harassment . She stated that when women withdraw from digital spaces, it is a collective harm to public discourse and democratic participation .
on: AI amplifies and deepens existing inequalities, particularly for women, girls, the Global South, and other marginalised groups, requiring proactive governance responses
Gender and child rights impact assessments must be mandatory, conducted before deployment with affected communities participating - Mandatory gender impact assessments
Arg. 4Dad calls for three concrete recommendations: mandatory gender and child rights impact assessments before deployment with affected communities participating; uniform human rights due diligence obligations across all markets; and repeated assessments whenever AI capabilities materially change, including increases in agentic function.
Dad recommended that gender and child rights impact assessments must be mandatory, conducted before deployment with affected communities participating, not merely documented , and that human rights due diligence obligations must apply uniformly across all markets where a system is deployed, noting that a risk assessment covering Brussels but not Pakistan, Kenya, or Brazil is not due diligence .
on: Agentic AI creates unprecedented accountability challenges that require new governance paradigms, including structured documentation, identifiable human responsibility, and rights to timely redress
Civil society organisations in the majority world are early sensors of AI-related harm but remain unfunded and precarious, requiring resourcing and connection to decision-making - Resourcing civil society evidence
Arg. 5Dad argues that the evidence problem in AI governance is fundamentally a resourcing problem. Civil society organisations in the majority world are the earliest sensors of AI-related harm, but their documentation is unfunded, precarious, and treated as anecdote rather than evidence.
Dad noted that her organisation documented synthetic intimate imagery targeting women years before it entered global policy conversations, but that this documentation is unfunded, precarious, and treated as anecdote rather than evidence . She called for this existing early warning system to be resourced and connected to decision-making, including the scientific panel .
on: The appropriate role of evidence in driving AI governance action: whether to act now on existing evidence of harm or wait for more rigorous longitudinal evidence
AI governance frameworks must move beyond self-regulatory, ethics-based models to normative frameworks rooted in international human rights law - Beyond voluntary ethics
Arg. 1Chetty argues that prevailing governance models anchored in ethical or responsible AI remain structurally inadequate because they are largely self-regulatory, driven by dominant actors, and calibrated to high-income countries. She proposes the Just AI framework as a normative alternative rooted in international human rights law.
Chetty stated that prevailing governance models anchored in notions of ethical or responsible AI remain structurally inadequate, as such frameworks are largely self-regulatory, driven by dominant actors, calibrated to high-income countries, and disregard sovereignty or agency . She argued that such frameworks deepen existing inequalities by extracting value from individuals, communities, and nations without reciprocal benefit, input, or control .
on: AI amplifies and deepens existing inequalities, particularly for women, girls, the Global South, and other marginalised groups, requiring proactive governance responses
on: Whether AI governance should focus on universal binding standards or allow genuine pluralism above a common floor of rights safeguards
The separation of data governance and AI governance in international forums obscures the foundational data justice that must inform all AI systems - Data justice inseparable from AI governance
Arg. 2Chetty argues that the governance of AI is inseparable from the governance of data, and that separating these two areas in international forums obscures the foundational data justice issues that must inform all AI systems. Data justice is crucially informed by a right of access to data in substantive and procedural forms.
Chetty called for establishing a globally recognised understanding that the governance of AI is inseparable from the governance of data, and stated that the separation of data governance and AI governance in international forums obscures the foundational data justice that must inform all AI systems .
Governing AI requires a new social contract at both national and international levels, not just regulation - New social contract
Arg. 1Gutiérrez argues that the rapidly changing landscape of AI development means that governance cannot be limited to regulation alone. What is needed is the adoption of a new social contract at both the international and national levels that addresses the fundamental question of what technology is doing to human beings.
Gutiérrez stated that we should talk about governance and the adoption of a new social contract, not only in the international context but also in the national context . He also noted the separation between legality and legitimacy in the international backdrop, and the importance of understanding the impact of technological development on human beings rather than only what human beings can do with technology .
on: Binding regulation versus broader governance frameworks and social contracts for AI
The rule of law requires implementing binding legal frameworks equally, regardless of wealth, power, or influence - Binding legal frameworks
Arg. 1Lampel argues that the rule of law requires implementing binding legal frameworks equally without regard for wealth, power, or influence, and that the international community must start enforcing international human rights law today. He proposes three concrete actions: AI red lines, standardised certifications linked to procurement rules, and a right to remedy.
Lampel referenced the 2024 UN General Assembly resolution on safe, secure, and trustworthy AI systems for sustainable development as explicitly supporting the concept of AI red lines , and cited UNESCO's recommendations on the ethics of AI as already explicitly ruling out the use of AI for social scoring and mass surveillance .
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
on: Whether AI governance should focus on universal binding standards or allow genuine pluralism above a common floor of rights safeguards
AI governance must embed human rights across the full AI lifecycle, from design to deployment and monitoring - Full lifecycle governance
Arg. 1Cassayre argues that human rights and the rule of law must underpin the development and deployment of digital technologies, notably in the justice sector. AI systems must be designed to expand access, serve people's needs, and prevent new forms of exclusion and inequality throughout their entire lifecycle.
Cassayre offered three recommendations: that human rights and the rule of law must underpin the development and deployment of digital technologies; that fit-for-purpose legal and regulatory frameworks must accompany innovation; and that investment in institutional capacity is needed, including strengthening public digital infrastructure for justice delivery and enhancing AI literacy among legal and justice professionals .
on: Regulation of AI does not stifle innovation; safety standards are the foundation of trust in technology
Justice systems must convert human rights principles into reality by ensuring accountability when AI causes harm, focusing on transparency, traceability, and effective remedy - Justice systems as accountability mechanisms
Arg. 1Arias Arzeno argues that the true challenge of AI governance is not in adopting laws or ethical principles but in what happens when a person believes an AI system has violated their human rights. Justice systems are essential institutions for converting principles into reality and ensuring accountability when AI causes harm.
Arias Arzeno stated that governance is no longer just a concept but becomes a reality at the moment when a person considers an AI system has violated their human rights and data privacy . He outlined four priorities for strengthening justice systems: strengthening institutional capacities of lawyers and jurors, ensuring transparency and traceability in the use of AI, having effective human oversight, and ensuring all people have effective mechanisms to access justice and repair harm .
on: AI governance must be grounded in international human rights law as a binding framework, not merely aspirational ethics
on: Whether the primary locus of human rights due diligence should be pre-deployment or continuous across the AI lifecycle
No public institution can justify a decision by saying the system told it to do so; responsibility must lie with people and institutions - Human institutional responsibility
Arg. 2Arias Arzeno argues that the use of AI in courtrooms and public institutions is already a reality, and the challenge is to ensure its use is transparent, responsible, auditable, and compatible with human rights and the rule of law. No institution can abdicate responsibility by attributing a decision to an AI system.
Arias Arzeno stated that no public institution can justify a decision by saying that is what the system told us to do, and that responsibility should lie with people and institutions, with technology helping the judge but never replacing them .
on: Meaningful human oversight of AI must be real and substantive, not a rubber stamp, with an identifiable human retaining authority to alter or stop systems
Agentic AI creates the most significant legal accountability challenge of the decade, as no single human is at the origin of final decisions in networks of autonomous agents - Agentic AI accountability gap
Arg. 1El Fallah Seghrouchni argues that accountability in agentic systems is the most significant legal challenge of the decade because networks of individually autonomous AI agents produce final decisions with no single human at their origin. It is extremely difficult to distribute accountability among agents or to trace back up the chain to identify where a mistake was made.
El Fallah Seghrouchni gave the example of the Iderati X.0 platform in Morocco, which processes 52 million administrative transactions daily, noting that when there is a problem it is very difficult to find the exact cause . She described the challenge of LLMs with between 175 billion and 180 billion parameters and the difficulty of ensuring accountability for what appears in these systems .
on: Agentic AI creates unprecedented accountability challenges that require new governance paradigms, including structured documentation, identifiable human responsibility, and rights to timely redress
on: The appropriate role of evidence in driving AI governance action: whether to act now on existing evidence of harm or wait for more rigorous longitudinal evidence
AI systems must be subject to structured documentation of agent chains, appointment of an identifiable responsible human, and a right to timely redress - Three accountability obligations
Arg. 2El Fallah Seghrouchni proposes three concrete obligations for accountability in agentic AI systems: structured documentation of agent chains specifying who does what and when; appointment of an identifiable human being in charge for all rights-related issues; and a right to redress in good time in line with the speed of AI systems.
El Fallah Seghrouchni proposed that when agents are deployed in public services, there must be structured documentation of agent chains, an identifiable human being in charge for all issues tied to rights, and a right to redress in good time in line with the speed of AI systems . She concluded that the functioning of the algorithm must never be autonomous in regards to rights and the law .
on: Agentic AI creates unprecedented accountability challenges that require new governance paradigms, including structured documentation, identifiable human responsibility, and rights to timely redress
on: Whether the primary locus of human rights due diligence should be pre-deployment or continuous across the AI lifecycle
Transparency about AI's environmental footprint is a fundamental human right, enabling users to make informed choices between tools - Environmental transparency as human right
Arg. 1Luccioni argues that transparency about AI's energy consumption and environmental costs is a fundamental human right because it enables users to make informed choices between tools. Without this information, meaningful choice and accountability are impossible.
Luccioni stated that transparency is a fundamental human right that users should be getting when they use AI, asking what the cost is, where the data comes from, and where the energy comes from, so that users can make a choice between tool A or tool B . She noted that even organisations like the IEA struggle to get this information because member countries themselves do not have it .
on: Transparency is a fundamental requirement across all dimensions of AI governance, including data use, environmental impact, and decision-making processes
Agentic AI amplifies degrees of separation between users and underlying technology, making it harder to identify where failures originate - Agentic AI opacity
Arg. 2Luccioni argues that agentic AI worsens an already difficult transparency and accountability situation by adding more layers between users and the underlying technology. As AI systems become more agentic, it becomes increasingly difficult to identify where failures originate.
Luccioni described the progression from AI models that could be probed, to AI systems with filters and additional components, to AI agents with even larger degrees of separation, noting that when something fails, you do not know where it is coming from . She called for imposing safeguards and standards for safety and sustainability at each part of the machine, regardless of how many parts there are .
on: Agentic AI creates unprecedented accountability challenges that require new governance paradigms, including structured documentation, identifiable human responsibility, and rights to timely redress
on: Whether the primary locus of human rights due diligence should be pre-deployment or continuous across the AI lifecycle
Data centres make the negative impacts of AI very local in terms of water, energy, emissions, and health, disproportionately affecting the most marginalised populations - Local environmental harms
Arg. 3Luccioni argues that while the benefits of AI can technically be global, the negative environmental impacts are very local, concentrated around data centres in terms of water, energy, emissions, and health. These local harms disproportionately affect the most marginalised populations.
Luccioni stated that while the benefits of AI can technically be global, the negative impacts in terms of water, energy, emissions, and health are very local and impact the most marginalised populations . She noted that data centres are a concrete way to anchor the debate about AI's human rights implications .
Transparency about AI's energy consumption is a fundamental human right, yet even international organisations struggle to obtain this information from member countries - Energy transparency deficit
Arg. 4Luccioni highlights a significant transparency deficit in AI's energy consumption, noting that even major international organisations like the IEA cannot obtain reliable data from member countries. This lack of transparency prevents meaningful accountability and informed decision-making.
Luccioni stated that organisations like the IEA, which she has worked with, struggle to get information about AI energy consumption because even member countries do not have the information . She described transparency as something she has been fighting for several years as a fundamental human right .
Energy efficiency labels for AI models, such as the AI Energy Score Project, represent a stepping stone to informed decision-making and eventual regulation - Energy labelling as first step
Arg. 5Luccioni proposes energy efficiency labels for AI models as a practical first step towards transparency and accountability for AI's environmental impact. Rather than immediately restricting deployment, she advocates for first quantifying and measuring impacts so that people can make informed decisions.
Luccioni described the AI Energy Score Project, which creates energy efficiency labels for AI models analogous to energy labels for appliances, as a stepping stone to informed decision-making . She argued that quantifying and measuring impacts is the prerequisite to so many other things that can and should be done when it comes to AI .
The algorithm register and fundamental rights impact assessments used in the Netherlands demonstrate practical tools for translating legal requirements into accountability - Practical accountability tools
Arg. 1Aerdts presents the Netherlands' practical tools for AI accountability as concrete examples of how legal requirements can be translated into actionable guidelines. These include an algorithm framework, a fundamental rights and algorithm impact assessment, and an algorithm register.
Aerdts described the Netherlands' algorithm framework that translates legal requirements into practical guidelines for public organisations, including a fairness handbook, bias testing instruments, and risk profiling assessments . She also mentioned the fundamental rights and algorithm impact assessment that helps identify human rights risks in AI systems , and the algorithm register that includes all algorithms used by the Dutch government in the interest of transparency .
on: Transparency is a fundamental requirement across all dimensions of AI governance, including data use, environmental impact, and decision-making processes
When making policy for children and young people, they must be genuinely included in the decision-making process alongside parents and educators, not left to face issues too big for parents but too small for police - Genuine youth inclusion in policy
Arg. 2Aerdts argues that when making policy for children and young people, they must be genuinely included in the decision-making process. She highlights a gap where young people face issues that are too big for their educators or parents but too small for the police, leaving them without tangible support.
Aerdts noted that the Netherlands speaks to UNICEF youth panels and wants to include parents as well, while ensuring platforms take their responsibility . She recounted that when speaking to young people, they mentioned that some issues they face are too big for their educators or parents but feel too small for the police, leaving them looking for a tangible way to address them .
on: Affected communities, including women, youth, children, and Global South populations, must be meaningfully included in AI governance processes, not merely consulted after decisions are made
The freedom of thought, long encompassed within freedom of expression, must be reinterpreted in the context of AI threatening cognitive autonomy through micro-targeting and manipulation - Cognitive autonomy under threat
Arg. 1This argument has already been captured above under Jhalak M. Kakkar's entries.
There is a methodological challenge in studying children as a protected category, which partly explains the lack of evidence on AI's impact on children and requires careful navigation - Methodological barriers to child research
Arg. 1This argument was made by Alvitta Ottley, not Sonia Livingstone. Please see Alvitta Ottley's entry for this argument.
on: Whether AI governance should prioritise protection of children by restricting their access or by building rights-respecting safeguards into systems
Canada's proposed law would require AI chatbots to be proven safe before exposure to children, with a digital commissioner to ensure compliance - Proof-of-safety legislation
Arg. 1Lametti describes Canada's proposed legislative approach to AI safety for children, which would require AI chatbots to be proven safe before they could be exposed to children. A digital commissioner would be established to ensure compliance with this requirement.
Lametti described Canada's new policy, AI for All, which aims to ensure privacy rights and safety in the use of AI, and a new proposed law on children that would restrict any social platform to children under 16 until proven safe . He noted that AI chatbots would also have to be proven safe before exposure to children, with a digital commissioner to ensure compliance .
on: Children require special protection in AI governance, with safety built into systems from the design stage and responsibility resting with developers and deployers rather than children or families
on: Whether AI governance should prioritise protection of children by restricting their access or by building rights-respecting safeguards into systems
Children's rights must be central to AI governance as a cross-cutting consideration, with safety built into systems from the start rather than added after harm occurs - Children's rights as cross-cutting issue
Arg. 1Henriques argues on behalf of over 120 signatories of a joint statement that children's rights must be central to AI governance as a cross-cutting consideration. Children are among the earliest and most frequent users of new technology, yet they remain largely missing from national AI strategies and governance frameworks.
Henriques spoke on behalf of over 120 signatories of the Joint Statement on Children's Rights at the AI Dialogue, a global campaign coordinated by Five Rights Foundation . She noted that children are among the earliest and most frequent users of new technology, yet remain largely missing from national AI strategies and governance frameworks .
on: Children require special protection in AI governance, with safety built into systems from the design stage and responsibility resting with developers and deployers rather than children or families
Children are not a homogeneous group; indigenous children, girls, children with disabilities, and children of African descent face disproportionate impacts from gaps in AI governance - Intersectionality of child rights
Arg. 2Henriques argues that children must not be treated as a homogeneous group in AI governance discussions. Indigenous children, girls, children with disabilities, and children of African descent face disproportionate impacts from gaps in AI governance, and their intersectionalities must be recognised.
Henriques stated that children are not a homogeneous group and that we must recognise their intersectionalities, noting that indigenous children, girls, children with disabilities, and children of African descent have their rights disproportionately impacted as a result of gaps in AI governance . She highlighted Brazil's ECA Digital as a landmark framework for the protection of children's rights in the digital environment .
on: Children require special protection in AI governance, with safety built into systems from the design stage and responsibility resting with developers and deployers rather than children or families
on: Whether AI governance should prioritise protection of children by restricting their access or by building rights-respecting safeguards into systems
Children should interact with AI systems only if they are proven safe and designed to respect children's rights, with responsibility sitting with those who build and profit from the technology - Proof of safety before child exposure
Arg. 3Henriques argues that children should only interact with AI systems that have been proven safe and designed to respect children's rights, considering their perspectives in decisions that affect them. Responsibility must sit with those who build and profit from the technology, not with children or parents.
Henriques stated that children should interact with AI systems only if they are proven safe and designed to respect children's rights and considering their perspectives in decisions that affect them . She emphasised that responsibility must sit with those who build and profit from this technology .
on: Children require special protection in AI governance, with safety built into systems from the design stage and responsibility resting with developers and deployers rather than children or families
CEDAW provides an essential framework requiring states to achieve substantive equality and tackle structural barriers in AI governance - CEDAW as AI governance framework
Arg. 1Eghobamien-Mshelia argues that CEDAW provides an essential framework for addressing the gendered realities of AI governance. It requires states not only to prohibit discrimination but to achieve substantive equality by tackling structural and regulatory barriers, stereotypes, and unequal power relations.
Eghobamien-Mshelia stated that CEDAW requires states not only to prohibit discrimination but to achieve substantive equality by tackling structural and regulatory barriers, stereotypes, and unequal power relations . She noted that CEDAW also recognises that discrimination is often compounded by factors such as race, disability, age, migration status, and poverty, requiring tailored and proactive action to curb intersectional discrimination .
on: AI amplifies and deepens existing inequalities, particularly for women, girls, the Global South, and other marginalised groups, requiring proactive governance responses
AI-amplified disinformation campaigns and hate speech force women and girls to self-censor, undermining their democratic participation - Disinformation and democratic exclusion
Arg. 1Smyth argues that AI-amplified disinformation campaigns and hate speech undermine the rights of women and girls to exercise freedom of expression by forcing them to self-censor, close their digital accounts, or withdraw from online spaces. This contributes to a broader chilling effect on their full and equal participation in society.
Smyth stated that AI-amplified disinformation campaigns and hate speech undermine the rights of women and girls to exercise freedom of expression by forcing them to self-censor, close their digital accounts, or otherwise withdraw from participating in online spaces . She noted that this contributes to a broader chilling effect on their full, equal, and meaningful participation in society .
on: AI amplifies and deepens existing inequalities, particularly for women, girls, the Global South, and other marginalised groups, requiring proactive governance responses
AI tools used for online content moderation without human oversight can amplify disinformation, disproportionately affecting women and girls - Automated moderation amplifies disinformation
Arg. 2Smyth argues that the deployment of AI for online content moderation without human oversight can amplify disinformation, undermining the integrity of the information landscape. This disproportionately affects women and girls.
Smyth stated that the deployment of AI online content moderation without human oversight can amplify disinformation, undermining the integrity of the information landscape, and that this disproportionately affects women and girls .
Brazil's decree prohibiting synthetic intimate images based on real third parties demonstrates concrete legislative action against AI-facilitated gender-based violence - Legislative action on synthetic imagery
Arg. 1Brant highlights Brazil's legislative action against AI-facilitated gender-based violence, including a decree establishing proactive responsibilities for platforms and AI companies, including the prohibition of creating synthetic intimate images based on real third parties.
Brant described Brazil's digital statute for children and adolescents online, which requires platforms to adopt child protection measures from the design phase and prohibits targeted advertising based on children's personal data . He also described a decree released the previous month to address violence against girls and women in online spaces, including the prohibition of creating synthetic intimate images based on real third parties .
Information integrity must be understood in its collective or social dimension as part of the right to access accurate and reliable information, and AI's impact on journalism's economic sustainability must be addressed - Information integrity as collective right
Arg. 2Brant argues for a broad perception of human rights when discussing AI, highlighting information integrity as a key issue. He frames information integrity as part of Article 19 in its collective or social dimension, encompassing the need for an information ecosystem that provides consistent, accurate, and reliable information.
Brant called for taking information integrity as part of Article 19 of the government in a broad perception of access to information in its collective or social dimension, and stated that we need an information ecosystem that can provide consistent, accurate, and reliable information . He also noted that the way AI is supporting and affecting the economic arrangement and sustainability of journalism should be a concern .
Common and well-designed standards for AI risk, including human rights considerations, are needed to ensure that human rights due diligence boards function consistently across interconnected multi-agent systems - Need for common AI risk standards
Arg. 1Park argues that while individual companies may define AI risk and evaluate their models accordingly, the problem arises when multi-agent systems from different companies are interconnected, as each company has its own definition of AI risk. Common and well-designed standards are needed to ensure consistent human rights due diligence across these systems.
Park stated that the problem comes when multi-agent systems from different companies are interconnected, as companies have their own definition of AI risk and some agents may consider human rights more than others . He referenced the AI risk taxonomy from the BTEC project at OHCHR as important work that needs to be developed in a more concrete and practical way to find a common baseline with many stakeholders .
on: Agentic AI creates unprecedented accountability challenges that require new governance paradigms, including structured documentation, identifiable human responsibility, and rights to timely redress
Today's children are AI natives who need education and critical thinking skills to engage with AI in a balanced way, with their voices flowing into governance discussions - AI literacy for children
Arg. 2Park argues that today's children are AI natives who use AI naturally in search, recommendation, and learning in their daily lives. It is therefore important for them to develop critical thinking skills to engage with AI in a balanced way, and their voices should flow into governance discussions.
Park stated that today's children are AI natives who use AI naturally in search, recommendation, and learning in their daily lives, and that it is important for them to accept it with critical thinking . He suggested that when school programmes for education and discussion are connected with NGOs and relevant committees, children can voice how AI affects them in a balanced way, and those voices can flow into governance discussions .
on: Children require special protection in AI governance, with safety built into systems from the design stage and responsibility resting with developers and deployers rather than children or families
on: Whether AI governance should prioritise protection of children by restricting their access or by building rights-respecting safeguards into systems
There is an evaluation mismatch between engineering metrics such as speed and accuracy and the societal questions of whether human rights are protected and institutions remain accountable - Evaluation mismatch
Arg. 1Ottley argues that there is a fundamental mismatch between the questions that engineers ask about AI (can we make it faster, more accurate, more capable?) and the questions that societies are asking (are human rights protected, are institutions accountable, is society better off?). These are simply different questions that lead to different evaluations of success.
Ottley illustrated the mismatch by noting that a parent does not ask if the model scored 94% on a recent benchmark but asks whether their child can use it and decide when not to trust it, and a physician does not ask if it is the latest model but whether they can rely on it when a patient's life is at stake . She stated that the conversations in the room are not asking whether AI is more capable than last year but whether human rights are protected, institutions remain accountable, and society is better off .
There is a significant evidence gap regarding how AI affects people's decision-making, children's learning, clinical decisions, and public servants' work, requiring longitudinal interdisciplinary studies - Evidence gap in AI impact
Arg. 2Ottley highlights a significant evidence gap: while there is abundant evidence about how well AI models perform, there is very little evidence about how AI is affecting people's decision-making, children's learning, clinical decisions, or public servants' work. Answering these questions requires longitudinal studies and interdisciplinary collaboration.
Ottley stated that we have a lot of evidence about how well AI models perform but very little evidence about how AI is affecting people's decision-making, how well AI has helped teachers teach, how AI affects clinical decisions, how AI helps children learn, or how AI affects public servants . She noted that answering these questions requires longitudinal studies, partnerships with organisations, interdisciplinary collaborations, and careful work with protected and underserved communities .
on: The appropriate role of evidence in driving AI governance action: whether to act now on existing evidence of harm or wait for more rigorous longitudinal evidence
Society must decide what success looks like and science must determine how to measure it; good decisions under uncertainty require making values explicit and evidence rigorous - Society defines success, science measures it
Arg. 3Ottley argues for a new way of thinking about the relationship between society and science in AI governance. Society must decide what success looks like, science must determine how to measure it, and together they must build the evidence to determine whether success is being achieved.
Ottley stated that society has to decide what success looks like and science has to determine how to measure it, and together they have to build the evidence that tells us whether we are actually achieving it . She concluded that good decisions under uncertainty do not come from eliminating uncertainty but from making values explicit, evidence rigorous, and uncertainty understood .
There is a methodological challenge in studying children as a protected category, which partly explains the lack of evidence on AI's impact on children and requires careful navigation - Methodological barriers to child research
Arg. 4Ottley highlights a methodological challenge that is rarely discussed: children are a protected category in research, meaning there are limitations on what can be studied and how. This partly explains the lack of evidence on AI's impact on children and means that things are often developed without children being involved.
Ottley noted that children, along with pregnant women and people in prison, are considered a protected category of the population, meaning there are limitations on what can be studied and how, which is one of the reasons why there is a lack of evidence on the impact of AI on children . She stated that this also means that a lot of times things are developed without having children involved .
on: Whether AI governance should prioritise protection of children by restricting their access or by building rights-respecting safeguards into systems
Young people are the most users of AI and the most frequent innovators within AI firms, yet they are almost never the decision-makers despite living longest with the consequences - Youth excluded from AI decision-making
Arg. 1Paullier argues that young people are the most users of AI and many of the innovators within AI technology firms, yet they are almost never the decision-makers. This is a significant governance gap given that they will live longest with the consequences of decisions made today.
Paullier stated that young people are the most users of artificial intelligence and are actually most of the innovators and creators within some of these huge AI technology firms, but almost always they are not the decision-makers . He noted that they will live the longest of the consequences of the decisions that we make today .
on: Affected communities, including women, youth, children, and Global South populations, must be meaningfully included in AI governance processes, not merely consulted after decisions are made
Meaningful spaces for young people to engage in AI governance must be created at the national level, not only globally, as young people best understand both opportunities and harms - National youth participation
Arg. 2Paullier argues that meaningful spaces for young people to engage in AI governance must be created especially at the national level, not only in global forums. Young people are those who first experience the impact of technology in their education, employment, and everyday digital life, and they best understand both the opportunities and the harms.
Paullier stated that young people are those who first experience the impact of technology in their education, employment cycles, and everyday digital life, and that they forge their identities in the digital space . He argued that young people are the ones who understand the most about which opportunities AI can bring but also the ones who will help identify biases, discriminations, and exclusions .
If meaningful spaces for youth are not created, young people will create their own spaces outside governance frameworks, as has happened in the climate space - Youth will self-organise
Arg. 3Paullier warns that if meaningful spaces for young people to engage in AI governance are not created, young people will find their own way and create their own spaces, as has happened in the climate space. This underscores the urgency of proactive inclusion.
Paullier stated that if meaningful spaces for young people to engage are not created, young people will find their way and create their own spaces, as has happened within the climate space .
Young people consistently raise the human dimension and the impact of AI on well-being, mental health, and meaningful human relationships as their primary concern - Youth prioritise human well-being
Arg. 4Paullier reports that across regions, young people consistently raise the human dimension and the impact of AI on well-being, mental health, and meaningful human relationships as their primary concern. While young people value technology, what they value most is belonging, trust, and meaningful human relationships.
Paullier stated that what young people and citizens in general value most is belonging, trust, and meaningful human relationships . He called for emphasis on the impact of technologies on the well-being and mental health of communities, and for working not only for youth but with youth .
Journalism is a keystone species of the information ecosystem; AI systems are trained on journalistic content scraped without consent or compensation, undermining journalism's business models - Journalism as critical infrastructure
Arg. 1Osterling argues that journalism is a keystone species of the information ecosystem that stabilises trust, anchors verification, structures accountability, and enables other institutions to function. AI systems are trained on journalistic content scraped without consent, compensation, or credit, undermining journalism's business models and public trust.
Osterling cited her colleague's description of journalism as a keystone species of the information ecosystem, noting that removing it means the ecosystem does not adapt but collapses . She stated that AI systems are trained on journalistic content scraped without consent, compensation, or credit , and called for public digital infrastructure, industrial policies ensuring public interest AI, and AI governance requiring human rights to be embedded across the full lifecycle of AI systems .
AI-generated disinformation and online hate speech have created direct protection risks for refugees and displaced people, as seen in Libya and among the Rohingya - AI hate speech as protection risk
Arg. 1Tan argues that AI-generated disinformation and online hate speech have become direct protection risks for refugees and displaced people. She presents concrete examples from Libya and the Rohingya community where AI-generated content has incited hostility, abuse, and violence.
Tan cited the example of Libya, where violent hate speech and dangerous misinformation including AI-generated content incited hostility and abuse of refugees and affected the safety of UNHCR and humanitarian workers . She also noted that the Rohingya continue to face dehumanising narratives online even in exile, and that this kind of hate can fuel abuse, exclusion, violence, and fear .
Geopolitical competing interests impede global AI governance, and leveraging negotiation tools to shift from positional bargaining to integrative negotiation is essential to forge common ground - Negotiation as governance tool
Arg. 1Bellion-Jourdan argues that geopolitical competing interests and power asymmetries are impediments to global AI governance, and that leveraging the tools and techniques of multilateral negotiation can help navigate these challenges. The goal is to shift from positional bargaining and win-lose dynamics to integrative negotiation and win-win outcomes.
Bellion-Jourdan argued that if we leverage the power of negotiation with all its tools and techniques to navigate power politics and power asymmetry, this would allow us to forge common ground . He called for investment in process design, process management, and innovative formats of negotiations, noting that it will not be enough to lock 193 states in a room and expect agreement .
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
The Council of Europe Framework Convention on AI is the first binding treaty placing AI within the order of human rights, democracy, and the rule of law - First binding AI treaty
Arg. 1Kownacki welcomes the Council of Europe Framework Convention on AI as the first binding treaty to place AI within the order of human rights, democracy, and the rule of law. He argues that Poland is turning these principles into practice at home through its national digitisation strategy and AI policy.
Kownacki stated that Poland welcomes the Council of Europe Framework Convention on AI, describing it as the first binding treaty to place AI within the order of human rights, democracy, and the rule of law . He noted that Poland's national AI policy commits to artificial intelligence that is human-centric and trustworthy .
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
The human factor, keeping a person with the final word to understand, contest, and switch off AI decisions, is the common ground on which truly global AI governance can be built - Human factor as common ground
Arg. 2Kownacki argues that the human factor — keeping a person with the final word to understand, contest, and switch off AI decisions — is non-negotiable and represents the common ground on which truly global AI governance can be built. This must be written into values, laws, standards, and institutions, not left as a declaration.
Kownacki stated that however capable AI systems become, a person must keep the final word, to understand the decision, to contest it, and where it matters most to switch the systems off, and that this is non-negotiable above all in high-risk systems . He argued that the human factor belongs to no single nation and is the common ground on which a truly global governance of AI can be built .
on: Meaningful human oversight of AI must be real and substantive, not a rubber stamp, with an identifiable human retaining authority to alter or stop systems
on: Whether AI governance should focus on universal binding standards or allow genuine pluralism above a common floor of rights safeguards
A common floor of rights safeguards, including disclosure, contestability, and remedy, must apply to every person affected by AI - Common rights floor
Arg. 1Shahani argues that compatibility between national approaches to AI governance does not require uniformity. Instead, a common floor of rights safeguards — including disclosure, contestability, and remedy — must apply to every person affected by AI, with genuine pluralism permitted above that floor.
Shahani stated that compatibility between approaches globally does not require uniformity, and that we can have a common floor of rights safeguards including disclosure, contestability, and remedy for every person affected, but with genuine pluralism above that floor .
on: Whether AI governance should focus on universal binding standards or allow genuine pluralism above a common floor of rights safeguards
Safety claims must be accompanied by conditions under which systems were tested and known failure rates disaggregated by language, gender, disability, and region - Disaggregated safety disclosure
Arg. 2Shahani argues that safety claims for AI systems must be accompanied by the conditions under which systems were tested, known limitations, and failure rates disaggregated by language, gender, disability, region, and skin tone. Without this, it is impossible to hold a system accountable for where it fails.
Shahani stated that safety claims must be accompanied by the conditions under which systems were tested, known limitations and failure rates disaggregated by language, gender, disability, region, skin tone, and more, and that disclosure of training data provenance must be standard . She noted that we cannot hold a system accountable if we cannot see where it fails .
on: Transparency is a fundamental requirement across all dimensions of AI governance, including data use, environmental impact, and decision-making processes
Global majority countries largely import models trained elsewhere and deploy them in high-stakes settings without the means to evaluate them, requiring publicly financed regional evaluation capacity - Regional evaluation capacity
Arg. 3Shahani argues that global majority countries largely import AI models trained elsewhere and deploy them in high-stakes settings without the means to evaluate them first. She calls for publicly financed, regionally hosted capacity to evaluate AI systems before deployment and open benchmarks built with and for under-resourced languages.
Shahani stated that global majority countries largely import models trained elsewhere and deploy them in high-stakes settings without the means to evaluate them first, and called for publicly financed, regionally hosted capacity to evaluate AI systems before they are deployed and open benchmarks built with and for under-resourced languages .
on: Whether geographic unevenness in human rights due diligence is a structural choice by companies or a capacity gap
Indigenous and traditional knowledge is being absorbed into training data without consent, recognition, or return, requiring community-led data stewardship as part of human oversight - Indigenous data sovereignty
Arg. 4Shahani argues that indigenous and traditional knowledge is being absorbed into AI training data without consent, recognition, or return. She calls for community-led data stewardship to be recognised as part of human oversight.
Shahani stated that indigenous and traditional knowledge is being absorbed into training data without consent, recognition, or return, and that community-led data stewardship must therefore be recognised as part of human oversight .
51% of AI governance conversations happen in Geneva, meaning the rest of the world is effectively locked out due to visa restrictions, which themselves rely on opaque algorithms - Visa algorithms exclude global voices
Arg. 1Bonyo argues that the concentration of AI governance conversations in Geneva, combined with visa restrictions that rely on opaque algorithms, effectively locks out the rest of the world from these discussions. She calls for transparency in the algorithms that determine whether people can travel to participate in governance forums.
Bonyo cited a report stating that 51% of AI governance conversations this year happen in Geneva, meaning the rest of the world is effectively locked out because they cannot access visas . She called for algorithmic openness around visa processes and asked the global north to reconsider the kind of algorithms outsourced to determine whether people travel .
on: Affected communities, including women, youth, children, and Global South populations, must be meaningfully included in AI governance processes, not merely consulted after decisions are made
The Africa AI Governance Index tracks AI strategies, laws, and institutions across all African states for the first time, providing an assessment tool for inclusive governance - Africa AI Governance Index (Linda Bonyo)
Arg. 2Bonyo presents the Africa AI Governance Index, launched by Lawyers Hub, as a tool for tracking AI strategies, laws, and institutions across all African states for the first time. This provides an assessment tool that supports inclusive governance by making African AI governance visible and comparable.
Bonyo stated that the Africa AI Governance Index tracks AI strategies, laws, and institutions across all African states, and that for the first time there is an assessment that covers everyone across the African continent . She invited participants to visit AIpolicy.africa to interact with the work of the AI Lab .
Uruguay's commitment to gender-responsive AI governance and the Global Partnership for Human Rights represents a multi-stakeholder platform connecting efforts on AI's cross-cutting impacts - Multi-stakeholder human rights platform
Arg. 1De Bellis Bonilla highlights Uruguay's commitment to driving forward a digital transformation that includes AI development and use in an inclusive and gender-based approach. She points to the Global Partnership for Human Rights as a broad multi-stakeholder platform that connects efforts on AI's cross-cutting impacts.
De Bellis Bonilla noted Uruguay's adherence to the Madrid Declaration on the Fifth Ministerial Conference on the Feminist Foreign Policy , and highlighted the Global Partnership for Human Rights from OHCHR as a broad multi-stakeholder platform and network connecting all efforts with a cross-cutting focus on the impact of AI .
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
Access Now calls for a halt to AI tools facilitating violations of international humanitarian law and human rights law, especially in conflict contexts, alongside binding global governance mechanisms - Halt to IHL-violating AI
Arg. 1Gigena calls on behalf of Access Now for a halt to the development and use of AI tools that are facilitating violations of international humanitarian law and international human rights law, especially in contexts of conflict or war. He also calls for binding legal standards and global governance mechanisms to regulate digital surveillance technologies and AI.
Gigena called for a halt to the development and use of AI tools facilitating violations of international humanitarian law and international human rights law, especially in contexts of conflict or war . He also echoed calls for the adoption of human rights-centred, binding legal standards and global governance mechanisms to regulate digital surveillance technologies and AI, addressing chilling effects .
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
Access to AI should be treated not as a privilege to be earned but as a basic right to be enjoyed, with global AI capacity-building to reduce fragmented readiness - AI access as a right
Arg. 1Cha argues that access to AI should be treated not as a privilege to be earned but as a basic right to be enjoyed. He notes that global efforts to build AI readiness remain fragmented, and that the Republic of Korea has declared a vision for establishing a Global AI Hub to contribute to strengthening global AI capacity.
Cha stated that the Republic of Korea considers access to AI not as a privilege to be earned but as a basic right to be enjoyed . He noted that as countries deepen their readiness for AI, their approaches to governing it also deepen, but globally these efforts remain fragmented , and described Korea's vision for establishing the Global AI Hub together with nine participating AI and related organisations .
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
Community-centred connectivity is a prerequisite for equitable AI participation; communities are not the last mile but the first mile of AI - Communities as first mile
Arg. 1The APC representative argues that before communities can contribute data, build local AI solutions, influence policy, or benefit from innovation, they need meaningful, affordable, trusted, and locally relevant connectivity. Community-centred connectivity shifts power closer to communities and enables women, indigenous people, rural communities, and speakers of underrepresented languages to become creators and decision-makers.
The speaker stated that community-centred connectivity is more than providing internet access; it is about communities owning, managing, and governing the infrastructure that connects them, creating space for local knowledge, local languages, and community priorities to thrive . The speaker concluded that communities are not the last mile of connectivity or of AI but are actually the first mile .
on: Affected communities, including women, youth, children, and Global South populations, must be meaningfully included in AI governance processes, not merely consulted after decisions are made
History will judge us not by how intelligent our AI is, but by whether we protected those with the smallest voice and the greatest stake in the future - Moral responsibility to children
Arg. 1Kiladze argues that the question of AI and children's rights is ultimately a moral one about whether there is the will from states, companies, and international organisations to design, develop, and govern AI that respects children's rights. History will judge us not by the intelligence of our AI but by whether we protected those with the smallest voice and the greatest stake in the future.
Kiladze stated that history will not judge us by how intelligent our AI or machines are, but by whether we used this extraordinary moment to protect those who had the smallest voice but the greatest stake in the future . She referenced the joint UN statement on AI and the Rights of the Child, co-led by ITU, the CRC, and UNICEF, which unified 13 UN agencies and over 60 organisations, with children from all five UN regions helping to shape it .
on: Children require special protection in AI governance, with safety built into systems from the design stage and responsibility resting with developers and deployers rather than children or families
Compatibility between national approaches does not require uniformity; a common floor of rights safeguards with genuine pluralism above it is achievable - Common floor with pluralism
Arg. 1This argument was primarily made by Shumaila Hussaini Shahani. Clara Chappaz's role in the session was as moderator, and her closing remarks synthesised the panel's contributions rather than advancing this specific argument independently.
Innovation should not come at the cost of harm to children; if there is potential harm, protection must be prioritised, and AI systems should only be accessible to children if proven safe and designed to respect their rights - Protection over innovation for children
Arg. 1Hendricks argues that innovation must not be pursued at the expense of children's safety and rights. Children should only interact with AI systems that have been proven safe and designed with their rights in mind, and responsibility must rest with those who build and profit from the technology rather than with children or families.
Hendricks stated that if there is potential harm, we need to prioritise protection, and that children should interact with AI systems only if they are proven safe and designed to respect children's rights and considering their perspectives in decisions that affect them . She emphasised that responsibility must sit with those who build and profit from this technology, and called for building an AI future worthy of every child's trust and safety .
on: Children require special protection in AI governance, with safety built into systems from the design stage and responsibility resting with developers and deployers rather than children or families
Creators and artists must remain in control of how their work is used to develop AI systems, with freely negotiated agreements between rights holders and technology developers creating trust and legal certainty - Creator control over AI training data
Arg. 1Baruch argues that responsible AI governance requires that creators and artists retain control over how their work is used to train AI systems. Agreements reached freely and voluntarily between creators, rights holders, and technology developers are the foundation for trust, legal certainty, and sustainable innovation.
Baruch stated that creators and artists must remain in control of how their work is used to develop AI systems, and that agreements reached freely and voluntarily between creators, rights holders, and technology developers create trust, legal certainty, and sustainable innovation . He referenced Universal Music Group's partnerships with companies including NVIDIA, Stability AI, and Spotify as practical examples of this approach .
Transparency about when and how creators' works are used to develop AI models is essential for protecting artistic integrity and enabling meaningful accountability - Transparency for creators
Arg. 2Baruch argues that creators must know when and how their works have been used to develop AI models and how they will be used for outputs. Without transparency, there can be no accountability, no trust, and no meaningful collaboration between the creative and technology sectors.
Baruch stated that creators should know when and how their works have been used to develop AI models and how they will be used for outputs, and that without transparency there can be no accountability, no trust, and no meaningful collaboration . He argued that with transparency, artistic integrity can be protected and, where necessary, enforced .
on: Transparency is a fundamental requirement across all dimensions of AI governance, including data use, environmental impact, and decision-making processes
AI should amplify human creativity rather than replace it, as music carries memory, identity, emotion, and lived experience that goes beyond data or patterns - AI as amplifier of human creativity
Arg. 3Baruch argues that AI is an extraordinary creative tool but must remain subordinate to human creativity rather than replacing it. Music, as a profoundly human art form carrying memory, identity, emotion, and lived experience, exemplifies why human oversight of AI in the creative sector is essential.
Baruch stated that AI is an extraordinary creative tool but it should amplify human creativity, not replace it, and that music is profoundly human, carrying memory, identity, emotion, and lived experience . He cited Bjorn Ulvaeus's description of music as testimony, and argued that if applied responsibly, AI can ignite a new renaissance of human creativity preserving cultural heritage and inspiring future generations .
Article 27 of the Universal Declaration of Human Rights and Article 15 of the International Covenant on Economic, Social, and Cultural Rights protect creators' moral and material interests, and these principles remain fully applicable in the age of AI - Human rights framework for creators
Arg. 4Baruch grounds the music industry's approach to AI governance in international human rights law, arguing that the rights of creators to protection of their moral and material interests are enshrined in foundational human rights instruments and remain just as relevant in the AI era.
Baruch stated that Article 27 of the Universal Declaration of Human Rights and Article 15 of the International Covenant on Economic, Social, and Cultural Rights recognise that creators are entitled to protection of the moral and material interests from their work, and that those principles are just as relevant in the age of AI .
Survey results from session participants show a plurality are concerned that insufficient governance measures are in place, with accountability, rule of law, and AI's impact on children identified as the top human rights concerns - Participant concern about governance gaps
Arg. 1Hicks presents the results of a survey conducted among session participants, revealing that many are uncertain or concerned about the adequacy of current AI governance measures. The survey identified accountability and rule of law, and the impact of AI on children, as the top human rights concerns among participants.
Hicks reported that a plurality of survey respondents were quite concerned that we do not have the measures in place to address the challenges and opportunities discussed in the session . She noted that the top two human rights issues identified in the survey were accountability and rule of law, and the impact of AI on children, followed by surveillance and use of AI by law enforcement, and environmental sustainability .
Survey respondents overwhelmingly identified AI-developing companies, states, and deploying organisations as the primary responsible parties for agentic AI actions, consistent with the UN Guiding Principles on Business and Human Rights - Distributed accountability for agentic AI
Arg. 2Hicks presents survey findings showing that participants identified a hierarchy of responsibility for agentic AI: first, companies that develop AI models; second, states that must ensure regulatory environments prevent harm; and third, organisations that deploy agentic systems. This is consistent with the UN Guiding Principles on Business and Human Rights.
Hicks reported that survey respondents identified the companies that develop AI models as the primary responsible party for agentic AI actions, followed by states and the public authorities that allowed the system, and then the organisations that deploy it . She noted that this is consistent with the UN Guiding Principles on Business and Human Rights, under which the first pillar is that states are responsible for ensuring the regulatory environment exists to prevent companies from causing harm .
on: Agentic AI creates unprecedented accountability challenges that require new governance paradigms, including structured documentation, identifiable human responsibility, and rights to timely redress
A survey of 1,000 children in 49 countries found they want AI to be shaped with them, not just for them, and they want it to respect their rights rather than simply being shielded from it - Children want agency in AI governance
Arg. 3Hicks references a survey of 1,000 children in 49 countries conducted with ITU, which found that children want meaningful participation in shaping AI rather than simply being protected from it. Children expressed that they want AI to respect their rights and want to be included in governance discussions.
Hicks described a survey called 'Me and AI' of 1,000 children in 49 countries, noting that children said they want AI to be shaped with them, not just for them, and they want it to respect their rights and do not just want to be shielded from it .
on: Affected communities, including women, youth, children, and Global South populations, must be meaningfully included in AI governance processes, not merely consulted after decisions are made
Trust in AI is not only an ethical objective but a prerequisite for broader AI adoption, requiring a human-centric approach grounded in human rights, democratic values, ethics, safety, transparency, and accountability - Trust as prerequisite for AI adoption
Arg. 1Pipan argues that Slovenia's view is that trust in AI must be understood not merely as an ethical aspiration but as a practical prerequisite for the broader adoption of AI systems. This trust must be built on a human-centric approach grounded in human rights, democratic values, ethics, safety, transparency, and accountability.
Pipan stated that in Slovenia's view, trust is not only an ethical objective but also a prerequisite for the broader adoption of AI, and that this approach is reflected in Slovenia's national AI strategy 2030, adopted in March of that year . She noted that the strategy clearly promotes a human-centric approach to AI grounded in human rights, democratic values, ethics, safety, transparency, and accountability, with the objective of ensuring that AI is developed and used responsibly in the public interest .
on: AI governance must be grounded in international human rights law as a binding framework, not merely aspirational ethics
Building trust in AI requires effective and practical implementation, including responsible governance, legal certainty, support mechanisms, and sustained investment in AI literacy and technology skills - Implementation as foundation of trust
Arg. 2Pipan argues that declaring principles is insufficient; building genuine trust in AI requires translating those principles into effective and practical implementation. This entails ensuring responsible governance, legal certainty, appropriate support mechanisms, and sustained investment in AI literacy and technology skills.
Pipan stated that the strategy recognises that building trust requires effective and practical implementation, and that this entails ensuring responsible governance, legal certainty, appropriate support mechanisms, and sustained investment in AI literacy and technology skills .
on: Transparency is a fundamental requirement across all dimensions of AI governance, including data use, environmental impact, and decision-making processes
As a small linguistic community, Slovenia places particular importance on protecting linguistic and cultural diversity, arguing that inclusive AI must reflect and preserve all languages and cultures so that no community is left behind - Linguistic and cultural diversity in AI
Arg. 3Pipan highlights Slovenia's particular concern as a small linguistic community that inclusive AI must reflect and preserve all languages and cultures. She argues that AI governance must ensure that no community is left behind due to linguistic or cultural underrepresentation in AI systems.
Pipan stated that as a small linguistic community, Slovenia places particular importance on protecting linguistic and cultural diversity, and that inclusive AI should reflect and preserve all languages and cultures, ensuring that no community is left behind .
International cooperation through the exchange of good practices, interoperable approaches, and capacity building is essential to advance trustworthy AI globally - International cooperation for trustworthy AI
Arg. 4Pipan calls for strengthened international cooperation as a key pillar of advancing trustworthy AI globally. She argues that this cooperation should take the form of exchanging good practices, developing interoperable approaches, and building capacity across countries.
Pipan outlined four forward-looking priorities for Slovenia, including strengthening international cooperation through the exchange of good practices, interoperable approaches, and capacity building to advance trustworthy AI globally . She also called for complementing regulatory frameworks with practical implementation support, including capacity building, guidance, and AI literacy .
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
The collaboration between the World Bank and OHCHR in preparing the AI governance session reflects the importance of UN system cooperation in addressing timely and important issues of AI governance - UN system collaboration on AI
Arg. 1Ng emphasises the significance of the dialogue by characterising it as timely and important, and acknowledges the substantial preparatory work done by OHCHR and his counterpart. This implicitly argues that effective AI governance requires coordinated effort across UN system organisations rather than siloed approaches.
Ng thanked OHCHR and the co-chairs for doing a lot of the heavy lifting in preparing the session, and specifically acknowledged his OHCHR counterpart Li Zhou for his massive efforts .
Broad participation from diverse stakeholders must be structurally ensured in AI governance dialogues by alternating between member state and non-state stakeholder representatives - Structured multi-stakeholder participation
Arg. 1The Co-moderator explains that the audience intervention segment is organised to alternate between one representative from member states and one representative from other stakeholders. This procedural arrangement reflects a substantive commitment to inclusive multi-stakeholder participation as a governance principle, ensuring that civil society, private sector, and other non-state voices are formally embedded in the dialogue structure alongside governments.
The Co-moderator stated that in the interest of promoting broad participation from stakeholders, the segment would proceed with one representative from member states and one representative from other stakeholders, alternating between the two .
Time discipline and equal speaking time for all participants is essential to maximise the number of voices heard in AI governance forums - Equal and time-limited participation
Arg. 2The Co-moderator emphasises that a timer has been set and that microphones will be automatically switched off once the allocated speaking time expires. This procedural commitment reflects a substantive principle that governance forums must actively manage participation to ensure the broadest possible range of voices can be heard, rather than allowing a few speakers to dominate.
The Co-moderator noted that a timer had been set visible on screen and at the lectern, and that microphones would be automatically switched off once the allocated speaking time expired, encouraging all speakers to respect the allotted time so that the largest possible number of speakers could be accommodated .
Session Knowledge Graph
Speakers · Topics · Arguments · Relationships
Across the session, speakers from government, civil society, international organisations, and academia converged on the view that AI governance cannot remain voluntary or ethics-based but must be anchored in binding international human rights law. Turk argued that international human rights law constitutes a binding legal framework and that human rights provide the compass for AI governance . Bahous stated that AI governance cannot be treated solely as a technical issue and is fundamentally a human rights matter, referencing CEDAW and the ICCPR as comprehensive frameworks . Arias Arzeno argued that justice systems are essential for converting human rights principles into reality . Lampel called for enforcing international human rights law today through binding legal frameworks applied equally regardless of wealth or power . Cassayre recommended that human rights and the rule of law must underpin the development and deployment of digital technologies . Chetty argued that prevailing governance models anchored in ethical or responsible AI remain structurally inadequate and called for normative frameworks rooted in international human rights law . Pipan stated that trust in AI requires a human-centric approach grounded in human rights and democratic values . Eghobamien-Mshelia argued that CEDAW requires states to achieve substantive equality by tackling structural barriers .
The UN system must use international human rights law as a binding compass for AI governance, with OHCHR's advisory service helping states govern AI in line with human rights responsibilities - UN human rights framework as compass
AI governance must be treated as a fundamental human rights issue, not merely a technical one, with international human rights law providing a binding legal framework - Human rights as binding framework
Justice systems must convert human rights principles into reality by ensuring accountability when AI causes harm, focusing on transparency, traceability, and effective remedy - Justice systems as accountability mechanisms
The rule of law requires implementing binding legal frameworks equally, regardless of wealth, power, or influence - Binding legal frameworks
AI governance must embed human rights across the full AI lifecycle, from design to deployment and monitoring - Full lifecycle governance
AI governance frameworks must move beyond self-regulatory, ethics-based models to normative frameworks rooted in international human rights law - Beyond voluntary ethics
Trust in AI is not only an ethical objective but a prerequisite for broader AI adoption, requiring a human-centric approach grounded in human rights, democratic values, ethics, safety, transparency, and accountability - Trust as prerequisite for AI adoption
Children's rights must be central to AI governance as a cross-cutting consideration, with safety built into systems from the start rather than added after harm occurs - Children's rights as cross-cutting issue
CEDAW provides an essential framework requiring states to achieve substantive equality and tackle structural barriers in AI governance - CEDAW as AI governance framework
Multiple speakers explicitly rejected the framing that regulation and innovation are in tension. Turk stated that we do not consider safety standards for medicines, cars, or aircraft as obstacles to progress but as the reason why people trust those technologies, and that it is possible to design technologies that advance rights, economic opportunity, and safety simultaneously . Bahous drew the same analogy, arguing that just as we would never release food, medicine, aircraft, or vehicles without rigorous oversight, AI should not be deployed without mandatory safeguards . Cassayre stated that effective regulation, transparency, accountability, and human oversight are not obstacles to innovation but the foundations of trustworthy and sustainable innovation . Kownacki argued that Poland's answer is not to halt innovation but to keep one factor constant at its core: the human being .
The UN system must use international human rights law as a binding compass for AI governance, with OHCHR's advisory service helping states govern AI in line with human rights responsibilities - UN human rights framework as compass
AI governance must be treated as a fundamental human rights issue, not merely a technical one, with international human rights law providing a binding legal framework - Human rights as binding framework
AI governance must embed human rights across the full AI lifecycle, from design to deployment and monitoring - Full lifecycle governance
The rule of law requires implementing binding legal frameworks equally, regardless of wealth, power, or influence - Binding legal frameworks
The human factor, keeping a person with the final word to understand, contest, and switch off AI decisions, is the common ground on which truly global AI governance can be built - Human factor as common ground
There was strong consensus that human oversight cannot be nominal. Turk stated that human oversight of AI systems cannot be just a rubber stamp and requires that an identified person be granted authority, competence, time, independence, and power to alter and even stop a system . Arias Arzeno argued that no public institution can justify a decision by saying that is what the system told us to do, and that technology should help the judge but never replace them . El Fallah Seghrouchni proposed that when agents are deployed in public services, there must be an identifiable human being in charge for all issues tied to rights, and that the functioning of the algorithm must never be autonomous in regards to rights and the law . Kownacki stated that however capable AI systems become, a person must keep the final word to understand, contest, and switch off decisions, and that this is non-negotiable . Tan argued that human oversight must be real, informed, and able to change outcomes in high-stakes areas such as asylum and border management .
The UN system must use international human rights law as a binding compass for AI governance, with OHCHR's advisory service helping states govern AI in line with human rights responsibilities - UN human rights framework as compass
No public institution can justify a decision by saying the system told it to do so; responsibility must lie with people and institutions - Human institutional responsibility
AI systems must be subject to structured documentation of agent chains, appointment of an identifiable responsible human, and a right to timely redress - Three accountability obligations
The human factor, keeping a person with the final word to understand, contest, and switch off AI decisions, is the common ground on which truly global AI governance can be built - Human factor as common ground
Common and well-designed standards for AI risk, including human rights considerations, are needed to ensure that human rights due diligence boards function consistently across interconnected multi-agent systems - Need for common AI risk standards
Transparency emerged as a cross-cutting requirement endorsed by speakers from diverse backgrounds. Turk argued that decisions around AI need to be transparent about how data is being used and where people can seek justice . Luccioni described transparency as a fundamental human right she has been fighting for, enabling users to know what AI costs, where data comes from, and where energy comes from . Aerdts highlighted the Netherlands' algorithm register as a transparency tool covering all algorithms used by the Dutch government . Baruch stated that without transparency there can be no accountability, no trust, and no meaningful collaboration . Shahani called for safety claims to be accompanied by conditions under which systems were tested and failure rates disaggregated by language, gender, disability, and region . Dad argued that the evidence problem in AI governance is fundamentally a resourcing problem and that civil society organisations documenting harms must be connected to decision-making .
The UN system must use international human rights law as a binding compass for AI governance, with OHCHR's advisory service helping states govern AI in line with human rights responsibilities - UN human rights framework as compass
Transparency about AI's environmental footprint is a fundamental human right, enabling users to make informed choices between tools - Environmental transparency as human right
The algorithm register and fundamental rights impact assessments used in the Netherlands demonstrate practical tools for translating legal requirements into accountability - Practical accountability tools
Transparency about when and how creators' works are used to develop AI models is essential for protecting artistic integrity and enabling meaningful accountability - Transparency for creators
Safety claims must be accompanied by conditions under which systems were tested and known failure rates disaggregated by language, gender, disability, and region - Disaggregated safety disclosure
Human rights due diligence and impact assessments must be mandatory before and after AI deployment, not merely aspirational - Mandatory due diligence
Building trust in AI requires effective and practical implementation, including responsible governance, legal certainty, support mechanisms, and sustained investment in AI literacy and technology skills - Implementation as foundation of trust
Protection of children from AI harms was one of the most widely shared concerns across the session. Turk called for specific attention to protecting children online and encouraged drawing on OHCHR's guidelines . Livingstone presented abundant evidence of child rights violations, including that across 11 global south countries up to one child per classroom reported AI was used to make sexually explicit deepfakes of them, and that reports of AI-generated child sexual abuse material are rising exponentially . Lametti described Canada's proposed law requiring AI chatbots to be proven safe before exposure to children . Henriques argued on behalf of over 120 signatories that children's rights must be central to AI governance and that safety must be built into systems from the start . Kiladze stated that history will not judge us by how intelligent our AI is but by whether we protected those with the smallest voice and the greatest stake in the future . Brant described Brazil's digital statute requiring platforms to adopt child protection measures from the design phase . Kakkar argued that we need to have certification and post-deployment monitoring of harms and impacts, and that the onus must be placed back on platforms, companies, governments, and regulators .
The UN system must use international human rights law as a binding compass for AI governance, with OHCHR's advisory service helping states govern AI in line with human rights responsibilities - UN human rights framework as compass
Canada's proposed law would require AI chatbots to be proven safe before exposure to children, with a digital commissioner to ensure compliance - Proof-of-safety legislation
Children's rights must be central to AI governance as a cross-cutting consideration, with safety built into systems from the start rather than added after harm occurs - Children's rights as cross-cutting issue
Children are not a homogeneous group; indigenous children, girls, children with disabilities, and children of African descent face disproportionate impacts from gaps in AI governance - Intersectionality of child rights
Children should interact with AI systems only if they are proven safe and designed to respect children's rights, with responsibility sitting with those who build and profit from the technology - Proof of safety before child exposure
Innovation should not come at the cost of harm to children; if there is potential harm, protection must be prioritised, and AI systems should only be accessible to children if proven safe and designed to respect their rights - Protection over innovation for children
Today's children are AI natives who need education and critical thinking skills to engage with AI in a balanced way, with their voices flowing into governance discussions - AI literacy for children
History will judge us not by how intelligent our AI is, but by whether we protected those with the smallest voice and the greatest stake in the future - Moral responsibility to children
There was broad consensus that AI does not operate on a neutral playing field but actively amplifies existing inequalities. Turk stated that AI is fuelling mass surveillance, disinformation, and enabling bias including from a gender perspective, and that AI will deepen inequalities rather than help close them without inclusive governance . Bahous cited evidence that 44% of assessed AI systems demonstrate gender bias and that up to 99% of online deepfakes target women . Livingstone documented that AI power is concentrated in very few companies, countries, and languages, with adverse impacts on cultures, languages, inclusion, and education . Dad argued that companies conduct meaningful human rights assessments primarily where the law requires them to, primarily in the EU, creating a two-tier rights regime determined by geography . López Agueda warned that without inclusive governance, the global south will serve merely as a battery or data provider for greater powers . Chetty argued that prevailing governance frameworks deepen existing inequalities by extracting value from individuals, communities, and nations without reciprocal benefit .
The UN system must use international human rights law as a binding compass for AI governance, with OHCHR's advisory service helping states govern AI in line with human rights responsibilities - UN human rights framework as compass
AI governance must be treated as a fundamental human rights issue, not merely a technical one, with international human rights law providing a binding legal framework - Human rights as binding framework
44% of assessed AI systems demonstrate gender bias, and AI reproduces and amplifies harmful stereotypes because training data reflects existing biases - AI amplifies gender bias
Technology-facilitated gender-based violence cannot be treated as a niche safety issue; any due diligence framework that does not address it has written half the population out of its protection - TFGBV as systemic issue
Without inclusive governance, the global south will serve merely as a battery or data provider for greater powers - Global south as data colony
AI governance frameworks must move beyond self-regulatory, ethics-based models to normative frameworks rooted in international human rights law - Beyond voluntary ethics
CEDAW provides an essential framework requiring states to achieve substantive equality and tackle structural barriers in AI governance - CEDAW as AI governance framework
AI-amplified disinformation campaigns and hate speech force women and girls to self-censor, undermining their democratic participation - Disinformation and democratic exclusion
Speakers converged on the view that agentic AI represents a qualitatively new accountability challenge. El Fallah Seghrouchni described accountability in agentic systems as probably the most significant legal challenge of the decade, noting that with networks of individually autonomous agents there is no human at the origin of the final decision . She proposed three obligations: structured documentation of agent chains, an identifiable human in charge for rights-related issues, and a right to timely redress . Luccioni argued that agentic AI amplifies degrees of separation between users and underlying technology, making it harder to identify where failures originate . Park noted that the problem arises when multi-agent systems from different companies are interconnected, as each company has its own definition of AI risk . Hicks reported that survey respondents overwhelmingly identified companies developing AI models, states, and deploying organisations as the primary responsible parties for agentic AI .
Agentic AI creates the most significant legal accountability challenge of the decade, as no single human is at the origin of final decisions in networks of autonomous agents - Agentic AI accountability gap
AI systems must be subject to structured documentation of agent chains, appointment of an identifiable responsible human, and a right to timely redress - Three accountability obligations
Agentic AI amplifies degrees of separation between users and underlying technology, making it harder to identify where failures originate - Agentic AI opacity
Gender and child rights impact assessments must be mandatory, conducted before deployment with affected communities participating - Mandatory gender impact assessments
Survey respondents overwhelmingly identified AI-developing companies, states, and deploying organisations as the primary responsible parties for agentic AI actions, consistent with the UN Guiding Principles on Business and Human Rights - Distributed accountability for agentic AI
Common and well-designed standards for AI risk, including human rights considerations, are needed to ensure that human rights due diligence boards function consistently across interconnected multi-agent systems - Need for common AI risk standards
There was strong consensus that meaningful participation of affected communities is not optional but essential to legitimate AI governance. Bahous stated that women and girls, feminist technologists, indigenous communities, labour organisations, disability advocates, and civil society must be meaningfully involved and empowered . Paullier argued that young people are the most users of AI yet almost never the decision-makers, and that if meaningful spaces are not created, young people will create their own spaces as happened in the climate space . Aerdts noted that when making policy for children and young people, they must be genuinely included in the decision-making process . Dad argued that gender and child rights impact assessments must be conducted before deployment with affected communities participating, not merely documented . Bonyo highlighted that 51% of AI governance conversations happen in Geneva, effectively locking out the rest of the world . The APC representative stated that communities are not the last mile of AI but the first mile . Hicks referenced a survey of 1,000 children in 49 countries who said they want AI to be shaped with them, not just for them .
Women and girls, feminist technologists, indigenous communities, and civil society must be meaningfully involved and empowered in AI governance - Inclusive participation requirement
Young people are the most users of AI and the most frequent innovators within AI firms, yet they are almost never the decision-makers despite living longest with the consequences - Youth excluded from AI decision-making
When making policy for children and young people, they must be genuinely included in the decision-making process alongside parents and educators, not left to face issues too big for parents but too small for police - Genuine youth inclusion in policy
Human rights due diligence and impact assessments must be mandatory before and after AI deployment, not merely aspirational - Mandatory due diligence
51% of AI governance conversations happen in Geneva, meaning the rest of the world is effectively locked out due to visa restrictions, which themselves rely on opaque algorithms - Visa algorithms exclude global voices
Community-centred connectivity is a prerequisite for equitable AI participation; communities are not the last mile but the first mile of AI - Communities as first mile
A survey of 1,000 children in 49 countries found they want AI to be shaped with them, not just for them, and they want it to respect their rights rather than simply being shielded from it - Children want agency in AI governance
Speakers broadly agreed that the global nature of AI requires international cooperation and binding multilateral frameworks. Turk called for regulation guided by human rights as the most obvious solution and noted that OHCHR's advisory service is aimed at helping states govern AI in line with human rights responsibilities . Kownacki welcomed the Council of Europe Framework Convention on AI as the first binding treaty placing AI within the order of human rights, democracy, and the rule of law . Lampel called for enforcing international human rights law today through binding legal frameworks applied equally regardless of wealth or power . Pipan called for strengthening international cooperation through the exchange of good practices, interoperable approaches, and capacity building . Cha stated that the Republic of Korea considers access to AI not as a privilege to be earned but as a basic right to be enjoyed, and described Korea's vision for a Global AI Hub . Bellion-Jourdan argued that leveraging negotiation tools to shift from positional bargaining to integrative negotiation is essential to forge common ground on global AI governance .
The UN system must use international human rights law as a binding compass for AI governance, with OHCHR's advisory service helping states govern AI in line with human rights responsibilities - UN human rights framework as compass
The Council of Europe Framework Convention on AI is the first binding treaty placing AI within the order of human rights, democracy, and the rule of law - First binding AI treaty
The rule of law requires implementing binding legal frameworks equally, regardless of wealth, power, or influence - Binding legal frameworks
International cooperation through the exchange of good practices, interoperable approaches, and capacity building is essential to advance trustworthy AI globally - International cooperation for trustworthy AI
Access to AI should be treated not as a privilege to be earned but as a basic right to be enjoyed, with global AI capacity-building to reduce fragmented readiness - AI access as a right
Uruguay's commitment to gender-responsive AI governance and the Global Partnership for Human Rights represents a multi-stakeholder platform connecting efforts on AI's cross-cutting impacts - Multi-stakeholder human rights platform
Access Now calls for a halt to AI tools facilitating violations of international humanitarian law and human rights law, especially in conflict contexts, alongside binding global governance mechanisms - Halt to IHL-violating AI
Geopolitical competing interests impede global AI governance, and leveraging negotiation tools to shift from positional bargaining to integrative negotiation is essential to forge common ground - Negotiation as governance tool
These speakers share a detailed and evidence-based perspective on the gendered harms of AI, arguing that technology-facilitated gender-based violence is a systemic issue requiring mandatory governance responses. Bahous cited that 44% of assessed AI systems demonstrate gender bias and that up to 99% of online deepfakes target women , while Dad documented over 23,000 cases of technology-facilitated abuse through her organisation's helpline . Eghobamien-Mshelia argued that CEDAW requires states to achieve substantive equality and tackle structural barriers in AI . Smyth stated that AI-amplified disinformation campaigns force women and girls to self-censor and withdraw from online spaces . Brant described Brazil's decree prohibiting synthetic intimate images based on real third parties . All agreed that these harms are not niche safety issues but fundamental human rights violations requiring mandatory governance frameworks. These speakers converge on the view that the evidence base for AI's human rights impacts is critically insufficient and that current evaluation frameworks are misaligned with societal needs. Livingstone noted that the evidence for human rights violations is currently much more compelling than the evidence for human rights benefits in many settings . Ottley argued that there is an evaluation mismatch between engineering metrics and societal questions, and a significant evidence gap regarding how AI affects people's decision-making, children's learning, and clinical decisions . Park called for common and well-designed standards to create a common baseline for AI risk assessment . Dad argued that civil society organisations documenting harms are the earliest sensors of AI-related harm but remain unfunded and precarious, treated as anecdote rather than evidence . These speakers, predominantly from or representing the Global South and civil society, share a structural critique of current AI governance as extractive and exclusionary. Kakkar argued that the concentration of data centres and extraction of minerals predominantly occurs in sites of existing inequality in the global south, and raised fundamental questions of how economic value is accrued far from the communities most impacted . Chetty argued that prevailing governance frameworks extract value from individuals, communities, and nations without reciprocal benefit, input, or control . Shahani called for publicly financed, regionally hosted capacity to evaluate AI systems before deployment and noted that indigenous and traditional knowledge is being absorbed into training data without consent . Bonyo highlighted that 51% of AI governance conversations happen in Geneva, effectively locking out the rest of the world . The APC representative argued that communities are not the last mile of AI but the first mile . These speakers share the view that young people and children must be participants in AI governance rather than passive subjects of protection. Paullier argued that young people are the most users of AI yet almost never the decision-makers, and that meaningful spaces must be created especially at the national level . Aerdts noted that when making policy for children and young people, they must be genuinely included in the decision-making process, and highlighted a gap where young people face issues too big for parents but too small for police . Park argued that children are AI natives who need critical thinking skills and that their voices should flow into governance discussions . Hicks referenced a survey of 1,000 children in 49 countries who said they want AI to be shaped with them, not just for them . Chappaz emphasised that children cannot be taken out of governance discussions . These speakers share concern about AI's role in undermining the information ecosystem and enabling disinformation and hate speech with real-world consequences. Osterling argued that journalism is a keystone species of the information ecosystem and that AI systems are trained on journalistic content scraped without consent, undermining journalism's business models and public trust . Brant called for taking information integrity as part of Article 19 in its collective or social dimension, and noted that AI's impact on the economic sustainability of journalism should be a concern . Smyth argued that AI online content moderation without human oversight can amplify disinformation, disproportionately affecting women and girls . Tan cited concrete examples from Libya and the Rohingya community where AI-generated content incited hostility and abuse . These speakers share a structural critique of AI's physical and environmental footprint as a human rights issue concentrated in already marginalised communities. Luccioni argued that while the benefits of AI can technically be global, the negative impacts in terms of water, energy, emissions, and health are very local and impact the most marginalised populations . Kakkar raised fundamental questions about the concentration of data centres and extraction of minerals predominantly in sites of existing inequality in the global south, and how economic value is accrued far from the communities most impacted . Chetty argued that the planetary and sustainability impacts of AI must be brought into view alongside the development and prosperity of local populations .
It was somewhat unexpected that a representative of a major commercial music corporation (Universal Music Group) and representatives of civil society organisations and environmental researchers converged on transparency as a fundamental requirement. Baruch, representing Universal Music Group, stated that without transparency there can be no accountability, no trust, and no meaningful collaboration, and called for creators to know when and how their works are used to develop AI models . Luccioni, from an environmental research perspective, described transparency as a fundamental human right she has been fighting for, enabling users to make informed choices . Dad, from a digital rights civil society perspective, called for the evidence problem to be addressed by resourcing civil society organisations as early warning systems . Park, representing a major telecommunications company, called for common and well-designed standards for AI risk assessment . Despite representing very different constituencies with often competing interests, all converged on transparency as the foundational requirement for accountability.
It was notable that governments from Spain, Poland, Ireland, South Korea, Slovenia, and the Netherlands - representing different political traditions, regional blocs, and levels of AI development - all explicitly rejected the innovation-versus-regulation framing. López Agueda framed AI governance as a choice between digital rights and oligarchy . Kownacki stated that Poland's answer is not to halt innovation but to keep the human being at the core . Smyth argued that Ireland firmly believes human rights must be at the core of AI governance . Cha stated that South Korea considers access to AI not as a privilege but as a basic right . Pipan argued that trust is not only an ethical objective but a prerequisite for broader AI adoption . Aerdts presented practical Dutch tools as evidence that rights-based governance and effective AI deployment are compatible . This cross-regional governmental consensus on the compatibility of regulation and innovation was stronger than might have been anticipated given ongoing geopolitical tensions around AI governance.
It was unexpected that a representative of Universal Music Group explicitly grounded the music industry's position in international human rights law, citing Article 27 of the Universal Declaration of Human Rights and Article 15 of the ICESCR as protecting creators' moral and material interests in the age of AI . This aligned closely with the positions of human rights advocates such as Bahous, who referenced the same instruments as providing a comprehensive framework to protect rights , and Eghobamien-Mshelia, who argued that CEDAW provides an essential framework for AI governance . Lampel called for enforcing international human rights law today . The convergence of a commercial music industry representative with human rights advocates on the direct applicability of existing international human rights law to AI governance was a notable area of unexpected consensus.
The framing of AI's environmental impact as a human rights issue, rather than merely a technical or sustainability concern, represented an unexpected area of consensus. Turk noted that data centres housing AI servers are choking the environment . Luccioni argued that transparency about AI's energy consumption is a fundamental human right and that the negative environmental impacts are very local, disproportionately affecting the most marginalised populations . Kakkar raised fundamental questions about the concentration of data centres and extraction of minerals in sites of existing inequality in the global south . Lametti explicitly thanked Luccioni for underlining the human rights dimensions of climate and the climate impact of AI . Hicks noted that environmental sustainability was among the top human rights concerns identified in the participant survey . This convergence across a High Commissioner, an environmental scientist, a legal academic, a diplomat, and a session organiser on the human rights framing of AI's environmental impact was notable.
The session revealed a remarkably high level of consensus across a diverse range of speakers — including government ministers, UN officials, civil society representatives, academics, private sector actors, and international organisation representatives — on several foundational principles of AI governance. The strongest areas of agreement were: (1) AI governance must be grounded in binding international human rights law rather than voluntary ethics; (2) regulation and innovation are complementary rather than in tension; (3) meaningful human oversight must be substantive and not nominal; (4) transparency is a fundamental requirement across all dimensions of AI; (5) children require special protection with responsibility resting on developers and deployers; (6) AI amplifies existing inequalities and requires proactive governance responses; (7) agentic AI creates unprecedented accountability challenges; and (8) affected communities must be meaningfully included in governance processes. There was also notable convergence on the need for international cooperation and binding multilateral frameworks, and on the recognition of AI's environmental impact as a human rights issue. Unexpected areas of consensus included the private sector (Universal Music Group) and civil society converging on transparency and the applicability of existing human rights law, and governments from very different political and regional contexts unanimously rejecting the innovation-versus-regulation framing.
Volker Turk argues that regulation guided by human rights is the most obvious solution and questions why it is even up for debate , while Zachary Lampel insists the rule of law requires binding legal frameworks applied equally regardless of wealth or power . Nighat Dad calls for mandatory due diligence obligations . By contrast, Ulises Gutiérrez argues that the rapidly changing landscape means governance cannot be limited to regulation alone and that what is needed is a new social contract at both national and international levels . El Fallah Seghrouchni, while not opposing regulation, emphasises that existing legal mechanisms are insufficient to address the internal and psychological effects of AI, suggesting that new accountability paradigms are needed beyond conventional regulatory approaches .
The most obvious solution, regulation guided by human rights, is right in front of our eyes - UN human rights framework as compass
The rule of law requires implementing binding legal frameworks equally, regardless of wealth, power, or influence - Binding legal frameworks
Human rights due diligence and impact assessments must be mandatory before and after AI deployment, not merely aspirational - Mandatory due diligence
Governing AI requires a new social contract at both national and international levels, not just regulation - New social contract
Agentic AI creates the most significant legal accountability challenge of the decade, as no single human is at the origin of final decisions in networks of autonomous agents - Agentic AI accountability gap
Nighat Dad argues that assessments must be repeated whenever capabilities materially change, including increases in agentic function, and that a one-time assessment at launch is structurally inadequate because harms emerge in deployment, interaction, and iteration . El Fallah Seghrouchni focuses on the need for structured documentation of agent chains and identifiable human responsibility at the point of deployment in public services . Luccioni emphasises that agentic AI makes it harder to identify where failures originate and calls for safeguards and standards at each part of the machine . Kakkar stresses that justice systems will need to identify harms that only emerge after societal-level monitoring, suggesting a reactive as well as proactive approach . These speakers share a concern about lifecycle governance but differ on whether the emphasis should be on pre-deployment mandatory assessment, continuous monitoring, or post-harm remedy.
Human rights due diligence and impact assessments must be mandatory before and after AI deployment, not merely aspirational - Mandatory due diligence
AI systems must be subject to structured documentation of agent chains, appointment of an identifiable responsible human, and a right to timely redress - Three accountability obligations
Agentic AI amplifies degrees of separation between users and underlying technology, making it harder to identify where failures originate - Agentic AI opacity
Justice systems must convert human rights principles into reality by ensuring accountability when AI causes harm, focusing on transparency, traceability, and effective remedy - Justice systems as accountability mechanisms
Livingstone explicitly cautions that the problem will not be solved by restricting children, and emphasises children's rights to expression, participation, education, and information in a digital age . Lametti describes Canada's proposed law that would restrict social platforms to children under 16 until proven safe, and require AI chatbots to be proven safe before exposure to children . Henriques argues that children should interact with AI systems only if proven safe and designed to respect their rights , while Kakkar raises the concern that constant surveillance of children through AI raises fundamental questions about how they grow up as democratic citizens . Park takes a different angle, arguing that since children are already AI natives, the focus should be on education and critical thinking rather than restriction . These speakers agree children need protection but disagree on whether restriction, proof-of-safety requirements, rights-based design, or education is the primary mechanism.
There is a methodological challenge in studying children as a protected category, which partly explains the lack of evidence on AI's impact on children and requires careful navigation - Methodological barriers to child research
Canada's proposed law would require AI chatbots to be proven safe before exposure to children, with a digital commissioner to ensure compliance - Proof-of-safety legislation
Children are not a homogeneous group; indigenous children, girls, children with disabilities, and children of African descent face disproportionate impacts from gaps in AI governance - Intersectionality of child rights
AI and child also raises a fundamental point of surveillance of children - how does a child who is constantly watched and monitored grow up as a contributing member of a democratic society
Today's children are AI natives who need education and critical thinking skills to engage with AI in a balanced way, with their voices flowing into governance discussions - AI literacy for children
Nighat Dad explicitly characterises the uneven application of human rights due diligence across markets as a structural choice, not a capacity gap, noting that companies conduct meaningful assessments primarily where the law requires them to (the EU) and then deploy the same systems in the majority world without equivalent processes . Shahani, by contrast, frames the problem partly as one of capacity, calling for publicly financed, regionally hosted capacity to evaluate AI systems before deployment and open benchmarks built with and for under-resourced languages . Chetty argues that prevailing governance models are structurally inadequate because they are calibrated to high-income countries and disregard sovereignty or agency , aligning more with Dad's structural critique but framing the solution as a normative framework shift rather than enforcement of existing obligations.
Human rights due diligence is applied unevenly across markets, creating a two-tier rights regime determined by geography - Geographic inequality in due diligence
Global majority countries largely import models trained elsewhere and deploy them in high-stakes settings without the means to evaluate them, requiring publicly financed regional evaluation capacity - Regional evaluation capacity
AI governance frameworks must move beyond self-regulatory, ethics-based models to normative frameworks rooted in international human rights law - Beyond voluntary ethics
Ottley highlights a significant evidence gap, noting that while there is abundant evidence about how well AI models perform, there is very little evidence about how AI affects people's decision-making, children's learning, or clinical decisions, and that answering these questions requires longitudinal studies and interdisciplinary collaboration . Livingstone, however, argues that the evidence for human rights violations is currently much more compelling than the evidence for human rights benefits in many settings , and presents abundant documented harms to children . Dad argues that the evidence problem is fundamentally a resourcing problem and that civil society organisations have already documented harms years before they entered global policy conversations, but this documentation is treated as anecdote rather than evidence . El Fallah Seghrouchni raises a different dimension, noting that even AI researchers do not always have the tools to understand the complexity of algorithms, making accountability extremely difficult regardless of evidence availability .
There is a significant evidence gap regarding how AI affects people's decision-making, children's learning, clinical decisions, and public servants' work, requiring longitudinal interdisciplinary studies - Evidence gap in AI impact
Civil society organisations in the majority world are early sensors of AI-related harm but remain unfunded and precarious, requiring resourcing and connection to decision-making - Resourcing civil society evidence
The evidence for human rights violations is currently much more compelling than the evidence for human rights benefits in many settings where AI is being used
Agentic AI creates the most significant legal accountability challenge of the decade, as no single human is at the origin of final decisions in networks of autonomous agents - Agentic AI accountability gap
Shahani explicitly argues that compatibility between national approaches does not require uniformity, and that a common floor of rights safeguards including disclosure, contestability, and remedy can coexist with genuine pluralism above that floor . Lampel, by contrast, insists that the rule of law requires implementing binding legal frameworks equally without regard for wealth, power, or influence, implying a more uniform approach . Kownacki argues that the human factor is the common ground on which truly global governance can be built, suggesting a universal principle rather than a pluralistic framework . Chetty calls for moving beyond aspirational ethics to normative frameworks rooted in international human rights law , which implies a more binding and uniform approach than Shahani's pluralistic model.
A common floor of rights safeguards, including disclosure, contestability, and remedy, must apply to every person affected by AI - Common rights floor
The rule of law requires implementing binding legal frameworks equally, regardless of wealth, power, or influence - Binding legal frameworks
The human factor, keeping a person with the final word to understand, contest, and switch off AI decisions, is the common ground on which truly global AI governance can be built - Human factor as common ground
AI governance frameworks must move beyond self-regulatory, ethics-based models to normative frameworks rooted in international human rights law - Beyond voluntary ethics
This is unexpected because all three speakers are broadly aligned on the need for stronger AI governance, yet they diverge significantly on the state of the evidence base. Ottley, speaking from the Independent Scientific Panel, highlights a significant evidence gap and argues that answering questions about AI's societal impact requires longitudinal studies, interdisciplinary collaborations, and careful work with protected communities . Livingstone, also from the Scientific Panel, takes a starkly different position, stating that the evidence for human rights violations is currently much more compelling than the evidence for human rights benefits . Dad argues that the evidence problem is fundamentally a resourcing problem, and that civil society organisations have already documented harms years before they entered global policy conversations, but this documentation is treated as anecdote rather than evidence . This internal disagreement within and around the Scientific Panel about the adequacy of existing evidence is unexpected given the shared institutional context and could have significant implications for the urgency and form of governance responses.
This is an unexpected disagreement because it cuts across the usual governance versus industry divide. Kakkar explicitly argues that without diffusion of power away from a handful of companies in a few jurisdictions, human rights safeguards cannot be achieved , and Chetty argues that prevailing governance models are structurally inadequate because they are driven by dominant actors . Dad characterises uneven due diligence as a structural choice, not a capacity gap . However, Baruch from Universal Music Group argues that the solution lies in freely and voluntarily negotiated agreements between creators, rights holders, and technology developers , and presents existing partnerships with major technology companies as evidence that innovation and rights protection can advance together . This represents an unexpected disagreement because Baruch's voluntary partnership model is precisely the kind of approach that Kakkar, Dad, and Chetty argue is structurally insufficient to address power imbalances.
This is an unexpected disagreement because it challenges the legitimacy of the very forum in which the dialogue is taking place. Bonyo explicitly calls for algorithmic openness around visa processes, noting that 51% of AI governance conversations happen in Geneva and that the rest of the world is effectively locked out because they cannot access visas . She names a specific absent participant, Freedom Wangi, an AI worker who was unable to get a visa . This implicitly challenges the Co-moderator's procedural commitment to broad participation and López Agueda's call for inclusive global dialogue , by pointing out that the structural conditions of the dialogue itself reproduce the exclusions that the dialogue is meant to address. This meta-level disagreement about the inclusivity of the governance process itself was unexpected in a formal UN dialogue setting.
This is an unexpected disagreement because while Luccioni argues that transparency about AI's environmental footprint is a fundamental human right and dedicates her entire intervention to this issue , Turk mentions data centres choking the environment only briefly as one item in a list of AI harms , and Hicks reports that in the participant survey, environmental sustainability ranked fourth among human rights concerns, behind accountability and rule of law, impact on children, and surveillance . This suggests a significant gap between Luccioni's framing of environmental impact as a core human rights issue and the broader dialogue's treatment of it as a secondary concern. The survey results presented by Hicks implicitly reveal that participants themselves do not prioritise environmental sustainability as highly as Luccioni's argument would suggest they should.
The dialogue reveals a broad consensus on the need for human rights-based AI governance, but significant disagreements on the form, urgency, and scope of governance mechanisms. Key fault lines include: (1) binding regulation versus broader governance frameworks and social contracts; (2) whether existing evidence of harm is sufficient to justify immediate action or whether more rigorous longitudinal evidence is needed; (3) whether geographic unevenness in due diligence is a structural choice or a capacity gap; (4) how to protect children through restriction versus rights-based design versus education; (5) whether universal binding standards or a common floor with pluralism above it is the appropriate model; and (6) whether the environmental impact of AI is a core human rights issue or a secondary concern. There is also an unexpected meta-level disagreement about whether the governance dialogue itself reproduces the exclusions it seeks to address, raised by Bonyo's challenge regarding visa algorithms .
All five speakers agree that AI governance is fundamentally a human rights issue and that gendered harms from AI are serious and systemic. Turk states that AI is fuelling disinformation and enabling bias including from a gender perspective , Bahous documents that 44% of assessed AI systems demonstrate gender bias and up to 99% of deepfakes target women , Dad documents over 23,000 cases of technology-facilitated abuse disproportionately against women , Eghobamien-Mshelia argues CEDAW requires states to achieve substantive equality in AI governance , and Smyth calls for human rights safeguards to prevent technology-facilitated gender-based violence . However, they differ on the specific mechanisms: Bahous emphasises mandatory impact assessments and workforce representation , Dad focuses on uniform due diligence obligations across all markets , Eghobamien-Mshelia emphasises CEDAW's existing framework , and Smyth focuses on content moderation and disinformation .
AI governance must be treated as a fundamental human rights issue, not merely a technical one, with international human rights law providing a binding legal framework - Human rights as binding framework Gender and child rights impact assessments must be mandatory, conducted before deployment with affected communities participating - Mandatory gender impact assessments Technology-facilitated gender-based violence cannot be treated as a niche safety issue; any due diligence framework that does not address it has written half the population out of its protection - TFGBV as systemic issue CEDAW provides an essential framework requiring states to achieve substantive equality and tackle structural barriers in AI governance - CEDAW as AI governance framework AI-amplified disinformation campaigns and hate speech force women and girls to self-censor, undermining their democratic participation - Disinformation and democratic exclusion
All four speakers agree that accountability for agentic AI is a critical and urgent challenge. Arias Arzeno argues that no public institution can justify a decision by saying the system told it to do so , El Fallah Seghrouchni identifies agentic AI accountability as the most significant legal challenge of the decade , Luccioni argues that agentic AI amplifies degrees of separation making it harder to identify where failures originate , and Kakkar highlights the transnational cross-border governance gap as the biggest challenge for justice systems . However, they differ on solutions: El Fallah Seghrouchni proposes structured documentation of agent chains and identifiable human responsibility , Luccioni calls for standards at each part of the machine , Arias Arzeno focuses on keeping responsibility with people and institutions , and Kakkar emphasises the need to shift the burden of proof to companies .
Justice systems must convert human rights principles into reality by ensuring accountability when AI causes harm, focusing on transparency, traceability, and effective remedy - Justice systems as accountability mechanisms AI systems must be subject to structured documentation of agent chains, appointment of an identifiable responsible human, and a right to timely redress - Three accountability obligations Agentic AI amplifies degrees of separation between users and underlying technology, making it harder to identify where failures originate - Agentic AI opacity Justice systems will have to grapple with the biggest question, which is the transnational cross-border governance gap
All four speakers agree that young people and children must be meaningfully included in AI governance rather than merely being subjects of protection. Paullier argues that young people are the most users of AI yet almost never the decision-makers , Aerdts emphasises including young people in decision-making processes alongside parents and educators , Park argues children's voices should flow into governance discussions , and Hicks cites a survey of 1,000 children in 49 countries who said they want AI shaped with them, not just for them . However, they differ on the mechanism: Paullier emphasises national-level participation structures , Aerdts focuses on UNICEF youth panels and parental inclusion , Park focuses on school programmes connected to NGOs , and Hicks references a dedicated survey methodology .
Meaningful spaces for young people to engage in AI governance must be created at the national level, not only globally, as young people best understand both opportunities and harms - National youth participation When making policy for children and young people, they must be genuinely included in the decision-making process alongside parents and educators, not left to face issues too big for parents but too small for police - Genuine youth inclusion in policy Today's children are AI natives who need education and critical thinking skills to engage with AI in a balanced way, with their voices flowing into governance discussions - AI literacy for children A survey of 1,000 children in 49 countries found they want AI to be shaped with them, not just for them, and they want it to respect their rights rather than simply being shielded from it - Children want agency in AI governance
All four speakers agree that the negative impacts of AI infrastructure are concentrated in the global south and among marginalised communities, while benefits accrue elsewhere. Luccioni argues that while AI benefits can be global, negative environmental impacts are very local and disproportionately affect marginalised populations , Kakkar notes that data centres and mineral extraction are concentrated in sites of existing inequality in the global south , Chetty argues that prevailing governance models extract value from individuals, communities, and nations without reciprocal benefit , and the APC representative argues that communities need to own and govern their own connectivity infrastructure . However, they differ on solutions: Luccioni focuses on energy transparency and labelling , Kakkar focuses on shifting from individual to group rights , Chetty proposes the Just AI normative framework , and the APC representative focuses on community-centred connectivity infrastructure .
Data centres make the negative impacts of AI very local in terms of water, energy, emissions, and health, disproportionately affecting the most marginalised populations - Local environmental harms We also see a concentration of data centres and extraction of minerals, predominantly in sites where there is already a lot of inequality in the global south The separation of data governance and AI governance in international forums obscures the foundational data justice that must inform all AI systems - Data justice inseparable from AI governance Community-centred connectivity is a prerequisite for equitable AI participation; communities are not the last mile but the first mile of AI - Communities as first mile
All four speakers agree that AI-generated disinformation and the erosion of the information ecosystem pose serious human rights risks. Osterling argues that journalism is a keystone species of the information ecosystem and that AI systems are trained on journalistic content scraped without consent , Brant calls for information integrity as a collective right encompassing the need for consistent, accurate, and reliable information , Smyth argues that AI content moderation without human oversight amplifies disinformation disproportionately affecting women and girls , and Tan presents concrete examples of AI-generated hate speech creating protection risks for refugees in Libya and the Rohingya . However, they differ on the primary focus: Osterling emphasises the economic sustainability of journalism and public digital infrastructure , Brant focuses on platform liability and shared responsibility , Smyth focuses on the gendered dimension , and Tan focuses on the protection risks for displaced and stateless people .
Journalism is a keystone species of the information ecosystem; AI systems are trained on journalistic content scraped without consent or compensation, undermining journalism's business models - Journalism as critical infrastructure Information integrity must be understood in its collective or social dimension as part of the right to access accurate and reliable information, and AI's impact on journalism's economic sustainability must be addressed - Information integrity as collective right AI tools used for online content moderation without human oversight can amplify disinformation, disproportionately affecting women and girls - Automated moderation amplifies disinformation AI-generated disinformation and online hate speech have created direct protection risks for refugees and displaced people, as seen in Libya and among the Rohingya - AI hate speech as protection risk
- AI governance must be grounded in international human rights law as a binding legal framework, not merely aspirational ethics or voluntary self-regulation, with regulation viewed as a prerequisite for public trust rather than an obstacle to innovation.
- Human rights due diligence and impact assessments must be mandatory across the full AI lifecycle — from design through deployment and monitoring — and must apply uniformly across all markets and geographies, not only where regulation compels it.
- Agentic AI represents the most significant legal accountability challenge of the decade, as networks of autonomous agents make it extremely difficult to identify which node caused harm and who bears responsibility, requiring new accountability paradigms including structured documentation of agent chains and appointment of identifiable responsible humans.
- AI is disproportionately harming women and girls through algorithmic bias, deepfakes, technology-facilitated gender-based violence, and exclusion from AI governance; 44% of assessed AI systems demonstrate gender bias, up to 99% of online deepfakes target women, and only 24 of 138 countries reference gender in their national AI strategies.
- Children's rights must be a cross-cutting consideration in all AI governance frameworks, with safety built into systems from the start; evidence shows exponentially rising AI-generated child sexual abuse material, consistent failures of AI companion products to meet basic safety standards, and up to one child per classroom in 11 global south countries reporting AI-generated sexual deepfakes of themselves.
- Power over AI is dangerously concentrated in a handful of companies and a few countries, deepening global inequalities; global majority countries largely import models trained elsewhere and deploy them in high-stakes settings without the means to evaluate them, while civil society organisations in the majority world that document AI harms remain chronically underfunded.
- The negative environmental impacts of AI — including water and energy consumption, emissions, and health harms from data centres — are highly localised and disproportionately affect the most marginalised populations, yet transparency about these impacts remains severely lacking even for international organisations.
- There is a critical evaluation mismatch between engineering metrics (speed, accuracy, capability) and the societal questions AI governance must answer (whether human rights are protected, institutions remain accountable, and society is better off); society must define what success looks like and science must measure it.
- Young people are the most users of AI and will live longest with the consequences of decisions made today, yet they are almost never included as decision-makers; meaningful youth participation must be created at the national level, not only in global forums.
- AI is threatening the information ecosystem by fuelling disinformation, undermining journalism's business models through unconsented scraping of journalistic content, and enabling AI-generated hate speech that creates direct protection risks for refugees and displaced people.
- Visa and border management algorithms already embody human rights concerns, with opaque algorithmic processes restricting who can participate in AI governance discussions; 51% of AI governance conversations occur in Geneva while the rest of the world is effectively excluded.
- The freedom of thought, long encompassed within freedom of expression, must be reinterpreted in the context of AI threatening cognitive autonomy through micro-targeting, manipulation, and psychological profiling, including of children.
“Before a new drug reaches the market, it undergoes years of clinical trials, regulatory changes, review and market authorization. And this process can last between 10 and 15 years. Many drugs fail due to lack of effectiveness or safety concerns. And even with all these safeguards, mistakes can still happen. Are we taking the same care with artificial intelligence?”
“It reminds me of the protagonist K in Franz Kafka's book, The Castle. K arrives in a new village as a land surveyor and spends the rest of the novel trying to understand a system that remains inaccessible and unaccountable. Are we like K, trapped in a system of opaque power in which we are losing our agency? AI is about power over data, markets, resources and information, but to what end?”
“The unofficial slogan of the tech and AI industry is bigger, faster, better. I would rather advocate for smarter, kinder, wiser.”
“The concept of something exogenous compared to something endogenous... When you use algorithms that manipulate a child's psychology, that's not something you can measure. That's not something that you can even perceive. Therefore, the internal nature of the child's psychology and the internal nature of the effects of AI create significant issues at the level of the rights and the legal mechanisms that we have at our disposal. How can we audit our neurons? How can we understand that our brains have been transformed?”
“Accountability in agentic systems is probably the most significant legal challenge this decade because we have a network of AI agents that are autonomous individually and there's no human that is at the origin of the final decision. So when we want to make an agentic network accountable, we don't know which of the agents is accountable and we don't know how to distribute this accountability amongst the different agents.”
“The evidence for the violations is currently much more compelling than the evidence for human rights benefits in many settings where AI is being used... We identified also the opportunity costs, the failure to realise the AI benefits is also a risk to human rights.”
“Across 11 global south countries, up to one child per classroom reported that AI was used to make sexually explicit deep fakes of them. Reports of AI-generated child sexual abuse material to the US cyber tip line NCMEC are rising exponentially. Child sexual abuse material is documented in some training sets and offenders can now fine-tune open models on child sexual exploitation.”
“Human rights due diligence, as most AI companies practice it today, does not really meet the standard of UN guiding principles on business and human rights. It happens after co-design decisions are made. It happens where regulation compels it. And it happens without the participation of the people actually affected. What we have in most cases is not due diligence. It's really documentation... Companies conduct meaningful assessments where the law requires them to do, primarily in the EU. Then they deploy the same system in the majority world with really no equivalent process. And I would say this is a structural choice, not a capacity gap.”
“Society has to decide what success looks like, and science has to determine how to measure it. And together, we have to build the evidence that tells us whether we're actually achieving it. So have we agreed on what success looks like?”
“The evidence problem is a resourcing problem. Civil society organisations or digitalised organisations in the majority world are the earlier sensors of AI-related harm. We have documented synthetic intimate imagery targeting women years before it entered global policy conversations. But this documentation is unfunded, precarious, and treated as anecdote rather than evidence. If this dialogue wants an early warning system for AI harms, it already exists. It needs to be resourced and connected to decision-making.”
“When we decide what an algorithm may do to a human being, we decide what we believe a person is worth... Some choices a machine must never make on its own. Poland knows. It knows from its own history what it costs when people lose control over the systems that decide their fate.”
“51% of AI governance conversations this year happen in Geneva. And that means that the rest of the world were ideally locked out because they could not access visas to this place. So I want to ask us to reconsider what that means... I want to ask the global north to reconsider the kind of algorithms that we outsource to determine whether people travel here or not.”
How can we audit the effects of AI on human cognition and psychology, particularly for children?
The Minister raised the concept of cognitive rights and the difficulty of measuring psychological manipulation by algorithms. She noted that even AI researchers lack tools to fully understand the complexity of these systems, making it critical to develop methods for assessing internal cognitive impacts of AI, especially on children.
How should accountability be distributed across networks of autonomous AI agents when no single human is at the origin of a final decision?
Multiple speakers highlighted that agentic AI systems create a new and unresolved legal challenge: when a network of agents each contribute incrementally to a harmful outcome, it is unclear which agent or human principal bears responsibility. This requires a new accountability paradigm, including structured documentation of agent chains and identifiable human oversight.
What longitudinal studies and interdisciplinary research are needed to understand how AI is actually affecting children's learning, mental health, and development?
Both panellists noted a significant evidence gap: while there is abundant data on AI model performance, there is very little rigorous evidence on how AI affects children's education, emotional well-being, and cognitive development. Longitudinal studies and partnerships with protected communities are needed.
How can human rights due diligence be made mandatory and uniform across all markets where an AI system is deployed, not just in jurisdictions with strong regulation?
The founder of Digital Rights Foundation highlighted a structural two-tier rights regime where meaningful human rights assessments are conducted in the EU but not in the Global South. Further research and policy development is needed to establish uniform due diligence obligations regardless of geography.
How do we define and measure 'success' for AI systems in terms of human rights, accountability, and societal well-being, rather than purely technical benchmarks?
The scientific panellist argued that society and science are asking fundamentally different questions about AI. Society needs to agree on what success looks like in human rights terms, and science must then develop the tools to measure it. Without this alignment, governance frameworks risk optimising for the wrong outcomes.
How can cognitive rights be legally defined and protected in the context of AI systems that manipulate psychological states?
Referencing Chile's early legislative attempt to introduce cognitive rights, the Minister raised the need for international frameworks that protect individuals from algorithmic psychological manipulation. This remains an underexplored area of law requiring further research and normative development.
What mechanisms can ensure that children are meaningfully included in AI governance decision-making processes?
Multiple speakers noted that children are among the most frequent users of AI yet are largely absent from governance discussions. Further work is needed to design inclusive participation mechanisms that allow children's voices to genuinely shape AI policy, not merely be consulted after decisions are made.
How can the environmental and human rights impacts of AI data centres be made transparent and measurable, particularly for marginalised communities near those facilities?
The Sustainable AI Group co-founder noted that even international bodies like the IEA struggle to obtain energy and emissions data from member countries. Research is needed into standardised transparency and reporting mechanisms for the environmental footprint of AI, with particular attention to health impacts on local and marginalised populations.
How can justice systems be equipped with the technical capacity, expertise, and cross-border enforcement tools needed to hold AI actors accountable?
Both speakers identified significant gaps in judicial capacity to handle AI-related harms, including the difficulty of gathering evidence, the transnational nature of AI supply chains, and the concentration of power in a handful of companies. Further research is needed into how courts can access information, shift burdens of proof, and enforce decisions across jurisdictions.
How can gender-responsive indicators and monitoring systems be developed to measure whether women are participating in and benefiting equally from AI, and are protected from AI-facilitated harms?
Both speakers noted that gender equality remains largely invisible in AI governance frameworks, with only a small minority of national AI strategies including substantive gender-responsive provisions. Developing robust measurement tools and indicators is essential to ensure accountability under frameworks such as CEDAW.
What are the implications of AI-powered algorithmic management for gig workers, particularly in the Global South, and how can existing labour protections be extended to them?
The Lawyers Hub founder highlighted gig workers managed by algorithms in Kenya, while the Tech Global Institute speaker noted that data and platform workers, disproportionately women, lack labour protections. Further research is needed into how algorithmic management affects workers' rights and how cross-border labour protections can be enforced.
How can the separation between data governance and AI governance in international forums be addressed, given that data justice is foundational to equitable AI?
The Research ICT Africa executive director argued that treating data governance and AI governance as separate issues obscures the foundational injustices embedded in AI systems. Further research and policy work is needed to integrate these frameworks, particularly to protect the data sovereignty of Global South nations.
How can visa and border management algorithms be made transparent and subject to human rights scrutiny, given that they already determine who can participate in global AI governance discussions?
The co-chair noted that 51% of AI governance conversations happen in Geneva, yet many affected stakeholders cannot attend due to visa denials that may themselves be algorithmically influenced. This raises urgent questions about transparency and accountability in the very systems that gatekeep participation in governance.
How can indigenous and traditional knowledge be protected from being absorbed into AI training data without consent, recognition, or return to communities?
The Tech Global Institute speaker raised the issue of community-led data stewardship as a form of human oversight, noting that indigenous knowledge is being extracted without consent. Further research is needed into legal and technical mechanisms to protect such knowledge and ensure communities benefit from its use.
What public digital infrastructure, including cloud services and journalistic stacks, is needed to prevent AI governance and information ecosystems from being controlled by a handful of hyperscalers?
The Global Forum for Media Development representative argued that journalism is a keystone species of the information ecosystem and that AI systems trained on journalistic content without consent or compensation undermine democratic accountability. Further research is needed into public interest AI infrastructure and industrial policies that support media sustainability.
How can AI systems used in asylum, border management, and refugee contexts be made explainable and contestable for people who may not know how decisions affecting them were reached?
The UNHCR Director General highlighted that forcibly displaced and stateless people face compounded barriers to challenging AI-assisted decisions in high-stakes contexts such as asylum procedures. Research is needed into accessible explanation and redress mechanisms that function in humanitarian settings.
How can the mental health toll on AI data labellers and content moderators, particularly in the Global South, be documented, addressed, and incorporated into AI governance frameworks?
The co-chair referenced the Africa AI Governance Index and the documented mental health impacts on workers who train AI models. This remains an underresearched area requiring both empirical investigation and policy responses that extend human rights protections across the full AI value chain.
How can multilateral negotiation processes be redesigned to move from positional bargaining to integrative negotiation in order to forge common ground on global AI governance?
The Institute for Global Negotiation senior fellow argued that geopolitical competition is a major impediment to global AI governance and that innovative negotiation formats are needed to reconcile competing interests. Further research into process design and negotiation methodologies is needed to make global AI governance achievable.
How can AI energy efficiency labelling and standardised environmental impact disclosures be developed and mandated to enable informed choices by users, organisations, and governments?
The Sustainable AI Group co-founder described her AI Energy Score Project as a stepping stone towards transparency, but noted that operationalising such standards faces significant pushback. Further research and policy work is needed to develop universally applicable, comparable metrics for the environmental cost of AI systems.
How can the evidence gathered by civil society organisations in the Global South about AI-related harms be resourced, formalised, and connected to scientific and policy decision-making processes?
The Digital Rights Foundation founder argued that civil society organisations are early sensors of AI harm but their documentation is unfunded and treated as anecdote rather than evidence. Research is needed into how to institutionalise and resource this knowledge so it can inform scientific consensus and policy in a timely manner.
What are the methodological challenges of studying the impact of AI on children as a protected research category, and how can these be navigated without weakening ethical safeguards?
The scientific panellist noted that children are a protected category in research ethics, which limits the studies that can be conducted and contributes to the evidence gap on AI's impact on children. Further work is needed to develop ethical methodologies that allow rigorous research while maintaining appropriate protections.
How can AI governance frameworks be designed to address the concentration of power in a handful of companies and jurisdictions, and to enable Global South nations to become co-creators rather than passive consumers of AI?
Multiple speakers identified the concentration of AI development in a few companies and countries as a structural barrier to equitable governance. Research is needed into public interest alternatives, regional AI capacity building, and governance models that diffuse power and enable meaningful participation by Global South actors.
How can AI governance ensure that community-centred connectivity, particularly for indigenous, rural, and underrepresented language communities, is treated as a prerequisite for equitable AI participation rather than an afterthought?
The Association for Progressive Communications representative argued that meaningful AI governance requires communities to own and manage their own connectivity infrastructure. Further research is needed into how community-led digital infrastructure can be integrated into AI governance frameworks as a foundational human rights requirement.