Thematic discussion 4: Respecting, protecting and promoting human rights - Global Dialogue on Artificial Intelligence Governance - Day 2
This discussion, convened by OHCHR and the World Bank as part of a UN Global Dialogue on AI Governance, focused on the intersection of artificial intelligence, human rights, transparency, accountability, and human oversight. High Commissioner Volker Türk opened by drawing a parallel between AI deployment and pharmaceutical regulation, questioning whether sufficient care is being taken with AI , and warning that AI is already fuelling mass surveillance, disinformation, and gender-based bias . He argued that human rights law provides a binding framework for governing AI and that regulation should not be seen as an obstacle to innovation, but rather as the foundation of public trust .
Panellists on the first panel highlighted the gendered dimensions of AI harm, with Sima Bahous noting that 44% of assessed AI systems demonstrate gender bias and that up to 99% of online deepfakes target women . Samuel Arias Arzeno emphasised that justice systems must be strengthened to translate human rights principles into effective remedies , while Amal El Fallah Seghrouchni raised the particular challenge of accountability in agentic AI systems with billions of parameters, where causal responsibility is extremely difficult to trace . Sonia Livingstone presented scientific panel evidence of mounting human rights violations, including AI-generated child sexual abuse material rising exponentially. .
The second panel examined practical solutions and the inclusion of marginalised voices. Nighat Dad argued that human rights due diligence is applied unevenly across markets, with meaningful assessments conducted primarily where EU law requires them, creating a two-tier rights regime determined by geography . Alvitta Ottley identified an "evaluation mismatch," noting that engineering metrics such as speed and accuracy do not align with societal questions about whether human rights are protected . Felipe Paullier stressed that young people are the most active AI users yet almost never the decision-makers, and called for their meaningful inclusion in national AI governance frameworks .
Audience interventions from governments and civil society reinforced these themes. Brazil described its Digital Statute for Children and Adolescents requiring child protection measures from the design phase , while Poland and the Republic of Korea highlighted the need for human-centric national AI strategies and binding legal frameworks . Civil society speakers, including representatives from AccessNow, ICNL, and the Digital Rights Foundation, called for AI red lines, mandatory human rights impact assessments, and the resourcing of civil society organisations in the Global South as early-warning systems for AI-related harm .
The discussion concluded with broad consensus that AI governance must embed human rights from the design stage, ensure accountability across the full AI lifecycle, and meaningfully include children, women, and Global South communities - not merely as subjects of protection, but as active participants in shaping the technology that increasingly governs their lives .
Overall Purpose
- The discussion is a UN-convened global dialogue on AI governance, co-led by OHCHR and the World Bank, bringing together governments, international organisations, civil society, and technical experts to examine how artificial intelligence can be developed, deployed, and regulated in a manner consistent with international human rights law. The session aims to identify concrete governance frameworks, accountability mechanisms, and safeguards - particularly for vulnerable groups such as women, children, and Global South communities - and to build momentum for binding, human rights-centred AI regulation.
- --
Major Discussion Points
- The urgent need for human rights-based AI regulation, drawing parallels to other regulated industries. Multiple speakers argued that AI must be subject to the same rigorous oversight applied to medicines, vehicles, and aircraft. The High Commissioner for Human Rights, Volker Türk, opened by asking whether society is taking the same care with AI as it does with new drugs, which undergo 10-15 years of clinical trials before market authorisation . He warned that AI is being deployed "at warp speed" and is already fuelling mass surveillance, disinformation, and gender bias . He argued that regulation guided by human rights is "the most obvious solution" and that framing it as a trade-off with innovation is a false choice . This theme was echoed by Sima Bahous of UN Women , IDLO representative Mark Cassayre , and Ireland's Minister Niamh Smyth .
- Gendered harms caused by AI, and the accountability gaps that allow them to persist. Speakers presented extensive evidence that AI disproportionately harms women, girls, and marginalised communities. UN Women research found that 44% of assessed AI systems demonstrate gender bias, and that almost one in four women human rights defenders surveyed had experienced AI-assisted online violence . Up to 99% of online deepfakes and manipulated sexual imagery target women . Nighat Dad of the Digital Rights Foundation highlighted that human rights due diligence is applied unevenly across markets - meaningful assessments occur where law requires them (primarily in the EU), while the same systems are deployed in the Global South without equivalent scrutiny . She called for mandatory gender and child rights impact assessments conducted before deployment, with affected communities participating . Esther Eghobamien-Mshelia of the CEDAW Committee reinforced that CEDAW provides an essential framework requiring states to achieve substantive equality and tackle structural barriers reinforced by AI .
- The specific vulnerability of children in AI-mediated environments and the inadequacy of current protections. Children's rights emerged as a cross-cutting concern throughout the session. Sonia Livingstone of the Independent Scientific Panel reported that across 11 Global South countries, up to one child per classroom reported that AI was used to make sexually explicit deepfakes of them, and that reports of AI-generated child sexual abuse material are rising exponentially . Stanford risk assessments of AI companions found these products fail to meet basic safety standards . Jhalak M. Kakkar stressed that AI systems must be designed with children's safety built in from the outset, not retrofitted after harm has occurred , and raised the concern of how constant surveillance shapes children's development as democratic citizens . Isabella Henriques, speaking on behalf of over 120 signatories of a joint civil society statement, called for children's rights to be a cross-cutting consideration across all AI governance frameworks .
- Accountability gaps in agentic AI systems and the challenge of attributing responsibility across complex, multi-agent chains. Several panellists identified agentic AI - systems in which networks of autonomous agents act without direct human instruction - as the most significant emerging legal and governance challenge. Amal El Fallah Seghrouchni of Morocco described the core problem: when a network of AI agents produces a harmful outcome, it is unclear which agent is accountable and how responsibility should be distributed . She proposed three obligations: structured documentation of agent chains, appointment of an identifiable human responsible for rights-related issues, and a right to redress in good time . Sasha Luccioni warned that agentic AI amplifies degrees of separation between users and underlying technology, making it harder to identify where failures originate . The audience survey results, reported by Peggy Hicks, showed that respondents overwhelmingly held AI-developing companies primarily responsible, followed by states and then deploying organisations .
- Global power asymmetries in AI governance, including the exclusion of the Global South, civil society, and marginalised communities from decision-making. Multiple speakers challenged the concentration of AI power in a handful of companies and countries. Kakkar argued that without diffusing this concentration of power, human rights - especially for people in the Global South - cannot be safeguarded . Research ICT Africa's Pria Chetty proposed a "Just AI" framework, arguing that prevailing ethical AI models are self-regulatory, calibrated to high-income countries, and deepen existing inequalities . Linda Bonyo, in her closing remarks, highlighted that 51% of AI governance conversations happen in Geneva, yet many voices from the rest of the world are excluded because they cannot obtain visas - itself a process shaped by opaque algorithms . The Association for Progressive Communications emphasised that communities are "the first mile, not the last mile" of AI and must be central in AI governance .
- --
Overall Tone
- The overall tone of the discussion is one of urgent concern tempered by cautious determination. From the outset, speakers conveyed a sense of alarm - Volker Türk's opening remarks were sombre and morally charged, invoking Kafka's The Castle as a metaphor for opaque, unaccountable AI systems and warning that society risks repeating the failures of climate governance by allowing powerful interests to delay action . This gravity persisted throughout the first panel, where panellists presented mounting empirical evidence of harms to women, children, and marginalised communities.
- However, the tone shifted incrementally towards constructive problem-solving in the second panel and audience interventions. Ministers from the Netherlands, Spain, Ireland, Korea, and Poland shared concrete national measures - algorithm registers, AI Acts, child protection laws - signalling that governance is not merely aspirational . Civil society speakers, while critical, offered specific recommendations rather than simply cataloguing harms.
- By the closing remarks, the tone had become one of collective resolve, with co-chair Oscar López Águeda acknowledging that "we are late" but affirming that the direction of travel - towards humanistic, rights-respecting AI - is clear and non-negotiable . Throughout, an undercurrent of frustration was evident, particularly from Global South representatives who noted structural exclusions from the very dialogue meant to address them .
Expanded Summary: UN Global Dialogue on AI Governance - Thematic Cluster on Human Rights, Transparency, Accountability, and Human Oversight
#
Opening and Context
The session was convened as part of the UN Global Dialogue on AI Governance, co-led by the Office of the High Commissioner for Human Rights (OHCHR) and the World Bank, under the thematic leadership of co-chairs Linda Bonyo, founder and CEO of the Lawyers Hub Africa, and His Excellency Óscar López Águeda, Spain's Minister for Digital Transformation and Civil Service . Peggy Hicks, Director of the Thematic and Special Procedures Division at OHCHR, opened proceedings by welcoming participants to a session focused on respecting, protecting, and promoting human rights, transparency, accountability, and human oversight in the context of artificial intelligence . The dialogue operated under the leadership of Ambassador Egriselda López of El Salvador and Ambassador Rein Tammsaar of Estonia, and was described as a remarkable achievement of how the UN system is meeting today's moment .
#
High Commissioner's Opening Remarks
UN High Commissioner for Human Rights Volker Türk opened with a striking analogy: before a new drug reaches the market, it undergoes between ten and fifteen years of clinical trials, regulatory review, and market authorisation, and even with all these safeguards, mistakes can still happen . He asked directly whether society is taking the same care with artificial intelligence . His answer was sobering: AI is already being developed and deployed at warp speed, fuelling mass surveillance, disinformation on social media, and enabling bias including from a gender perspective, while harm to children from AI-powered algorithms is growing and data centres housing AI servers are choking the environment . At the same time, he acknowledged AI's remarkable potential to support medical diagnosis, accelerate scientific research, and strengthen public services .
Türk argued that the most obvious solution - regulation guided by human rights - is right in front of our eyes, yet society keeps skirting around it . He drew a parallel with climate change, warning that precious years were lost because powerful players cast doubt on science, delayed action, and prioritised short-term economic and political interests, and that the same dynamic risks repeating itself with AI . Invoking Franz Kafka's novel The Castle, he asked whether society is like the protagonist K - a land surveyor trapped in a system of opaque power in which human agency is being lost - and argued that AI is fundamentally about power over data, markets, resources, and information . His response to this challenge was clear: human rights help reclaim agency and provide a check on the exercise of power, and guardrails on AI development are needed to ensure transparency, inclusion, and accountability . He also invoked Lord Acton's dictum that "power tends to corrupt and absolute power corrupts absolutely" to frame the necessity of keeping AI power in check .
On the question of regulation, Türk explicitly rejected the framing that it constitutes a trade-off with innovation, arguing that safety standards for medicines, cars, and aircraft are not considered obstacles to progress but are the very reason people trust those technologies . He called for human rights to be embedded into the design, development, deployment, and use of AI, noting that international human rights law constitutes a binding legal framework to protect data, avoid discrimination, access justice, and ensure equality . He stressed that human rights due diligence and impact assessments of AI systems are essential, as are robust data protection and privacy safeguards . He also warned that when AI gathers data or carries out a decision without human agency, responsibility can disappear into the system, and that human oversight cannot be just a rubber stamp but requires that an identified person be granted authority, competence, time, independence, and power to alter and even stop a system .
He announced that the following day his office would launch the Human Rights Data Exchange (HRDX), described as the world's first open, authoritative service with evidence of where rights are under threat, what happened, why, and what to do about it . He also referenced OHCHR's human rights advisory service, established under the Global Digital Compact, aimed at helping states and others govern AI in line with their human rights responsibilities . He closed by contrasting the tech industry's unofficial slogan of "bigger, faster, better" with his own preferred alternative: "smarter, kinder, wiser" .
#
Thematic Co-Chairs' Opening Remarks
Linda Bonyo contextualised the discussion from an African perspective, speaking for gig workers managed by algorithms in Kenya and acknowledging the asymmetry of power and the voices of younger generations not present in the room . She highlighted the launch of the Africa AI Governance Index, which for the first time tracks AI strategies, laws, and institutions across all African states, and invited participants to engage with the work at AIpolicy.africa .
Minister López Águeda, speaking in Spanish, framed AI governance as a choice between digital rights and oligarchy, warning that without inclusive governance the Global South will serve merely as a battery or data provider for greater powers . He outlined Spain's concrete legislative achievements, including the EU AI Act signed during Spain's EU presidency, the prohibition of sexual deepfakes and child pornography within EU legislation, the establishment of Europe's first AI supervision agency, and a child protection law restricting under-16s from digital networks . He also referenced the Ibero-American digital rights charter as an initiative Spain has been driving forward .
#
First Panel: Human Rights, Accountability, and Justice
The first panel was moderated by Ambassador David Lametti, Permanent Representative of Canada to the UN and former Minister of Justice, who framed the discussion around the role of justice systems in delivering accountability and upholding human rights for people affected by AI, including children . He noted that civil liability is a principle that exists in most justice systems and is focused on human responsibility, but that the challenge for AI is being subject to human judgement and intelligence when it is a machine making the decision . He described Canada's proposed law that would restrict social platforms to children under 16 until proven safe, and require AI chatbots to be proven safe before exposure to children, with a digital commissioner to ensure compliance .
Sima Bahous, Executive Director of UN Women, argued that left unregulated, AI becomes not only a mirror of existing inequalities but a powerful mechanism for amplifying discrimination, exclusion, and violence against women and girls . She presented extensive evidence: 44% of assessed AI systems demonstrate gender bias because they are trained on data that already reflects existing biases ; almost one in four women human rights defenders, activists, and journalists surveyed had experienced AI-assisted online violence ; and up to 99% of online deepfakes and manipulated sexual imagery target women . She noted that 41% of women respondents self-censor on social media to avoid abuse, pushing women and girls out of online spaces and threatening democratic participation . Drawing on the previous day's independent scientific panel report, she noted that 88% of leading AI researchers are male and that women make up only 30% of the AI workforce globally . She further noted that of the 138 countries assessed, only 24 reference gender in their national AI strategies, and just 18 include substantive gender-responsive provisions . She argued that states remain the primary duty bearers under international human rights law, including the Universal Declaration, the ICCPR, and CEDAW, and that technology companies cannot hide behind the complexity of their systems . She called for mandatory human rights impact assessments before and after deployment, with gender equality treated as non-negotiable, and for women and girls, feminist technologists, indigenous communities, labour organisations, disability advocates, and civil society to be meaningfully involved and empowered . She framed her accountability questions - who builds AI, who benefits, who bears the risks, and who has a voice - as building blocks for accountability .
Amal El Fallah Seghrouchni, Minister Delegate from Morocco, introduced a conceptually original distinction between exogenous harms - which are external to human beings and can be observed and measured - and endogenous harms, which occur within the human mind and are imperceptible even to those experiencing them . She argued that when algorithms manipulate a child's psychology, that is not something that can be measured or even perceived, and asked how society can audit its own neurons or understand that human brains have been transformed . She referenced Chile's early legislative attempt to introduce cognitive rights as a visionary response to this challenge . She also noted that even AI researchers do not always have the tools to understand the complexity of algorithms, and that large language models with between 175 billion and 180 billion parameters make accountability extremely difficult to trace .
In her second intervention, El Fallah Seghrouchni identified accountability in agentic AI systems as probably the most significant legal challenge of the decade, noting that in a network of individually autonomous agents there is no human at the origin of the final decision, making it unclear which agent is accountable and how responsibility should be distributed . She illustrated the scale of the challenge with a concrete example from Morocco's Iderati X.0 platform, which processes 52 million administrative transactions daily, noting that at such scale it becomes extremely difficult to identify the exact cause when a problem arises . She proposed three concrete obligations: structured documentation of agent chains specifying which agent does what and when; appointment of an identifiable human being in charge for all issues tied to rights when agents are deployed in public services; and a right to timely redress so that humans can receive remedy in line with the speed of AI systems .
Samuel Arias Arzeno, Judge of the First Chamber of the Supreme Court of Justice of the Dominican Republic, argued that the true challenge of governance does not happen when laws or ethical principles are adopted, but when a person considers that an AI system has violated their human rights - it is at this moment that governance becomes a reality . He argued that justice systems should be seen not merely as users of AI but as essential institutions for converting human rights principles into true human rights, and that no public institution can justify a decision by saying that is what the system told it to do . He noted that through the Justice Action Coalition, governments, civil organisations, international organisations, and justice systems are working together to ensure that AI governance is not only restricted to the designing of public policies but can be made effective through justice systems based upon people, and that the Dominican Republic co-chairs with the World Bank the work on emerging technologies and AI in the area of justice . He proposed four priorities: strengthening institutional capacities of lawyers and jurors; ensuring transparency and traceability in the use of AI; maintaining effective human oversight; and ensuring that all people have effective mechanisms to access justice and repair harm .
Sonia Livingstone, member of the Independent International Scientific Panel on AI, reported that the panel found the evidence for human rights violations to be currently much more compelling than the evidence for human rights benefits in many settings where AI is being used . The panel documented threats to the information ecosystem through AI-generated persuasion and deceit, disinformation, and distrust, with adverse impacts on collective health, democratic participation, and election integrity . It also documented threats to privacy and safety as personal data is taken, manipulated, abused, and exploited, and evidence of harms in terms of inequality and injustice as AI power is concentrated in very few companies, countries, and languages . The panel identified four categories of risk: direct risks; risks arising from hugely uneven global capacity; opportunity costs from failure to realise AI benefits; and risks from deployment without rights-based safeguards .
On children specifically, Livingstone presented alarming data: across 11 Global South countries, up to one child per classroom reported that AI was used to make sexually explicit deepfakes of them; reports of AI-generated child sexual abuse material to the US cyber tip line NCMEC are rising exponentially; child sexual abuse material is documented in some training sets; and offenders can now fine-tune open models on child sexual exploitation . A national US survey found one in three children had discussed important emotional matters with an AI companion, yet Stanford's risk assessment of AI companions found these products fail to meet basic safety standards . She referred participants to calls by Mr. Kateris for nations to adopt an AI child safety pledge . She cautioned that the problem will not be solved by restricting children, and emphasised children's rights to expression, participation, education, and information in a digital age .
Sasha Luccioni, co-founder and chief scientific officer of the Sustainable AI Group, argued that transparency about AI's environmental footprint is a fundamental human right, enabling users to make informed choices between tools . She noted that while the benefits of AI can technically be global, the negative impacts in terms of water, energy, emissions, and health are very local and disproportionately affect the most marginalised populations . She described the difficulty of obtaining transparency even for international organisations such as the IEA, which struggle to get information because member countries themselves do not have it . She presented her AI Energy Score Project - energy efficiency labels for AI models - as a stepping stone to informed decision-making and eventual regulation . In her second intervention, she warned that agentic AI amplifies the degrees of separation between a user and the underlying technology, making it harder and harder to identify where failures originate .
Jhalak M. Kakkar, Executive Director of the Centre for Communication Governance at the National Law University of Delhi, argued that existing human rights frameworks - including the right to equality, privacy, and freedom of speech and expression - must be reinterpreted in the context of AI . She raised the question of what freedom of thought means when AI threatens cognitive autonomy through micro-targeting and manipulation , and noted that the concentration of data centres and extraction of minerals predominantly in sites of existing inequality in the Global South raises fundamental questions of environmental and economic justice . She argued that justice systems will need to grapple with the complexity of arriving at truth in a time of epistemic erosion, bridge accountability gaps, navigate transparency questions, and address the transnational cross-border governance gap where laws are national but companies are global . She concluded that without diffusing the concentration of power in a handful of companies in a few jurisdictions, human rights - especially for people in the Global South - cannot be safeguarded .
#
Audience Survey Results
Peggy Hicks reported the results of a participant survey conducted at the session. A plurality of respondents were concerned that insufficient governance measures are in place to address the challenges and opportunities of AI . The top two human rights concerns identified were accountability and rule of law, and the impact of AI on children, followed by surveillance and the use of AI by law enforcement, and then environmental sustainability . On the question of who should be responsible for the actions of agentic AI, respondents overwhelmingly identified the companies that develop the AI model as the primary responsible party, followed by states, and then the organisations that deploy the system - a result consistent with the UN Guiding Principles on Business and Human Rights . Hicks also noted that OHCHR and ITU would be presenting on Thursday a survey called "Me and AI," conducted with 1,000 children in 49 countries, in which children expressed that they want AI to be shaped with them, not just for them, that it should respect their rights, and that they do not simply want to be shielded from it .
#
Second Panel: Solutions, Evidence, and Inclusion
The second panel was moderated by Her Excellency Clara Chappaz, Ambassador for AI and Digital Affairs from France, who framed the discussion around three questions: what good practices exist for human rights due diligence; what technical tools and evidence are needed to understand impacts before deployment; and how to ensure that children and other affected populations are meaningfully engaged in AI governance .
Willemijn Aerdts, Minister for Digital Economy and Sovereignty of the Netherlands, presented concrete national tools including an algorithm framework translating legal requirements into practical guidelines, a fundamental rights and algorithm impact assessment, and an algorithm register covering all algorithms used by the Dutch government . On children, she emphasised that when making policy for children and young people, they must be genuinely included in the decision-making process alongside parents and educators, and noted that young people often face issues too big for parents but too small for the police .
Felipe Paullier, Assistant Secretary General of the UN Youth Office, argued that the question should not only be about what AI can do, but what AI can help humanity build as a future, and that AI must be benchmarked not only on speed and efficiency but on its contribution to human well-being, dignity, and human rights . He stressed that young people are the most active users of AI and among the most frequent innovators within AI firms, yet they are almost never the decision-makers despite living longest with the consequences of decisions made today . He called for meaningful spaces for young people to engage in AI governance at the national level, warning that if such spaces are not created, young people will create their own, as has happened in the climate space .
Ulises Gutiérrez, Special Representative for Emerging Technologies of Mexico, raised the concern that public policy is always lagging behind technological development, and that there is insufficient political understanding of the impact of technological development, particularly AI . He argued that the question is not what a human being can do with technology, but what technology is doing to human beings . He called for a new social contract at both national and international levels, not merely regulation, to govern AI in a constantly changing landscape .
Wanjin Park, Vice President of KT, described his company's approach to defining AI risk including human rights considerations, evaluating AI models and agents against that framework, and running an executive deployment safety board before releasing AI products . He specifically highlighted the AI risk taxonomy from the BTEC project at OHCHR as important work that needs to be developed in a more concrete and practical way . He noted that the problem arises when multi-agent systems from different companies are interconnected, as each company has its own definition of AI risk, and called for common and well-designed standards to create a shared baseline .
Nighat Dad, founder of the Digital Rights Foundation, delivered one of the session's most analytically sharp interventions, arguing that human rights due diligence as most AI companies practise it today does not meet the standard of the UN Guiding Principles on Business and Human Rights - it happens after co-design decisions are made, where regulation compels it, and without the participation of the people actually affected . She characterised the geographic unevenness of due diligence - meaningful assessments conducted primarily in the EU, with the same systems deployed in the Global South without equivalent scrutiny - as a structural choice, not a capacity gap, creating a two-tier rights regime determined by geography . She documented over 23,000 cases of technology-facilitated abuse disproportionately against women, girls, and young people through her organisation's cyber harassment helpline , and argued that any due diligence framework that does not explicitly address technology-facilitated gender-based violence has written half the population out of its protection . She proposed three concrete recommendations: mandatory gender and child rights impact assessments conducted before deployment with affected communities participating; uniform due diligence obligations across all markets where a system is deployed; and assessments repeated whenever capabilities materially change, including increases in agentic function .
Alvitta Ottley, member of the Independent Scientific Panel on AI, identified two related scientific challenges: evaluation mismatch and evidence gap . On evaluation mismatch, she argued that engineering questions - can we make something faster, more accurate, more capable? - are not the same questions that societies are asking, which concern whether human rights are protected, whether institutions remain accountable, and whether society is better off . She argued that if society is deciding that success is about protecting human rights, fostering appropriate trust, and preserving accountability, then the outcomes being measured must match what is being optimised for . On the evidence gap, she noted that while there is abundant evidence about how well AI models perform, there is very little evidence about how AI affects people's decision-making, children's learning, clinical decisions, or public servants' work, and that answering these questions requires longitudinal studies, interdisciplinary collaborations, and careful work with protected and underserved communities . She concluded with a formulation that resonated throughout the panel: society has to decide what success looks like, and science has to determine how to measure it .
In her closing remarks, Chappaz synthesised the panel's conclusions, noting that the speed of technological development in a fragmented geopolitical world requires defining what success means for humans, based on the values they choose to prioritise, and that this is only humanity's decision, not the technology's . She echoed Dad's framing that the geographic unevenness of due diligence represents structural choices, not capacity gaps, and warned that if this is not addressed, communities will either withdraw from digital spaces or create their own without governance or values .
#
Audience Interventions
The audience intervention segment featured contributions from governments and civil society organisations across multiple regions, moderated by the thematic co-chairs.
Ireland's Minister Niamh Smyth argued that global AI governance must align with international human rights frameworks, promoting freedom of expression, privacy, access to information, and gender equality, while actively countering all forms of violence including sexual and gender-based violence . She expressed particular concern that without necessary human rights safeguards and oversight, AI systems enable technology-facilitated gender-based violence, and that AI online content moderation without human oversight can amplify disinformation, disproportionately affecting women and girls .
Robert Baruch of Universal Music Group grounded the music industry's position in international human rights law, citing Article 27 of the Universal Declaration of Human Rights and Article 15 of the ICESCR as protecting creators' moral and material interests in the age of AI . He argued that the future of AI must be built not by choosing between innovation and creators' rights but by advancing both together, and proposed three pillars: creator control over how their work is used to develop AI systems; transparency about when and how works are used; and human oversight ensuring AI amplifies rather than replaces human creativity .
Slovenia's representative Anita Pipan argued that trust in AI is not only an ethical objective but a prerequisite for broader AI adoption, and described Slovenia's national AI strategy 2030 as promoting a human-centric approach grounded in human rights, democratic values, ethics, safety, transparency, and accountability . She placed particular importance on protecting linguistic and cultural diversity, arguing that inclusive AI should reflect and preserve all languages and cultures .
Zachary Lampel of the International Center for Not-for-Profit Law proposed three concrete actions: AI red lines - clear prohibitions or moratoria on AI systems and uses that pose unacceptable risks to human rights, explicitly provided for in the 2024 UN General Assembly resolution "Seizing the Opportunities of Safe, Secure, and Trustworthy Artificial Intelligence Systems for Sustainable Development" ; standardised certifications linked to national procurement rules, analogous to green building certifications, creating market incentives to design and deploy safe AI ; and a right to remedy, ensuring that decisions made via AI systems have an accountable actor and an avenue for challenge . He also noted that UNESCO's recommendations on the ethics of artificial intelligence already explicitly rule out the use of AI for social scoring and mass surveillance .
Uruguay's representative Alejandra De Bellis Bonilla highlighted the Global Partnership for Human Rights as a broad, multi-stakeholder platform connecting efforts on AI's cross-cutting impacts, and called for improvements in accountability, normative frameworks, sustainability, and funding, with a gender-responsive approach to AI design and deployment .
Franco Giandana Gigena of AccessNow called for human rights-centred, binding legal standards and global governance mechanisms to regulate digital surveillance technologies and AI, addressing chilling effects on protesters, journalists, and human rights defenders . He called for a halt to the development and use of AI tools facilitating violations of international humanitarian law and human rights law, especially in conflict contexts . He argued that people around the world do not only need access to AI but most importantly need agency .
Rafał Kownacki of Poland's Ministry of Digital Affairs argued that when society decides what an algorithm may do to a human being, it decides what it believes a person is worth . He invoked Poland's historical experience to argue that some choices a machine must never make on its own, and that however capable AI systems become, a person must keep the final word - to understand the decision, to contest it, and where it matters most, to switch the systems off . He welcomed the Council of Europe Framework Convention on AI as the first binding treaty placing AI within the order of human rights, democracy, and the rule of law .
Isabella Henriques of Instituto Alana, speaking on behalf of over 120 signatories of a joint civil society statement on children's rights at the AI dialogue, argued that children are among the earliest and most frequent users of new technology yet remain largely missing from national AI strategies and governance frameworks . She stressed that children's rights, safety, and well-being must be built into AI systems from the start, not added after harm has already occurred, and that responsibility must sit with those who build and profit from the technology .
João Brant of Brazil described the country's Digital Statute for Children and Adolescents, which requires platforms to adopt child protection measures from the design phase, limits features that can lead to excessive usage such as infinite scrolling, and prohibits targeted advertising based on children's personal data . He also described a decree prohibiting the creation of synthetic intimate images based on real third parties, establishing proactive responsibilities for platforms and AI companies . He called for information integrity to be understood in its collective or social dimension as part of the right to access accurate and reliable information, and raised concern about AI's impact on the economic sustainability of journalism .
Anna Osterling of the Global Forum for Media Development argued that, citing Courtney Raj of the Centre for Media and Digital Governance at OpenMarkets, journalism is a keystone species of the information ecosystem - stabilising trust, anchoring verification, structuring accountability, and enabling other institutions to function - and that removing it causes the information ecosystem to collapse rather than adapt . She noted that AI systems are trained on journalistic content scraped without consent, compensation, or credit, and called for public digital infrastructure, industrial policies supporting public interest AI, and AI governance requiring human rights to be embedded across the full lifecycle of all AI systems .
Jihoon Cha of the Republic of Korea described the country's AI Basic Act, which requires operators of high-impact AI systems to assess potential impacts on fundamental human rights, and declared Korea's vision for establishing the Global AI Hub, together with nine participating AI and related organisations, to strengthen global AI capacity . He argued that access to AI should be treated not as a privilege to be earned but as a basic right to be enjoyed .
Pria Chetty of Research ICT Africa proposed a "Just AI" framework, arguing that prevailing governance models anchored in ethical or responsible AI remain structurally inadequate because they are largely self-regulatory, driven by dominant actors, calibrated to high-income countries, and disregard sovereignty or agency . She called for a globally recognised understanding that the governance of AI is inseparable from the governance of data, and for democratising AI resources and capabilities so that global majority nations can shift from passive consumers to co-creators of AI .
Jérôme Bellion-Jourdan of the Institute for Global Negotiation, also a vice-chair of the AI for Good Impact Initiative steering committee, argued that while there is broad agreement on the need for more governance, the question is how to get there. He proposed that the tools and techniques of multilateral negotiation - including process design, innovative negotiation formats, and a shift from positional bargaining and win-lose dynamics to integrative negotiation and win-win outcomes - could help navigate the power politics and power asymmetries that impede progress towards global AI governance .
Mark Cassayre of IDLO, the only global intergovernmental organisation exclusively devoted to promoting the rule of law, recommended that human rights and the rule of law must underpin the development and deployment of digital technologies in the justice sector, that fit-for-purpose legal and regulatory frameworks must accompany innovation, and that investment in institutional capacity - including AI literacy among legal and justice professionals - is essential .
Rebecca Rektimbo, Connectivity Technical Projects Coordinator for LOCNET, delivering remarks on behalf of Raman Jit Singh Chima, Global Programme Director of the Association for Progressive Communications, argued that before communities can contribute data, build local AI solutions, influence policy, or benefit from innovation, they need meaningful, affordable, trusted, and locally relevant connectivity . She argued that community-centred connectivity shifts power closer to communities and enables women, indigenous people, rural communities, and speakers of underrepresented languages to become creators, innovators, researchers, and decision-makers rather than simply consumers of technology . She concluded with a formulation that resonated across the session: communities are not the last mile of AI - they are the first mile .
Esther Eghobamien-Mshelia of the CEDAW Committee argued that there can be no truly human rights-based AI governance without the full implementation of CEDAW, which requires states not only to prohibit discrimination but to achieve substantive equality by tackling structural and regulatory barriers, stereotypes, and unequal power relations . She cited CEDAW General Recommendation No. 40 on women's full and equal participation in political and public life as a tool reminding us that women must participate fully and equally in the design, governance, and oversight of AI systems . She called for gender-responsive indicators, monitoring, and surveillance to demonstrate whether women are participating and benefiting equally from digital transformation and are protected from harms such as algorithmic discrimination and technology-facilitated gender-based violence .
Elizabeth Tan of UNHCR highlighted that for forcibly displaced and stateless people, barriers to challenging AI-assisted decisions are especially high due to documentation gaps, language barriers, digital access limitations, and fear of approaching authorities . She cited concrete examples from Libya, where AI-generated content incited hostility and abuse of refugees, and from the Rohingya community, who continue to face dehumanising narratives online even in exile . She called for human rights due diligence across the AI lifecycle, bias testing, clear explanations of how decisions are reached, and accessible ways to complain or seek correction .
Sopio Kiladze of the Committee on the Rights of the Child described the joint UN statement on AI and the rights of the child, co-led by ITU, the CRC, and UNICEF, co-signed by 13 UN agencies and over 60 organisations, and shaped with input from children from all five UN regions . She argued that history will not judge society by how intelligent its AI is, but by whether it used this extraordinary moment to protect those with the smallest voice and the greatest stake in the future .
Shumaila Hussaini Shahani of Tech Global Institute proposed five concrete commitments: safety claims must be accompanied by conditions under which systems were tested and failure rates disaggregated by language, gender, disability, and region; a decade of voluntary commitments has not delivered and public accountability frameworks with corporate liability are needed; publicly financed, regionally hosted capacity to evaluate AI systems before deployment is required; transparency and oversight must extend to algorithmic management and data workers; and indigenous and traditional knowledge must be protected through community-led data stewardship .
#
Closing Remarks and Overarching Themes
In her closing remarks, Linda Bonyo raised two critical points: first, who finances human rights in the age of AI, noting that the money needed to ensure human rights ideally works in this context must be found ; and second, the need for algorithmic openness around visa processes, noting that 51% of AI governance conversations happen in Geneva and that the rest of the world is effectively locked out because people cannot access visas - a process itself shaped by opaque algorithms . She named a specific absent participant, Freedom Wangi, an AI worker unable to obtain a visa, as a concrete illustration of this exclusion .
Minister López Águeda closed by acknowledging that the dialogue is not merely about technology but about democracy, human rights, privacy, energy, and peace in the world . He stated plainly that society is late in addressing these challenges, but affirmed the direction of travel: building a humanistic AI, defending human agency, and using AI to be better rather than worse .
#
Overall Assessment
The session revealed a high degree of normative consensus across a remarkably diverse range of participants - from government ministers and UN officials to civil society representatives, academics, private sector actors, and international organisation representatives - on the foundational principles of human rights-based AI governance. Across the session's discussions, the strongest areas of convergence were that AI governance must be grounded in binding international human rights law rather than voluntary ethics; that regulation and innovation are complementary rather than in tension; that meaningful human oversight must be substantive and not nominal; that transparency is a fundamental requirement across all dimensions of AI; that children require special protection with responsibility resting on developers and deployers; that AI amplifies existing inequalities and requires proactive governance responses; that agentic AI creates unprecedented accountability challenges; and that affected communities must be meaningfully included in governance processes .
However, the consensus on principles was not matched by equivalent agreement on enforcement mechanisms, funding, or the specific institutional architecture needed to translate principles into practice. Speakers from the Global South consistently highlighted that the gap between principle and practice is itself a structural inequality, with meaningful due diligence applied primarily in high-income jurisdictions . The session's survey results, showing that a plurality of participants were concerned that insufficient governance measures are in place , and that accountability, rule of law, and AI's impact on children were the top concerns , confirmed that participants themselves recognise the distance between the normative consensus achieved and the reality of implementation. The challenge of closing that distance - equitably, urgently, and with the full participation of those most affected - emerged as the defining task ahead.
The UN system must use international human rights law as a binding compass for AI governance, with OHCHR's advisory service helping states govern AI in line with human rights responsibilities - UN human rights framework as compass
Arg. 1This argument has already been captured above under Volker Turk's entries.
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
AI governance must be treated as a fundamental human rights issue, not merely a technical one, with international human rights law providing a binding legal framework - Human rights as binding framework
Arg. 1Bahous argues that left unregulated, AI becomes not only a mirror of existing societal inequalities but a powerful mechanism for amplifying discrimination, exclusion, and violence against women and girls. She insists that AI governance cannot be treated solely as a technical issue and is fundamentally a human rights matter.
Bahous stated that left unregulated, AI becomes not only a mirror of the inequalities that already exist in our societies, but also a powerful mechanism for amplifying discrimination, exclusion, and violence against women and girls . She referenced international human rights law frameworks including the Universal Declaration of Human Rights, the International Covenant on Civil and Political Rights, and CEDAW as providing a comprehensive framework to protect rights .
on: AI amplifies and deepens existing inequalities, particularly for women, girls, the Global South, and other marginalised groups, requiring proactive governance responses
44% of assessed AI systems demonstrate gender bias, and AI reproduces and amplifies harmful stereotypes because training data reflects existing biases - AI amplifies gender bias
Arg. 2Bahous presents evidence that AI systems reproduce and amplify harmful gender stereotypes because they are trained on data that already reflects existing biases. This is not a marginal problem but a systemic one affecting nearly half of all assessed AI systems.
Bahous cited evidence that 44% of assessed AI systems demonstrate gender bias , and that AI systems reproduce and amplify harmful stereotypes because they are trained on data that already reflects existing biases .
on: AI amplifies and deepens existing inequalities, particularly for women, girls, the Global South, and other marginalised groups, requiring proactive governance responses
Up to 99% of online deepfakes and manipulated sexual imagery target women, and 41% of women self-censor on social media to avoid abuse - Deepfakes and self-censorship
Arg. 3Bahous presents alarming statistics on the gendered nature of AI-facilitated harm, particularly deepfakes and manipulated sexual imagery. She connects this to a broader chilling effect on women's participation in public life and democratic processes.
UN Women research found that almost one in four women human rights defenders, activists, and journalists surveyed had experienced AI-assisted online violence, and 6% had been victims of deepfakes or digitally manipulated imagery . Research shows that up to 99% of online deepfakes and manipulated sexual imagery target women , and 41% of all women respondents reported self-censoring on social media to avoid abuse .
Women are underrepresented in AI development, making up only 30% of the AI workforce globally, and gender equality remains largely invisible in AI governance frameworks - Women's exclusion from AI governance
Arg. 4Bahous argues that the accountability of AI governance begins with four questions: who builds AI, who benefits, who bears the risks, and who has a voice. The data reveals that women are systematically excluded from all four dimensions.
Bahous cited that women make up only 30% of the AI workforce globally , and that 88% of leading AI researchers are male according to the independent scientific panel's report . She further noted that of 138 countries assessed, only 24 reference gender in their national AI strategies, and just 18 include substantive gender-responsive provisions .
Gender and child rights impact assessments must be mandatory, conducted before deployment with affected communities participating - Mandatory gender impact assessments
Arg. 5Bahous calls for mandatory human rights impact assessments before and after AI deployment, with gender equality treated as non-negotiable rather than optional. She also emphasises that accountability requires meaningful participation from women, girls, and other affected communities.
Bahous called for mandatory human rights impact assessments before and after deployment with gender equality treated as non-negotiable and not as optional , and stated that women and girls, feminist technologists, indigenous communities, labour organisations, disability advocates, and civil society must be meaningfully involved and empowered .
on: Agentic AI creates unprecedented accountability challenges that require new governance paradigms, including structured documentation, identifiable human responsibility, and rights to timely redress
Women and girls, feminist technologists, indigenous communities, and civil society must be meaningfully involved and empowered in AI governance - Inclusive participation requirement
Arg. 6Bahous argues that accountability in AI governance requires genuine participation from those most affected, including women and girls, feminist technologists, indigenous communities, labour organisations, disability advocates, and civil society. Without this, governance frameworks will fail to address the needs of those most at risk.
Bahous stated that accountability requires participation, and that women and girls, feminist technologists, indigenous communities, labour organisations, disability advocates, and civil society must be meaningfully involved and empowered .
on: Affected communities, including women, youth, children, and Global South populations, must be meaningfully included in AI governance processes, not merely consulted after decisions are made
AI is a political tool, not a consumer good, and governance must choose between digital rights or oligarchy - AI as political tool
Arg. 1López Agueda argues that the geopolitical context reveals AI is not merely a consumer product but a political tool with profound implications for power. He frames the choice starkly: either AI governance upholds digital rights or it leads to oligarchy.
López Agueda stated that the geopolitical times show us that AI is not a consumer good but a political tool, and that today AI is powerful and only has two paths: that of digital rights or that towards an oligarchy .
Without inclusive governance, the global south will serve merely as a battery or data provider for greater powers - Global south as data colony
Arg. 2López Agueda warns that without inclusive and global AI governance, the global south risks being reduced to merely providing data and resources for more powerful nations. He calls for a democratic and inclusive global dialogue on AI.
López Agueda stated that either we do something or the global south will just serve as a battery for the greater powers because it is also just going to be someone who provides data, and therefore we have to be inclusive and global when we consider AI .
on: AI amplifies and deepens existing inequalities, particularly for women, girls, the Global South, and other marginalised groups, requiring proactive governance responses
Human rights due diligence and impact assessments must be mandatory before and after AI deployment, not merely aspirational - Mandatory due diligence
Arg. 1Nighat Dad argues that human rights due diligence as currently practised by most AI companies does not meet the standard of the UN Guiding Principles on Business and Human Rights. It happens after co-design decisions are made, only where regulations compel it, and without participation from affected people.
Dad stated that human rights due diligence happens after co-design decisions are made, where regulations compel it, and without the participation of the people actually affected, meaning what exists in most cases is not due diligence but documentation . She recommended that gender and child rights impact assessments must be mandatory, conducted before deployment with affected communities participating, not merely documented .
on: Affected communities, including women, youth, children, and Global South populations, must be meaningfully included in AI governance processes, not merely consulted after decisions are made
on: Whether the primary locus of human rights due diligence should be pre-deployment or continuous across the AI lifecycle
Human rights due diligence is applied unevenly across markets, creating a two-tier rights regime determined by geography - Geographic inequality in due diligence
Arg. 2Dad argues that companies conduct meaningful human rights assessments primarily where the law requires them to, such as in the EU, and then deploy the same systems in the majority world without equivalent processes. This is a structural choice, not a capacity gap, creating a two-tier rights regime.
Dad stated that companies conduct meaningful assessments where the law requires them to, primarily in the EU, then deploy the same system in the majority world with no equivalent process, and characterised this as a structural choice, not a capacity gap . She noted that the depth of a risk assessment depends not on the risk faced but on the jurisdiction one happens to live in .
on: Whether geographic unevenness in human rights due diligence is a structural choice by companies or a capacity gap
Technology-facilitated gender-based violence cannot be treated as a niche safety issue; any due diligence framework that does not address it has written half the population out of its protection - TFGBV as systemic issue
Arg. 3Dad argues that when women withdraw from digital spaces due to technology-facilitated gender-based violence, this is not merely an individual harm but a collective harm to public discourse and democratic participation. Any due diligence framework that fails to explicitly address this issue excludes half the population from its protection.
Dad's organisation, Digital Rights Foundation, documented more than 23,000 cases of technology-facilitated abuse over 10 years, disproportionately against women, girls, and young people, including non-consensual synthetic imagery, automated moderation that fails in Urdu, Hindi, and Bengali, and recommendation systems that amplify gendered harassment . She stated that when women withdraw from digital spaces, it is a collective harm to public discourse and democratic participation .
on: AI amplifies and deepens existing inequalities, particularly for women, girls, the Global South, and other marginalised groups, requiring proactive governance responses
Gender and child rights impact assessments must be mandatory, conducted before deployment with affected communities participating - Mandatory gender impact assessments
Arg. 4Dad calls for three concrete recommendations: mandatory gender and child rights impact assessments before deployment with affected communities participating; uniform human rights due diligence obligations across all markets; and repeated assessments whenever AI capabilities materially change, including increases in agentic function.
Dad recommended that gender and child rights impact assessments must be mandatory, conducted before deployment with affected communities participating, not merely documented , and that human rights due diligence obligations must apply uniformly across all markets where a system is deployed, noting that a risk assessment covering Brussels but not Pakistan, Kenya, or Brazil is not due diligence .
on: Agentic AI creates unprecedented accountability challenges that require new governance paradigms, including structured documentation, identifiable human responsibility, and rights to timely redress
Civil society organisations in the majority world are early sensors of AI-related harm but remain unfunded and precarious, requiring resourcing and connection to decision-making - Resourcing civil society evidence
Arg. 5Dad argues that the evidence problem in AI governance is fundamentally a resourcing problem. Civil society organisations in the majority world are the earliest sensors of AI-related harm, but their documentation is unfunded, precarious, and treated as anecdote rather than evidence.
Dad noted that her organisation documented synthetic intimate imagery targeting women years before it entered global policy conversations, but that this documentation is unfunded, precarious, and treated as anecdote rather than evidence . She called for this existing early warning system to be resourced and connected to decision-making, including the scientific panel .
on: The appropriate role of evidence in driving AI governance action: whether to act now on existing evidence of harm or wait for more rigorous longitudinal evidence
AI governance frameworks must move beyond self-regulatory, ethics-based models to normative frameworks rooted in international human rights law - Beyond voluntary ethics
Arg. 1Chetty argues that prevailing governance models anchored in ethical or responsible AI remain structurally inadequate because they are largely self-regulatory, driven by dominant actors, and calibrated to high-income countries. She proposes the Just AI framework as a normative alternative rooted in international human rights law.
Chetty stated that prevailing governance models anchored in notions of ethical or responsible AI remain structurally inadequate, as such frameworks are largely self-regulatory, driven by dominant actors, calibrated to high-income countries, and disregard sovereignty or agency . She argued that such frameworks deepen existing inequalities by extracting value from individuals, communities, and nations without reciprocal benefit, input, or control .
on: AI amplifies and deepens existing inequalities, particularly for women, girls, the Global South, and other marginalised groups, requiring proactive governance responses
on: Whether AI governance should focus on universal binding standards or allow genuine pluralism above a common floor of rights safeguards
The separation of data governance and AI governance in international forums obscures the foundational data justice that must inform all AI systems - Data justice inseparable from AI governance
Arg. 2Chetty argues that the governance of AI is inseparable from the governance of data, and that separating these two areas in international forums obscures the foundational data justice issues that must inform all AI systems. Data justice is crucially informed by a right of access to data in substantive and procedural forms.
Chetty called for establishing a globally recognised understanding that the governance of AI is inseparable from the governance of data, and stated that the separation of data governance and AI governance in international forums obscures the foundational data justice that must inform all AI systems .
Governing AI requires a new social contract at both national and international levels, not just regulation - New social contract
Arg. 1Gutiérrez argues that the rapidly changing landscape of AI development means that governance cannot be limited to regulation alone. What is needed is the adoption of a new social contract at both the international and national levels that addresses the fundamental question of what technology is doing to human beings.
Gutiérrez stated that we should talk about governance and the adoption of a new social contract, not only in the international context but also in the national context . He also noted the separation between legality and legitimacy in the international backdrop, and the importance of understanding the impact of technological development on human beings rather than only what human beings can do with technology .
on: Binding regulation versus broader governance frameworks and social contracts for AI
The rule of law requires implementing binding legal frameworks equally, regardless of wealth, power, or influence - Binding legal frameworks
Arg. 1Lampel argues that the rule of law requires implementing binding legal frameworks equally without regard for wealth, power, or influence, and that the international community must start enforcing international human rights law today. He proposes three concrete actions: AI red lines, standardised certifications linked to procurement rules, and a right to remedy.
Lampel referenced the 2024 UN General Assembly resolution on safe, secure, and trustworthy AI systems for sustainable development as explicitly supporting the concept of AI red lines , and cited UNESCO's recommendations on the ethics of AI as already explicitly ruling out the use of AI for social scoring and mass surveillance .
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
on: Whether AI governance should focus on universal binding standards or allow genuine pluralism above a common floor of rights safeguards
AI governance must embed human rights across the full AI lifecycle, from design to deployment and monitoring - Full lifecycle governance
Arg. 1Cassayre argues that human rights and the rule of law must underpin the development and deployment of digital technologies, notably in the justice sector. AI systems must be designed to expand access, serve people's needs, and prevent new forms of exclusion and inequality throughout their entire lifecycle.
Cassayre offered three recommendations: that human rights and the rule of law must underpin the development and deployment of digital technologies; that fit-for-purpose legal and regulatory frameworks must accompany innovation; and that investment in institutional capacity is needed, including strengthening public digital infrastructure for justice delivery and enhancing AI literacy among legal and justice professionals .
on: Regulation of AI does not stifle innovation; safety standards are the foundation of trust in technology
Justice systems must convert human rights principles into reality by ensuring accountability when AI causes harm, focusing on transparency, traceability, and effective remedy - Justice systems as accountability mechanisms
Arg. 1Arias Arzeno argues that the true challenge of AI governance is not in adopting laws or ethical principles but in what happens when a person believes an AI system has violated their human rights. Justice systems are essential institutions for converting principles into reality and ensuring accountability when AI causes harm.
Arias Arzeno stated that governance is no longer just a concept but becomes a reality at the moment when a person considers an AI system has violated their human rights and data privacy . He outlined four priorities for strengthening justice systems: strengthening institutional capacities of lawyers and jurors, ensuring transparency and traceability in the use of AI, having effective human oversight, and ensuring all people have effective mechanisms to access justice and repair harm .
on: AI governance must be grounded in international human rights law as a binding framework, not merely aspirational ethics
on: Whether the primary locus of human rights due diligence should be pre-deployment or continuous across the AI lifecycle
No public institution can justify a decision by saying the system told it to do so; responsibility must lie with people and institutions - Human institutional responsibility
Arg. 2Arias Arzeno argues that the use of AI in courtrooms and public institutions is already a reality, and the challenge is to ensure its use is transparent, responsible, auditable, and compatible with human rights and the rule of law. No institution can abdicate responsibility by attributing a decision to an AI system.
Arias Arzeno stated that no public institution can justify a decision by saying that is what the system told us to do, and that responsibility should lie with people and institutions, with technology helping the judge but never replacing them .
on: Meaningful human oversight of AI must be real and substantive, not a rubber stamp, with an identifiable human retaining authority to alter or stop systems
Agentic AI creates the most significant legal accountability challenge of the decade, as no single human is at the origin of final decisions in networks of autonomous agents - Agentic AI accountability gap
Arg. 1El Fallah Seghrouchni argues that accountability in agentic systems is the most significant legal challenge of the decade because networks of individually autonomous AI agents produce final decisions with no single human at their origin. It is extremely difficult to distribute accountability among agents or to trace back up the chain to identify where a mistake was made.
El Fallah Seghrouchni gave the example of the Iderati X.0 platform in Morocco, which processes 52 million administrative transactions daily, noting that when there is a problem it is very difficult to find the exact cause . She described the challenge of LLMs with between 175 billion and 180 billion parameters and the difficulty of ensuring accountability for what appears in these systems .
on: Agentic AI creates unprecedented accountability challenges that require new governance paradigms, including structured documentation, identifiable human responsibility, and rights to timely redress
on: The appropriate role of evidence in driving AI governance action: whether to act now on existing evidence of harm or wait for more rigorous longitudinal evidence
AI systems must be subject to structured documentation of agent chains, appointment of an identifiable responsible human, and a right to timely redress - Three accountability obligations
Arg. 2El Fallah Seghrouchni proposes three concrete obligations for accountability in agentic AI systems: structured documentation of agent chains specifying who does what and when; appointment of an identifiable human being in charge for all rights-related issues; and a right to redress in good time in line with the speed of AI systems.
El Fallah Seghrouchni proposed that when agents are deployed in public services, there must be structured documentation of agent chains, an identifiable human being in charge for all issues tied to rights, and a right to redress in good time in line with the speed of AI systems . She concluded that the functioning of the algorithm must never be autonomous in regards to rights and the law .
on: Agentic AI creates unprecedented accountability challenges that require new governance paradigms, including structured documentation, identifiable human responsibility, and rights to timely redress
on: Whether the primary locus of human rights due diligence should be pre-deployment or continuous across the AI lifecycle
Transparency about AI's environmental footprint is a fundamental human right, enabling users to make informed choices between tools - Environmental transparency as human right
Arg. 1Luccioni argues that transparency about AI's energy consumption and environmental costs is a fundamental human right because it enables users to make informed choices between tools. Without this information, meaningful choice and accountability are impossible.
Luccioni stated that transparency is a fundamental human right that users should be getting when they use AI, asking what the cost is, where the data comes from, and where the energy comes from, so that users can make a choice between tool A or tool B . She noted that even organisations like the IEA struggle to get this information because member countries themselves do not have it .
on: Transparency is a fundamental requirement across all dimensions of AI governance, including data use, environmental impact, and decision-making processes
Agentic AI amplifies degrees of separation between users and underlying technology, making it harder to identify where failures originate - Agentic AI opacity
Arg. 2Luccioni argues that agentic AI worsens an already difficult transparency and accountability situation by adding more layers between users and the underlying technology. As AI systems become more agentic, it becomes increasingly difficult to identify where failures originate.
Luccioni described the progression from AI models that could be probed, to AI systems with filters and additional components, to AI agents with even larger degrees of separation, noting that when something fails, you do not know where it is coming from . She called for imposing safeguards and standards for safety and sustainability at each part of the machine, regardless of how many parts there are .
on: Agentic AI creates unprecedented accountability challenges that require new governance paradigms, including structured documentation, identifiable human responsibility, and rights to timely redress
on: Whether the primary locus of human rights due diligence should be pre-deployment or continuous across the AI lifecycle
Data centres make the negative impacts of AI very local in terms of water, energy, emissions, and health, disproportionately affecting the most marginalised populations - Local environmental harms
Arg. 3Luccioni argues that while the benefits of AI can technically be global, the negative environmental impacts are very local, concentrated around data centres in terms of water, energy, emissions, and health. These local harms disproportionately affect the most marginalised populations.
Luccioni stated that while the benefits of AI can technically be global, the negative impacts in terms of water, energy, emissions, and health are very local and impact the most marginalised populations . She noted that data centres are a concrete way to anchor the debate about AI's human rights implications .
Transparency about AI's energy consumption is a fundamental human right, yet even international organisations struggle to obtain this information from member countries - Energy transparency deficit
Arg. 4Luccioni highlights a significant transparency deficit in AI's energy consumption, noting that even major international organisations like the IEA cannot obtain reliable data from member countries. This lack of transparency prevents meaningful accountability and informed decision-making.
Luccioni stated that organisations like the IEA, which she has worked with, struggle to get information about AI energy consumption because even member countries do not have the information . She described transparency as something she has been fighting for several years as a fundamental human right .
Energy efficiency labels for AI models, such as the AI Energy Score Project, represent a stepping stone to informed decision-making and eventual regulation - Energy labelling as first step
Arg. 5Luccioni proposes energy efficiency labels for AI models as a practical first step towards transparency and accountability for AI's environmental impact. Rather than immediately restricting deployment, she advocates for first quantifying and measuring impacts so that people can make informed decisions.
Luccioni described the AI Energy Score Project, which creates energy efficiency labels for AI models analogous to energy labels for appliances, as a stepping stone to informed decision-making . She argued that quantifying and measuring impacts is the prerequisite to so many other things that can and should be done when it comes to AI .
The algorithm register and fundamental rights impact assessments used in the Netherlands demonstrate practical tools for translating legal requirements into accountability - Practical accountability tools
Arg. 1Aerdts presents the Netherlands' practical tools for AI accountability as concrete examples of how legal requirements can be translated into actionable guidelines. These include an algorithm framework, a fundamental rights and algorithm impact assessment, and an algorithm register.
Aerdts described the Netherlands' algorithm framework that translates legal requirements into practical guidelines for public organisations, including a fairness handbook, bias testing instruments, and risk profiling assessments . She also mentioned the fundamental rights and algorithm impact assessment that helps identify human rights risks in AI systems , and the algorithm register that includes all algorithms used by the Dutch government in the interest of transparency .
on: Transparency is a fundamental requirement across all dimensions of AI governance, including data use, environmental impact, and decision-making processes
When making policy for children and young people, they must be genuinely included in the decision-making process alongside parents and educators, not left to face issues too big for parents but too small for police - Genuine youth inclusion in policy
Arg. 2Aerdts argues that when making policy for children and young people, they must be genuinely included in the decision-making process. She highlights a gap where young people face issues that are too big for their educators or parents but too small for the police, leaving them without tangible support.
Aerdts noted that the Netherlands speaks to UNICEF youth panels and wants to include parents as well, while ensuring platforms take their responsibility . She recounted that when speaking to young people, they mentioned that some issues they face are too big for their educators or parents but feel too small for the police, leaving them looking for a tangible way to address them .
on: Affected communities, including women, youth, children, and Global South populations, must be meaningfully included in AI governance processes, not merely consulted after decisions are made
The freedom of thought, long encompassed within freedom of expression, must be reinterpreted in the context of AI threatening cognitive autonomy through micro-targeting and manipulation - Cognitive autonomy under threat
Arg. 1This argument has already been captured above under Jhalak M. Kakkar's entries.
There is a methodological challenge in studying children as a protected category, which partly explains the lack of evidence on AI's impact on children and requires careful navigation - Methodological barriers to child research
Arg. 1This argument was made by Alvitta Ottley, not Sonia Livingstone. Please see Alvitta Ottley's entry for this argument.
on: Whether AI governance should prioritise protection of children by restricting their access or by building rights-respecting safeguards into systems
Canada's proposed law would require AI chatbots to be proven safe before exposure to children, with a digital commissioner to ensure compliance - Proof-of-safety legislation
Arg. 1Lametti describes Canada's proposed legislative approach to AI safety for children, which would require AI chatbots to be proven safe before they could be exposed to children. A digital commissioner would be established to ensure compliance with this requirement.
Lametti described Canada's new policy, AI for All, which aims to ensure privacy rights and safety in the use of AI, and a new proposed law on children that would restrict any social platform to children under 16 until proven safe . He noted that AI chatbots would also have to be proven safe before exposure to children, with a digital commissioner to ensure compliance .
on: Children require special protection in AI governance, with safety built into systems from the design stage and responsibility resting with developers and deployers rather than children or families
on: Whether AI governance should prioritise protection of children by restricting their access or by building rights-respecting safeguards into systems
Children's rights must be central to AI governance as a cross-cutting consideration, with safety built into systems from the start rather than added after harm occurs - Children's rights as cross-cutting issue
Arg. 1Henriques argues on behalf of over 120 signatories of a joint statement that children's rights must be central to AI governance as a cross-cutting consideration. Children are among the earliest and most frequent users of new technology, yet they remain largely missing from national AI strategies and governance frameworks.
Henriques spoke on behalf of over 120 signatories of the Joint Statement on Children's Rights at the AI Dialogue, a global campaign coordinated by Five Rights Foundation . She noted that children are among the earliest and most frequent users of new technology, yet remain largely missing from national AI strategies and governance frameworks .
on: Children require special protection in AI governance, with safety built into systems from the design stage and responsibility resting with developers and deployers rather than children or families
Children are not a homogeneous group; indigenous children, girls, children with disabilities, and children of African descent face disproportionate impacts from gaps in AI governance - Intersectionality of child rights
Arg. 2Henriques argues that children must not be treated as a homogeneous group in AI governance discussions. Indigenous children, girls, children with disabilities, and children of African descent face disproportionate impacts from gaps in AI governance, and their intersectionalities must be recognised.
Henriques stated that children are not a homogeneous group and that we must recognise their intersectionalities, noting that indigenous children, girls, children with disabilities, and children of African descent have their rights disproportionately impacted as a result of gaps in AI governance . She highlighted Brazil's ECA Digital as a landmark framework for the protection of children's rights in the digital environment .
on: Children require special protection in AI governance, with safety built into systems from the design stage and responsibility resting with developers and deployers rather than children or families
on: Whether AI governance should prioritise protection of children by restricting their access or by building rights-respecting safeguards into systems
Children should interact with AI systems only if they are proven safe and designed to respect children's rights, with responsibility sitting with those who build and profit from the technology - Proof of safety before child exposure
Arg. 3Henriques argues that children should only interact with AI systems that have been proven safe and designed to respect children's rights, considering their perspectives in decisions that affect them. Responsibility must sit with those who build and profit from the technology, not with children or parents.
Henriques stated that children should interact with AI systems only if they are proven safe and designed to respect children's rights and considering their perspectives in decisions that affect them . She emphasised that responsibility must sit with those who build and profit from this technology .
on: Children require special protection in AI governance, with safety built into systems from the design stage and responsibility resting with developers and deployers rather than children or families
CEDAW provides an essential framework requiring states to achieve substantive equality and tackle structural barriers in AI governance - CEDAW as AI governance framework
Arg. 1Eghobamien-Mshelia argues that CEDAW provides an essential framework for addressing the gendered realities of AI governance. It requires states not only to prohibit discrimination but to achieve substantive equality by tackling structural and regulatory barriers, stereotypes, and unequal power relations.
Eghobamien-Mshelia stated that CEDAW requires states not only to prohibit discrimination but to achieve substantive equality by tackling structural and regulatory barriers, stereotypes, and unequal power relations . She noted that CEDAW also recognises that discrimination is often compounded by factors such as race, disability, age, migration status, and poverty, requiring tailored and proactive action to curb intersectional discrimination .
on: AI amplifies and deepens existing inequalities, particularly for women, girls, the Global South, and other marginalised groups, requiring proactive governance responses
AI-amplified disinformation campaigns and hate speech force women and girls to self-censor, undermining their democratic participation - Disinformation and democratic exclusion
Arg. 1Smyth argues that AI-amplified disinformation campaigns and hate speech undermine the rights of women and girls to exercise freedom of expression by forcing them to self-censor, close their digital accounts, or withdraw from online spaces. This contributes to a broader chilling effect on their full and equal participation in society.
Smyth stated that AI-amplified disinformation campaigns and hate speech undermine the rights of women and girls to exercise freedom of expression by forcing them to self-censor, close their digital accounts, or otherwise withdraw from participating in online spaces . She noted that this contributes to a broader chilling effect on their full, equal, and meaningful participation in society .
on: AI amplifies and deepens existing inequalities, particularly for women, girls, the Global South, and other marginalised groups, requiring proactive governance responses
AI tools used for online content moderation without human oversight can amplify disinformation, disproportionately affecting women and girls - Automated moderation amplifies disinformation
Arg. 2Smyth argues that the deployment of AI for online content moderation without human oversight can amplify disinformation, undermining the integrity of the information landscape. This disproportionately affects women and girls.
Smyth stated that the deployment of AI online content moderation without human oversight can amplify disinformation, undermining the integrity of the information landscape, and that this disproportionately affects women and girls .
Brazil's decree prohibiting synthetic intimate images based on real third parties demonstrates concrete legislative action against AI-facilitated gender-based violence - Legislative action on synthetic imagery
Arg. 1Brant highlights Brazil's legislative action against AI-facilitated gender-based violence, including a decree establishing proactive responsibilities for platforms and AI companies, including the prohibition of creating synthetic intimate images based on real third parties.
Brant described Brazil's digital statute for children and adolescents online, which requires platforms to adopt child protection measures from the design phase and prohibits targeted advertising based on children's personal data . He also described a decree released the previous month to address violence against girls and women in online spaces, including the prohibition of creating synthetic intimate images based on real third parties .
Information integrity must be understood in its collective or social dimension as part of the right to access accurate and reliable information, and AI's impact on journalism's economic sustainability must be addressed - Information integrity as collective right
Arg. 2Brant argues for a broad perception of human rights when discussing AI, highlighting information integrity as a key issue. He frames information integrity as part of Article 19 in its collective or social dimension, encompassing the need for an information ecosystem that provides consistent, accurate, and reliable information.
Brant called for taking information integrity as part of Article 19 of the government in a broad perception of access to information in its collective or social dimension, and stated that we need an information ecosystem that can provide consistent, accurate, and reliable information . He also noted that the way AI is supporting and affecting the economic arrangement and sustainability of journalism should be a concern .
Common and well-designed standards for AI risk, including human rights considerations, are needed to ensure that human rights due diligence boards function consistently across interconnected multi-agent systems - Need for common AI risk standards
Arg. 1Park argues that while individual companies may define AI risk and evaluate their models accordingly, the problem arises when multi-agent systems from different companies are interconnected, as each company has its own definition of AI risk. Common and well-designed standards are needed to ensure consistent human rights due diligence across these systems.
Park stated that the problem comes when multi-agent systems from different companies are interconnected, as companies have their own definition of AI risk and some agents may consider human rights more than others . He referenced the AI risk taxonomy from the BTEC project at OHCHR as important work that needs to be developed in a more concrete and practical way to find a common baseline with many stakeholders .
on: Agentic AI creates unprecedented accountability challenges that require new governance paradigms, including structured documentation, identifiable human responsibility, and rights to timely redress
Today's children are AI natives who need education and critical thinking skills to engage with AI in a balanced way, with their voices flowing into governance discussions - AI literacy for children
Arg. 2Park argues that today's children are AI natives who use AI naturally in search, recommendation, and learning in their daily lives. It is therefore important for them to develop critical thinking skills to engage with AI in a balanced way, and their voices should flow into governance discussions.
Park stated that today's children are AI natives who use AI naturally in search, recommendation, and learning in their daily lives, and that it is important for them to accept it with critical thinking . He suggested that when school programmes for education and discussion are connected with NGOs and relevant committees, children can voice how AI affects them in a balanced way, and those voices can flow into governance discussions .
on: Children require special protection in AI governance, with safety built into systems from the design stage and responsibility resting with developers and deployers rather than children or families
on: Whether AI governance should prioritise protection of children by restricting their access or by building rights-respecting safeguards into systems
There is an evaluation mismatch between engineering metrics such as speed and accuracy and the societal questions of whether human rights are protected and institutions remain accountable - Evaluation mismatch
Arg. 1Ottley argues that there is a fundamental mismatch between the questions that engineers ask about AI (can we make it faster, more accurate, more capable?) and the questions that societies are asking (are human rights protected, are institutions accountable, is society better off?). These are simply different questions that lead to different evaluations of success.
Ottley illustrated the mismatch by noting that a parent does not ask if the model scored 94% on a recent benchmark but asks whether their child can use it and decide when not to trust it, and a physician does not ask if it is the latest model but whether they can rely on it when a patient's life is at stake . She stated that the conversations in the room are not asking whether AI is more capable than last year but whether human rights are protected, institutions remain accountable, and society is better off .
There is a significant evidence gap regarding how AI affects people's decision-making, children's learning, clinical decisions, and public servants' work, requiring longitudinal interdisciplinary studies - Evidence gap in AI impact
Arg. 2Ottley highlights a significant evidence gap: while there is abundant evidence about how well AI models perform, there is very little evidence about how AI is affecting people's decision-making, children's learning, clinical decisions, or public servants' work. Answering these questions requires longitudinal studies and interdisciplinary collaboration.
Ottley stated that we have a lot of evidence about how well AI models perform but very little evidence about how AI is affecting people's decision-making, how well AI has helped teachers teach, how AI affects clinical decisions, how AI helps children learn, or how AI affects public servants . She noted that answering these questions requires longitudinal studies, partnerships with organisations, interdisciplinary collaborations, and careful work with protected and underserved communities .
on: The appropriate role of evidence in driving AI governance action: whether to act now on existing evidence of harm or wait for more rigorous longitudinal evidence
Society must decide what success looks like and science must determine how to measure it; good decisions under uncertainty require making values explicit and evidence rigorous - Society defines success, science measures it
Arg. 3Ottley argues for a new way of thinking about the relationship between society and science in AI governance. Society must decide what success looks like, science must determine how to measure it, and together they must build the evidence to determine whether success is being achieved.
Ottley stated that society has to decide what success looks like and science has to determine how to measure it, and together they have to build the evidence that tells us whether we are actually achieving it . She concluded that good decisions under uncertainty do not come from eliminating uncertainty but from making values explicit, evidence rigorous, and uncertainty understood .
There is a methodological challenge in studying children as a protected category, which partly explains the lack of evidence on AI's impact on children and requires careful navigation - Methodological barriers to child research
Arg. 4Ottley highlights a methodological challenge that is rarely discussed: children are a protected category in research, meaning there are limitations on what can be studied and how. This partly explains the lack of evidence on AI's impact on children and means that things are often developed without children being involved.
Ottley noted that children, along with pregnant women and people in prison, are considered a protected category of the population, meaning there are limitations on what can be studied and how, which is one of the reasons why there is a lack of evidence on the impact of AI on children . She stated that this also means that a lot of times things are developed without having children involved .
on: Whether AI governance should prioritise protection of children by restricting their access or by building rights-respecting safeguards into systems
Young people are the most active users of AI and the most frequent innovators within AI firms, yet they are almost never the decision-makers despite living longest with the consequences - Youth excluded from AI decision-making
Arg. 1Paullier argues that young people are the most active users of AI and many of the innovators within AI technology firms, yet they are almost never the decision-makers. This is a significant governance gap given that they will live longest with the consequences of decisions made today.
Paullier stated that young people are the most active users of artificial intelligence and are actually most of the innovators and creators within some of these huge AI technology firms, but almost always they are not the decision-makers . He noted that they will live the longest of the consequences of the decisions that we make today .
on: Affected communities, including women, youth, children, and Global South populations, must be meaningfully included in AI governance processes, not merely consulted after decisions are made
Meaningful spaces for young people to engage in AI governance must be created at the national level, not only globally, as young people best understand both opportunities and harms - National youth participation
Arg. 2Paullier argues that meaningful spaces for young people to engage in AI governance must be created especially at the national level, not only in global forums. Young people are those who first experience the impact of technology in their education, employment, and everyday digital life, and they best understand both the opportunities and the harms.
Paullier stated that young people are those who first experience the impact of technology in their education, employment cycles, and everyday digital life, and that they forge their identities in the digital space . He argued that young people are the ones who understand the most about which opportunities AI can bring but also the ones who will help identify biases, discriminations, and exclusions .
If meaningful spaces for youth are not created, young people will create their own spaces outside governance frameworks, as has happened in the climate space - Youth will self-organise
Arg. 3Paullier warns that if meaningful spaces for young people to engage in AI governance are not created, young people will find their own way and create their own spaces, as has happened in the climate space. This underscores the urgency of proactive inclusion.
Paullier stated that if meaningful spaces for young people to engage are not created, young people will find their way and create their own spaces, as has happened within the climate space .
Young people consistently raise the human dimension and the impact of AI on well-being, mental health, and meaningful human relationships as their primary concern - Youth prioritise human well-being
Arg. 4Paullier reports that across regions, young people consistently raise the human dimension and the impact of AI on well-being, mental health, and meaningful human relationships as their primary concern. While young people value technology, what they value most is belonging, trust, and meaningful human relationships.
Paullier stated that what young people and citizens in general value most is belonging, trust, and meaningful human relationships . He called for emphasis on the impact of technologies on the well-being and mental health of communities, and for working not only for youth but with youth .
Journalism is a keystone species of the information ecosystem; AI systems are trained on journalistic content scraped without consent or compensation, undermining journalism's business models - Journalism as critical infrastructure
Arg. 1Osterling argues that journalism is a keystone species of the information ecosystem that stabilises trust, anchors verification, structures accountability, and enables other institutions to function. AI systems are trained on journalistic content scraped without consent, compensation, or credit, undermining journalism's business models and public trust.
Osterling cited her colleague's description of journalism as a keystone species of the information ecosystem, noting that removing it means the ecosystem does not adapt but collapses . She stated that AI systems are trained on journalistic content scraped without consent, compensation, or credit , and called for public digital infrastructure, industrial policies ensuring public interest AI, and AI governance requiring human rights to be embedded across the full lifecycle of AI systems .
AI-generated disinformation and online hate speech have created direct protection risks for refugees and displaced people, as seen in Libya and among the Rohingya - AI hate speech as protection risk
Arg. 1Tan argues that AI-generated disinformation and online hate speech have become direct protection risks for refugees and displaced people. She presents concrete examples from Libya and the Rohingya community where AI-generated content has incited hostility, abuse, and violence.
Tan cited the example of Libya, where violent hate speech and dangerous misinformation including AI-generated content incited hostility and abuse of refugees and affected the safety of UNHCR and humanitarian workers . She also noted that the Rohingya continue to face dehumanising narratives online even in exile, and that this kind of hate can fuel abuse, exclusion, violence, and fear .
Geopolitical competing interests impede global AI governance, and leveraging negotiation tools to shift from positional bargaining to integrative negotiation is essential to forge common ground - Negotiation as governance tool
Arg. 1Bellion-Jourdan argues that geopolitical competing interests and power asymmetries are impediments to global AI governance, and that leveraging the tools and techniques of multilateral negotiation can help navigate these challenges. The goal is to shift from positional bargaining and win-lose dynamics to integrative negotiation and win-win outcomes.
Bellion-Jourdan argued that if we leverage the power of negotiation with all its tools and techniques to navigate power politics and power asymmetry, this would allow us to forge common ground . He called for investment in process design, process management, and innovative formats of negotiations, noting that it will not be enough to lock 193 states in a room and expect agreement .
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
The Council of Europe Framework Convention on AI is the first binding treaty placing AI within the order of human rights, democracy, and the rule of law - First binding AI treaty
Arg. 1Kownacki welcomes the Council of Europe Framework Convention on AI as the first binding treaty to place AI within the order of human rights, democracy, and the rule of law. He argues that Poland is turning these principles into practice at home through its national digitisation strategy and AI policy.
Kownacki stated that Poland welcomes the Council of Europe Framework Convention on AI, describing it as the first binding treaty to place AI within the order of human rights, democracy, and the rule of law . He noted that Poland's national AI policy commits to artificial intelligence that is human-centric and trustworthy .
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
The human factor, keeping a person with the final word to understand, contest, and switch off AI decisions, is the common ground on which truly global AI governance can be built - Human factor as common ground
Arg. 2Kownacki argues that the human factor — keeping a person with the final word to understand, contest, and switch off AI decisions — is non-negotiable and represents the common ground on which truly global AI governance can be built. This must be written into values, laws, standards, and institutions, not left as a declaration.
Kownacki stated that however capable AI systems become, a person must keep the final word, to understand the decision, to contest it, and where it matters most to switch the systems off, and that this is non-negotiable above all in high-risk systems . He argued that the human factor belongs to no single nation and is the common ground on which a truly global governance of AI can be built .
on: Meaningful human oversight of AI must be real and substantive, not a rubber stamp, with an identifiable human retaining authority to alter or stop systems
on: Whether AI governance should focus on universal binding standards or allow genuine pluralism above a common floor of rights safeguards
A common floor of rights safeguards, including disclosure, contestability, and remedy, must apply to every person affected by AI - Common rights floor
Arg. 1Shahani argues that compatibility between national approaches to AI governance does not require uniformity. Instead, a common floor of rights safeguards — including disclosure, contestability, and remedy — must apply to every person affected by AI, with genuine pluralism permitted above that floor.
Shahani stated that compatibility between approaches globally does not require uniformity, and that we can have a common floor of rights safeguards including disclosure, contestability, and remedy for every person affected, but with genuine pluralism above that floor .
on: Whether AI governance should focus on universal binding standards or allow genuine pluralism above a common floor of rights safeguards
Safety claims must be accompanied by conditions under which systems were tested and known failure rates disaggregated by language, gender, disability, and region - Disaggregated safety disclosure
Arg. 2Shahani argues that safety claims for AI systems must be accompanied by the conditions under which systems were tested, known limitations, and failure rates disaggregated by language, gender, disability, region, and skin tone. Without this, it is impossible to hold a system accountable for where it fails.
Shahani stated that safety claims must be accompanied by the conditions under which systems were tested, known limitations and failure rates disaggregated by language, gender, disability, region, skin tone, and more, and that disclosure of training data provenance must be standard . She noted that we cannot hold a system accountable if we cannot see where it fails .
on: Transparency is a fundamental requirement across all dimensions of AI governance, including data use, environmental impact, and decision-making processes
Global majority countries largely import models trained elsewhere and deploy them in high-stakes settings without the means to evaluate them, requiring publicly financed regional evaluation capacity - Regional evaluation capacity
Arg. 3Shahani argues that global majority countries largely import AI models trained elsewhere and deploy them in high-stakes settings without the means to evaluate them first. She calls for publicly financed, regionally hosted capacity to evaluate AI systems before deployment and open benchmarks built with and for under-resourced languages.
Shahani stated that global majority countries largely import models trained elsewhere and deploy them in high-stakes settings without the means to evaluate them first, and called for publicly financed, regionally hosted capacity to evaluate AI systems before they are deployed and open benchmarks built with and for under-resourced languages .
on: Whether geographic unevenness in human rights due diligence is a structural choice by companies or a capacity gap
Indigenous and traditional knowledge is being absorbed into training data without consent, recognition, or return, requiring community-led data stewardship as part of human oversight - Indigenous data sovereignty
Arg. 4Shahani argues that indigenous and traditional knowledge is being absorbed into AI training data without consent, recognition, or return. She calls for community-led data stewardship to be recognised as part of human oversight.
Shahani stated that indigenous and traditional knowledge is being absorbed into training data without consent, recognition, or return, and that community-led data stewardship must therefore be recognised as part of human oversight .
51% of AI governance conversations happen in Geneva, meaning the rest of the world is effectively locked out due to visa restrictions, which themselves rely on opaque algorithms - Visa algorithms exclude global voices
Arg. 1Bonyo argues that the concentration of AI governance conversations in Geneva, combined with visa restrictions that rely on opaque algorithms, effectively locks out the rest of the world from these discussions. She calls for transparency in the algorithms that determine whether people can travel to participate in governance forums.
Bonyo cited a report stating that 51% of AI governance conversations this year happen in Geneva, meaning the rest of the world is effectively locked out because they cannot access visas . She called for algorithmic openness around visa processes and asked the global north to reconsider the kind of algorithms outsourced to determine whether people travel .
on: Affected communities, including women, youth, children, and Global South populations, must be meaningfully included in AI governance processes, not merely consulted after decisions are made
The Africa AI Governance Index tracks AI strategies, laws, and institutions across all African states for the first time, providing an assessment tool for inclusive governance - Africa AI Governance Index (Linda Bonyo)
Arg. 2Bonyo presents the Africa AI Governance Index, launched by Lawyers Hub, as a tool for tracking AI strategies, laws, and institutions across all African states for the first time. This provides an assessment tool that supports inclusive governance by making African AI governance visible and comparable.
Bonyo stated that the Africa AI Governance Index tracks AI strategies, laws, and institutions across all African states, and that for the first time there is an assessment that covers everyone across the African continent . She invited participants to visit AIpolicy.africa to interact with the work of the AI Lab .
Uruguay's commitment to gender-responsive AI governance and the Global Partnership for Human Rights represents a multi-stakeholder platform connecting efforts on AI's cross-cutting impacts - Multi-stakeholder human rights platform
Arg. 1De Bellis Bonilla highlights Uruguay's commitment to driving forward a digital transformation that includes AI development and use in an inclusive and gender-based approach. She points to the Global Partnership for Human Rights as a broad multi-stakeholder platform that connects efforts on AI's cross-cutting impacts.
De Bellis Bonilla noted Uruguay's adherence to the Madrid Declaration on the Fifth Ministerial Conference on the Feminist Foreign Policy , and highlighted the Global Partnership for Human Rights from OHCHR as a broad multi-stakeholder platform and network connecting all efforts with a cross-cutting focus on the impact of AI .
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
Access Now calls for a halt to AI tools facilitating violations of international humanitarian law and human rights law, especially in conflict contexts, alongside binding global governance mechanisms - Halt to IHL-violating AI
Arg. 1Gigena calls on behalf of Access Now for a halt to the development and use of AI tools that are facilitating violations of international humanitarian law and international human rights law, especially in contexts of conflict or war. He also calls for binding legal standards and global governance mechanisms to regulate digital surveillance technologies and AI.
Gigena called for a halt to the development and use of AI tools facilitating violations of international humanitarian law and international human rights law, especially in contexts of conflict or war . He also echoed calls for the adoption of human rights-centred, binding legal standards and global governance mechanisms to regulate digital surveillance technologies and AI, addressing chilling effects .
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
Access to AI should be treated not as a privilege to be earned but as a basic right to be enjoyed, with global AI capacity-building to reduce fragmented readiness - AI access as a right
Arg. 1Cha argues that access to AI should be treated not as a privilege to be earned but as a basic right to be enjoyed. He notes that global efforts to build AI readiness remain fragmented, and that the Republic of Korea has declared a vision for establishing a Global AI Hub to contribute to strengthening global AI capacity.
Cha stated that the Republic of Korea considers access to AI not as a privilege to be earned but as a basic right to be enjoyed . He noted that as countries deepen their readiness for AI, their approaches to governing it also deepen, but globally these efforts remain fragmented , and described Korea's vision for establishing the Global AI Hub together with nine participating AI and related organisations .
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
Community-centred connectivity is a prerequisite for equitable AI participation; communities are not the last mile but the first mile of AI - Communities as first mile
Arg. 1The APC representative argues that before communities can contribute data, build local AI solutions, influence policy, or benefit from innovation, they need meaningful, affordable, trusted, and locally relevant connectivity. Community-centred connectivity shifts power closer to communities and enables women, indigenous people, rural communities, and speakers of underrepresented languages to become creators and decision-makers.
The speaker stated that community-centred connectivity is more than providing internet access; it is about communities owning, managing, and governing the infrastructure that connects them, creating space for local knowledge, local languages, and community priorities to thrive . The speaker concluded that communities are not the last mile of connectivity or of AI but are actually the first mile .
on: Affected communities, including women, youth, children, and Global South populations, must be meaningfully included in AI governance processes, not merely consulted after decisions are made
History will judge us not by how intelligent our AI is, but by whether we protected those with the smallest voice and the greatest stake in the future - Moral responsibility to children
Arg. 1Kiladze argues that the question of AI and children's rights is ultimately a moral one about whether there is the will from states, companies, and international organisations to design, develop, and govern AI that respects children's rights. History will judge us not by the intelligence of our AI but by whether we protected those with the smallest voice and the greatest stake in the future.
Kiladze stated that history will not judge us by how intelligent our AI or machines are, but by whether we used this extraordinary moment to protect those who had the smallest voice but the greatest stake in the future . She referenced the joint UN statement on AI and the Rights of the Child, co-led by ITU, the CRC, and UNICEF, which unified 13 UN agencies and over 60 organisations, with children from all five UN regions helping to shape it .
on: Children require special protection in AI governance, with safety built into systems from the design stage and responsibility resting with developers and deployers rather than children or families
Compatibility between national approaches does not require uniformity; a common floor of rights safeguards with genuine pluralism above it is achievable - Common floor with pluralism
Arg. 1This argument was primarily made by Shumaila Hussaini Shahani. Clara Chappaz's role in the session was as moderator, and her closing remarks synthesised the panel's contributions rather than advancing this specific argument independently.
Innovation should not come at the cost of harm to children; if there is potential harm, protection must be prioritised, and AI systems should only be accessible to children if proven safe and designed to respect their rights - Protection over innovation for children
Arg. 1Hendricks argues that innovation must not be pursued at the expense of children's safety and rights. Children should only interact with AI systems that have been proven safe and designed with their rights in mind, and responsibility must rest with those who build and profit from the technology rather than with children or families.
Hendricks stated that if there is potential harm, we need to prioritise protection, and that children should interact with AI systems only if they are proven safe and designed to respect children's rights and considering their perspectives in decisions that affect them . She emphasised that responsibility must sit with those who build and profit from this technology, and called for building an AI future worthy of every child's trust and safety .
on: Children require special protection in AI governance, with safety built into systems from the design stage and responsibility resting with developers and deployers rather than children or families
Creators and artists must remain in control of how their work is used to develop AI systems, with freely negotiated agreements between rights holders and technology developers creating trust and legal certainty - Creator control over AI training data
Arg. 1Baruch argues that responsible AI governance requires that creators and artists retain control over how their work is used to train AI systems. Agreements reached freely and voluntarily between creators, rights holders, and technology developers are the foundation for trust, legal certainty, and sustainable innovation.
Baruch stated that creators and artists must remain in control of how their work is used to develop AI systems, and that agreements reached freely and voluntarily between creators, rights holders, and technology developers create trust, legal certainty, and sustainable innovation . He referenced Universal Music Group's partnerships with companies including NVIDIA, Stability AI, and Spotify as practical examples of this approach .
Transparency about when and how creators' works are used to develop AI models is essential for protecting artistic integrity and enabling meaningful accountability - Transparency for creators
Arg. 2Baruch argues that creators must know when and how their works have been used to develop AI models and how they will be used for outputs. Without transparency, there can be no accountability, no trust, and no meaningful collaboration between the creative and technology sectors.
Baruch stated that creators should know when and how their works have been used to develop AI models and how they will be used for outputs, and that without transparency there can be no accountability, no trust, and no meaningful collaboration . He argued that with transparency, artistic integrity can be protected and, where necessary, enforced .
on: Transparency is a fundamental requirement across all dimensions of AI governance, including data use, environmental impact, and decision-making processes
AI should amplify human creativity rather than replace it, as music carries memory, identity, emotion, and lived experience that goes beyond data or patterns - AI as amplifier of human creativity
Arg. 3Baruch argues that AI is an extraordinary creative tool but must remain subordinate to human creativity rather than replacing it. Music, as a profoundly human art form carrying memory, identity, emotion, and lived experience, exemplifies why human oversight of AI in the creative sector is essential.
Baruch stated that AI is an extraordinary creative tool but it should amplify human creativity, not replace it, and that music is profoundly human, carrying memory, identity, emotion, and lived experience . He cited Bjorn Ulvaeus's description of music as testimony, and argued that if applied responsibly, AI can ignite a new renaissance of human creativity preserving cultural heritage and inspiring future generations .
Article 27 of the Universal Declaration of Human Rights and Article 15 of the International Covenant on Economic, Social, and Cultural Rights protect creators' moral and material interests, and these principles remain fully applicable in the age of AI - Human rights framework for creators
Arg. 4Baruch grounds the music industry's approach to AI governance in international human rights law, arguing that the rights of creators to protection of their moral and material interests are enshrined in foundational human rights instruments and remain just as relevant in the AI era.
Baruch stated that Article 27 of the Universal Declaration of Human Rights and Article 15 of the International Covenant on Economic, Social, and Cultural Rights recognise that creators are entitled to protection of the moral and material interests from their work, and that those principles are just as relevant in the age of AI .
Survey results from session participants show a plurality are concerned that insufficient governance measures are in place, with accountability, rule of law, and AI's impact on children identified as the top human rights concerns - Participant concern about governance gaps
Arg. 1Hicks presents the results of a survey conducted among session participants, revealing that many are uncertain or concerned about the adequacy of current AI governance measures. The survey identified accountability and rule of law, and the impact of AI on children, as the top human rights concerns among participants.
Hicks reported that a plurality of survey respondents were quite concerned that we do not have the measures in place to address the challenges and opportunities discussed in the session . She noted that the top two human rights issues identified in the survey were accountability and rule of law, and the impact of AI on children, followed by surveillance and use of AI by law enforcement, and environmental sustainability .
Survey respondents overwhelmingly identified AI-developing companies, states, and deploying organisations as the primary responsible parties for agentic AI actions, consistent with the UN Guiding Principles on Business and Human Rights - Distributed accountability for agentic AI
Arg. 2Hicks presents survey findings showing that participants identified a hierarchy of responsibility for agentic AI: first, companies that develop AI models; second, states that must ensure regulatory environments prevent harm; and third, organisations that deploy agentic systems. This is consistent with the UN Guiding Principles on Business and Human Rights.
Hicks reported that survey respondents identified the companies that develop AI models as the primary responsible party for agentic AI actions, followed by states and the public authorities that allowed the system, and then the organisations that deploy it . She noted that this is consistent with the UN Guiding Principles on Business and Human Rights, under which the first pillar is that states are responsible for ensuring the regulatory environment exists to prevent companies from causing harm .
on: Agentic AI creates unprecedented accountability challenges that require new governance paradigms, including structured documentation, identifiable human responsibility, and rights to timely redress
A survey of 1,000 children in 49 countries found they want AI to be shaped with them, not just for them, and they want it to respect their rights rather than simply being shielded from it - Children want agency in AI governance
Arg. 3Hicks references a survey of 1,000 children in 49 countries conducted with ITU, which found that children want meaningful participation in shaping AI rather than simply being protected from it. Children expressed that they want AI to respect their rights and want to be included in governance discussions.
Hicks described a survey called 'Me and AI' of 1,000 children in 49 countries, noting that children said they want AI to be shaped with them, not just for them, and they want it to respect their rights and do not just want to be shielded from it .
on: Affected communities, including women, youth, children, and Global South populations, must be meaningfully included in AI governance processes, not merely consulted after decisions are made
Trust in AI is not only an ethical objective but a prerequisite for broader AI adoption, requiring a human-centric approach grounded in human rights, democratic values, ethics, safety, transparency, and accountability - Trust as prerequisite for AI adoption
Arg. 1Pipan argues that Slovenia's view is that trust in AI must be understood not merely as an ethical aspiration but as a practical prerequisite for the broader adoption of AI systems. This trust must be built on a human-centric approach grounded in human rights, democratic values, ethics, safety, transparency, and accountability.
Pipan stated that in Slovenia's view, trust is not only an ethical objective but also a prerequisite for the broader adoption of AI, and that this approach is reflected in Slovenia's national AI strategy 2030, adopted in March of that year . She noted that the strategy clearly promotes a human-centric approach to AI grounded in human rights, democratic values, ethics, safety, transparency, and accountability, with the objective of ensuring that AI is developed and used responsibly in the public interest .
on: AI governance must be grounded in international human rights law as a binding framework, not merely aspirational ethics
Building trust in AI requires effective and practical implementation, including responsible governance, legal certainty, support mechanisms, and sustained investment in AI literacy and technology skills - Implementation as foundation of trust
Arg. 2Pipan argues that declaring principles is insufficient; building genuine trust in AI requires translating those principles into effective and practical implementation. This entails ensuring responsible governance, legal certainty, appropriate support mechanisms, and sustained investment in AI literacy and technology skills.
Pipan stated that the strategy recognises that building trust requires effective and practical implementation, and that this entails ensuring responsible governance, legal certainty, appropriate support mechanisms, and sustained investment in AI literacy and technology skills .
on: Transparency is a fundamental requirement across all dimensions of AI governance, including data use, environmental impact, and decision-making processes
As a small linguistic community, Slovenia places particular importance on protecting linguistic and cultural diversity, arguing that inclusive AI must reflect and preserve all languages and cultures so that no community is left behind - Linguistic and cultural diversity in AI
Arg. 3Pipan highlights Slovenia's particular concern as a small linguistic community that inclusive AI must reflect and preserve all languages and cultures. She argues that AI governance must ensure that no community is left behind due to linguistic or cultural underrepresentation in AI systems.
Pipan stated that as a small linguistic community, Slovenia places particular importance on protecting linguistic and cultural diversity, and that inclusive AI should reflect and preserve all languages and cultures, ensuring that no community is left behind .
International cooperation through the exchange of good practices, interoperable approaches, and capacity building is essential to advance trustworthy AI globally - International cooperation for trustworthy AI
Arg. 4Pipan calls for strengthened international cooperation as a key pillar of advancing trustworthy AI globally. She argues that this cooperation should take the form of exchanging good practices, developing interoperable approaches, and building capacity across countries.
Pipan outlined four forward-looking priorities for Slovenia, including strengthening international cooperation through the exchange of good practices, interoperable approaches, and capacity building to advance trustworthy AI globally . She also called for complementing regulatory frameworks with practical implementation support, including capacity building, guidance, and AI literacy .
on: International cooperation, binding multilateral frameworks, and capacity building are essential to address the global nature of AI governance challenges
The collaboration between the World Bank and OHCHR in preparing the AI governance session reflects the importance of UN system cooperation in addressing timely and important issues of AI governance - UN system collaboration on AI
Arg. 1Ng emphasises the significance of the dialogue by characterising it as timely and important, and acknowledges the substantial preparatory work done by OHCHR and his counterpart. This implicitly argues that effective AI governance requires coordinated effort across UN system organisations rather than siloed approaches.
Ng thanked OHCHR and the co-chairs for doing a lot of the heavy lifting in preparing the session, and specifically acknowledged his OHCHR counterpart Li Zhou for his massive efforts .
Broad participation from diverse stakeholders must be structurally ensured in AI governance dialogues by alternating between member state and non-state stakeholder representatives - Structured multi-stakeholder participation
Arg. 1The Co-moderator explains that the audience intervention segment is organised to alternate between one representative from member states and one representative from other stakeholders. This procedural arrangement reflects a substantive commitment to inclusive multi-stakeholder participation as a governance principle, ensuring that civil society, private sector, and other non-state voices are formally embedded in the dialogue structure alongside governments.
The Co-moderator stated that in the interest of promoting broad participation from stakeholders, the segment would proceed with one representative from member states and one representative from other stakeholders, alternating between the two .
Time discipline and equal speaking time for all participants is essential to maximise the number of voices heard in AI governance forums - Equal and time-limited participation
Arg. 2The Co-moderator emphasises that a timer has been set and that microphones will be automatically switched off once the allocated speaking time expires. This procedural commitment reflects a substantive principle that governance forums must actively manage participation to ensure the broadest possible range of voices can be heard, rather than allowing a few speakers to dominate.
The Co-moderator noted that a timer had been set visible on screen and at the lectern, and that microphones would be automatically switched off once the allocated speaking time expired, encouraging all speakers to respect the allotted time so that the largest possible number of speakers could be accommodated .
Session Knowledge Graph
Speakers · Topics · Arguments · Relationships
