New York passes child protection law targeting AI companion chatbots

New York State has approved legislation aimed at strengthening protections for minors interacting with AI chatbots, marking one of the first targeted regulatory efforts focused on AI companion technologies. The bill, known as S9051B, introduces restrictions on chatbot features that may encourage harmful emotional dependence or unsafe behaviour among young users.

The law prohibits AI systems from presenting themselves as real or fictional human beings in ways that could mislead minors and restricts outputs that encourage self-harm, disordered eating or other harmful behaviour. The legislation specifically targets design features that may foster emotional dependency between children and AI systems, reflecting growing concerns over their potential psychological effects.

Sponsored by Senator Kristen Gonzalez and Assemblymember Alex Bores, the legislation was developed in consultation with New York Attorney General Letitia James and child safety organisations, including Common Sense Media. Supporters of the bill argue that rapid advances in AI have outpaced existing safeguards, leaving young users vulnerable to emerging risks.

Supporters say the measure is part of a wider push for responsible AI governance in New York, focusing on transparency, accountability, and consumer protection. Advocacy groups involved in developing the legislation have pointed to real-world cases as evidence of the need for stronger oversight of emotionally interactive AI systems.

Why does it matter?

AI companion applications are becoming increasingly sophisticated and capable of sustaining long-term, emotionally engaging interactions with users. While these systems may provide entertainment, companionship or support, concerns have emerged about their potential influence on children and other vulnerable users.

By focusing on chatbot design features rather than solely on content moderation, New York’s legislation introduces a new approach to AI governance that could influence future regulatory efforts in the United States and beyond. The law also reflects growing attention to the psychological and social impacts of generative AI systems.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our chatbot!  

Spain calls for United Nations Action on children’s digital rights

Spain has proposed the creation of a permanent multilateral working group within the UN to strengthen the regulation of digital environments and improve protections for children online.

The proposal was presented by Minister of Youth and Childhood, Sira Rego, during a ministerial roundtable at the Global Alliance of Pioneer Countries to End Violence Against Children in Turin.

According to Rego, stronger international cooperation is needed to regulate digital environments and protect children’s rights in response to abuses by major technology platforms. She said protecting children online requires regulations, rules, and control mechanisms that safeguard their rights and freedoms.

The proposal builds on earlier Ibero-American ministerial discussions on youth and childhood, during which countries agreed to establish an Ibero-American Observatory for the Well-being of Children, with a focus on protecting minors in digital environments. Spain is now proposing a similar approach within the UN framework.

A central element of Spain’s position is algorithmic transparency. Rego said algorithms are not neutral systems and can affect children’s ability to exercise their rights. She argued that such systems should be auditable and subject to democratic oversight by public authorities.

Alongside regulatory measures, Spain is advancing a National Strategy for Digital Environments to improve digital literacy among children, adolescents, and families. The strategy will combine education, pedagogical tools, and content creation to help protect children’s rights in digital spaces.

Why does it matter?

Spain’s proposal reflects growing pressure for international coordination on children’s digital rights. National rules alone often struggle to address platforms that operate across borders and use algorithmic systems that shape what children see, how they interact, and how their data is used. A UN-level working group could provide child online safety with a more permanent multilateral forum, especially on platform accountability and algorithmic transparency.

Would you like to learn more about AI, tech and digital diplomacyIf so, ask our Diplo chatbot!  

UNICEF warns of AI risks to child online safety

UNICEF Vietnam has warned that rapid advances in AI are creating new risks for child online safety, including AI-generated child sexual abuse material and deepfakes.

The UNICEF Vietnam Representative, Silvia Danailov, issued a warning to mark International Children’s Day and Vietnam’s Month of Action for Children, which is held under the theme ‘Happy, safe and confident children in the digital world.’

Danailov said digital technologies can help children learn, connect, and develop future skills, but also create new forms of harm. She warned that generative AI can now be used to create highly realistic sexual images or videos of children without their knowledge or consent.

UNICEF, ECPAT, and INTERPOL research across 11 countries found that at least 1.2 million children reported that their images had been manipulated into sexually explicit deepfakes in the past year. Danailov said such harms can have lasting effects, even when images are digitally created, because children experience fear, shame, and loss of trust.

Nearly nine in ten children aged 12 to 17 in Vietnam are online, with many spending five to seven hours a day on the internet. Danailov said AI-driven risks add a new layer to existing challenges, such as cyberbullying and online exploitation, while also exposing inequalities between children who are supported online and those who are not.

Vietnam has strengthened its legal and policy framework, including a new government decree effective from 16 May 2026 that reinforces children’s right to privacy by prohibiting the disclosure of a child’s personal information without the child’s consent, when aged seven or older, and with the consent of their parents or caregivers.

The country has also approved the National Programme on Child Online Protection and Support for Development for 2026–2030, aimed at protecting children and empowering them as confident digital citizens through stronger legal frameworks, improved systems, education, and coordinated action.

UNICEF called for laws and enforcement to keep pace with technology, stronger child protection systems, safer platform design by technology companies, and better support for schools and families. Danailov also stressed that children must be heard and involved in creating safer digital environments.

Why does it matter?

The warning shows how generative AI is changing the landscape of child online safety. Children can now be harmed even without direct interaction with an offender, including through manipulated images and deepfake abuse. That makes child protection harder for families, schools, platforms, and regulators, and increases the need for safety-by-design, stronger reporting systems, legal safeguards, and trusted support channels for children.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our Diplo chatbot!

UNESCO launches online child safety training

UNESCO and India’s National Council of Educational Research and Training have launched a national training programme to help teachers, educators, and education professionals identify, prevent, and respond to online violence affecting children.

The five-day programme is delivered live from 1 to 5 June 2026 in English, followed by a Hindi edition from 8 to 12 June. It is broadcast on NCERT’s official YouTube channel and the PM e-VIDYA platform, as well as on DTH TV Channels 6–12. Certification is available through the DIKSHA platform.

The initiative aims to strengthen teacher capacity as children spend more time on social media, gaming platforms, and online learning tools. UNESCO said India has more than one billion internet subscribers, with young people among the country’s most active digital users.

The programme covers cyberbullying, online grooming, image-based abuse, exploitation, exposure to harmful content, hate speech, and misinformation. It also addresses the impact of online violence on children’s mental health, well-being, learning outcomes, and participation in education.

Sessions bring together expertise from education, child protection, mental health, law enforcement, and digital governance. Contributors include experts from UNESCO, AIIMS, the Ministry of Home Affairs, NITI Aayog, Delhi Police, and Dublin City University.

UNESCO reported that cybercrime cases against children in India rose from 232 in 2018 to 1,823 in 2022, almost an eight-fold increase. Between 2021 and 2022 alone, reported cases increased by 32%.

The programme aligns with India’s National Education Policy 2020 and the National Curriculum Framework for School Education 2023, both of which emphasise digital citizenship, learner safety, digital literacy, and ethical use of technology.

Why does it matter?

The training shows how child online safety is becoming part of education policy, not only cybercrime enforcement. By equipping teachers to recognise online harms and respond through referral pathways, UNESCO and NCERT are treating schools as part of the frontline response to cyberbullying, grooming, image-based abuse, misinformation, and other risks affecting children’s learning and well-being.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot

UNICEF event to examine AI learning outcomes

A gLocal Evaluation Week 2026 session will examine how to measure the impact of AI on learning outcomes for children and adolescents.

The event, titled ‘Measuring AI impact on learning outcomes’, is scheduled for 2 June and will focus on evidence gaps around AI use in education, particularly in Latin America and the Caribbean.

The session will discuss how AI is entering classrooms through personalised learning, tutoring, and teaching tools. UNICEF says some applications show promising results, but many AI tools used across the region lack rigorous impact-focused evaluation measures needed to assess whether they improve learning outcomes and can be scaled effectively.

The discussion will bring together government, research, and evaluation experts to assess existing evidence, identify promising results, and examine gaps in measuring AI’s contribution to learning outcomes at scale.

Participants will also consider unintended effects, including bias and the exclusion of marginalised groups. UNICEF says policymakers still face uncertainty over what works, for whom, and under what conditions when deciding whether to invest in AI tools for education.

Speakers listed for the session include Fiorella Haim of Ceibal, Martín Elías De Simone of the World Bank, Juliette Norrmen-Smith of UNICEF’s Office of Innovation, María Paz Monge of J-PAL-LAC, and Michael Craft of UNICEF. The event will include simultaneous Spanish-English interpretation.

Why does it matter?

The session highlights a key challenge in AI and education: adoption is moving faster than evidence. As AI tools enter classrooms, policymakers need stronger evaluation methods to determine whether they improve learning outcomes, work for different groups of children, and risk reinforcing bias or exclusion.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our Diplo chatbot!

G7 digital and technology ministers agree on priorities on AI, resilience and online child safety

G7 digital and technology ministers have agreed on priorities covering secure AI, AI openness, digital sector resilience and online safety for minors following a meeting in Paris under France’s presidency. Ministers said digital technologies are central to innovation, productivity and competitiveness, while also creating new challenges for users, businesses and service providers.

The statement reaffirmed support for Data Free Flow with Trust, while highlighting privacy, data protection, intellectual property and security considerations. Ministers also welcomed G7 work on semiconductors, digital standards, quantum technologies, and competition in AI inputs, including computing power, data, energy, and talent.

On AI, ministers said secure, responsible and trustworthy systems are needed to maintain public trust and support adoption. They welcomed the revised Hiroshima AI Process Reporting Framework and said France’s presidency would start discussions with stakeholders, the OECD, and members of the International Network for Advanced AI Measurement, Evaluation and Science to improve comparability between AI risk assessment frameworks.

The G7 also backed a Vision on AI Openness, intended to clarify terminology and support access to open-source and open-weight AI approaches. Ministers said AI openness can help diffuse AI, support research collaboration, and contribute to innovation and economic growth, while clearer language can reduce ambiguity and support trust.

Ministers also supported a G7 SME AI Readiness Tool, developed with the OECD and in cooperation with the G7 Social-Employment working group. The tool is expected to be made available through the G7 AI Training Hub to help micro, small and medium-sized enterprises assess their digital and AI readiness, improve AI literacy and lower adoption barriers.

The statement also addresses digital and AI sector resilience, resource efficiency and growing pressure on energy grids and digital infrastructure. On child online safety, ministers supported a Common G7 Set of Principles for a safe and secure digital space for minors, covering digital literacy, AI education, risk mitigation by digital service providers, support for parents and guardians, and protection against online harms.

Why does it matter?

The G7 statement reflects growing international coordination around AI governance, digital resilience and online child safety. By addressing AI risk assessment, openness, SME adoption and digital infrastructure pressures in one framework, ministers are linking technological innovation with trust, security and economic competitiveness.

The agreement also signals that online safety for minors is becoming a core part of digital policy cooperation among major economies, particularly as AI systems and digital platforms play a larger role in children’s online experiences.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our Diplo chatbot!

IWF and CaseScan partner to strengthen the detection of child abuse material

The Internet Watch Foundation has announced a new partnership with CaseScan aimed at improving the detection and identification of child sexual abuse material online.

CaseScan, a specialist technology company supporting child protection investigations and digital safety work, has joined the IWF as a member. The company develops tools that help specialist teams identify, classify, and prioritise illegal material more efficiently, reducing manual workloads and supporting faster responses when criminal content is found.

Through its membership, CaseScan will be able to draw on IWF intelligence and services to strengthen how it helps approved clients detect child sexual abuse material. The IWF said the collaboration will support faster identification of criminal content.

The partnership comes amid a rapidly evolving online threat landscape. According to the IWF’s 2025 Annual Data & Insights Report, new technologies, systemic vulnerabilities, and the continued distribution of child sexual abuse material are increasing the challenges faced by investigators and online safety organisations.

CaseScan said the collaboration will strengthen its ability to support professionals working on the front line of child protection investigations. The IWF said industry partnerships are essential to disrupting the criminal distribution of abusive images and videos and preventing the repeated victimisation of children online.

Why does it matter?

The partnership shows how child safety organisations and specialist technology providers are working to improve the speed and accuracy of CSAM detection. As the volume and complexity of illegal material online grow, trusted intelligence and specialist detection tools can help investigators and approved organisations prioritise cases, reduce manual review burdens, and respond more quickly to harmful content.

Would you like to learn more about AI, tech and digital diplomacyIf so, ask our Diplo chatbot!  

EU welcomes G7 adoption of online child protection principles

The European Commission has welcomed a new agreement by G7 digital and technology ministers on a shared set of principles aimed at improving online safety for children and teenagers. The principles reflect approaches already present in several EU initiatives, including measures focused on online safety, digital literacy and the protection of minors.

The principles build on existing EU measures, including the Digital Services Act, the Better Internet for Kids Strategy and the AI Act. They focus on improving online safety while safeguarding privacy, fundamental rights and access to digital opportunities.

The framework promotes safety-by-design measures, privacy-conscious age assurance tools, stronger protections against harmful and illegal content, parental controls, and digital literacy initiatives. It also promotes greater cooperation between technology companies, researchers, governments and civil society organisations.

Why does it matter?

Governments are increasingly examining how digital platforms, recommendation systems and generative AI tools affect children’s wellbeing, privacy and online experiences. Concerns about harmful content, exploitation and age-inappropriate services have prompted policymakers worldwide to explore new approaches to online child protection.

The G7 agreement signals growing international convergence around child safety principles, while emphasising the need to balance protection measures with privacy, fundamental rights and access to digital opportunities.

Would you like to learn more about AI, tech and digital diplomacyIf so, ask our Diplo chatbot!

G7 agrees on the first common principles on protecting children online

G7 digital ministers have agreed a shared set of principles for protecting children and young people from online harm for the first time, marking the first coordinated approach adopted by the group on the issue. The agreement, reached during talks in Paris, sets shared principles for addressing risks linked to harmful content, exploitation and the use of AI chatbots.

The principles call for stronger digital literacy, robust online safety practices by digital service providers and safety measures built into digital services from the start. The agreement also sets expectations for effective age assurance and closer cooperation between providers, children, parents and guardians.

Ministers also called for improved access to data and research on how digital services affect children’s well-being, including greater cooperation among platforms, researchers and families. UK Science and Technology Secretary Liz Kendall said: ‘The agreements we have reached today are an important step on that journey: outlining a shared approach to protecting our children, backing our small businesses to adopt AI, and ensuring AI is developed safely and responsibly.’

The G7 also reaffirmed its commitment to promoting trustworthy AI while continuing discussions on assessing and managing AI-related risks. Under France’s presidency, members agreed to continue discussions on a mutual understanding of AI risk assessment frameworks, including in relation to cyberattacks and chemical and biological capabilities.

Ministers also backed support for small and medium-sized enterprises to adopt AI through a tool developed with the Organisation for Economic Co-operation and Development (OECD). G7 members also agreed a Vision on AI Openness and committed to further work on AI-generated content detection, secure AI systems, trusted data flows, and resource-efficient digital and AI infrastructure.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our Diplo chatbot!

Digital citizenship education key focus at Council of Europe policy forum

The second European Forum on digital citizenship education has concluded in Strasbourg, bringing together policymakers, educators, civil society groups, youth organisations, and parents to discuss responsible participation in digital societies.

Participants examined practical approaches to digital citizenship education, with discussions focusing on AI in education, children’s rights online, critical thinking, inclusion, and safe participation in digital spaces. Particular attention was given to the role of parents and families in helping young people develop responsible and informed online behaviours.

The forum also contributed to preparations for the Council of Europe’s Road Map for strengthening digital citizenship education for 2027–2031. Stakeholders highlighted the need for closer cooperation between public authorities, the private sector, and civil society to support effective implementation.

Outcomes from the event will inform ongoing Council of Europe work to promote democratic values, human rights, and active participation in the digital era, while helping learners and education professionals respond to the growing influence of technology on society.

Why does it matter?

Digital citizenship education is becoming a strategic policy issue as societies try to ensure that technological change is matched by the skills needed for safe, informed, and responsible participation online. The Council of Europe forum links digital literacy with democratic participation, children’s rights, critical thinking, inclusion, and human rights-based digital transformation.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our chatbot!