Child safety online Archives | Page 3 of 86

IWF and NCA urge parents to protect children’s photos from AI misuse

The Internet Watch Foundation (IWF) and the UK’s National Crime Agency (NCA) have launched new guidance urging parents and carers to better protect images of their children online, warning that criminals are increasingly using AI to turn publicly available photographs into child sexual abuse material.

The campaign responds to a sharp rise in AI-generated child sexual abuse material and aims to help families make more informed decisions about sharing children’s image online and obtaining their consent.

The guidance accompanies a public awareness campaign across Facebook, Instagram and YouTube, encouraging families to review privacy settings, reconsider who can access children’s photographs and discuss image consent with young people.

Parents are encouraged to regularly review whether they are comfortable sharing images online, limit access through private groups where appropriate, and talk openly with their children about AI-generated imagery, deepfake nudes and online safety.

The campaign follows growing evidence that offenders are exploiting publicly accessible family and school photographs.

The IWF recently helped prevent the circulation of more than 100 AI-generated sexual images created from photographs taken from a UK school’s website after criminals attempted to blackmail the school. According to the organisations, even ordinary family photographs can now be manipulated into realistic abuse material without the knowledge of children or their parents.

The scale of the threat has grown significantly. The IWF identified 8,029 AI-generated child sexual abuse images and videos in 2025, a 14% increase on the previous year.

AI-generated videos increased from just 13 identified in 2024 to 3,443 in 2025, with nearly two-thirds classified as the UK’s most severe Category A abuse material.

The IWF argues that technology companies must strengthen safeguards around AI image generation tools before release, while continuing to support law enforcement efforts to combat online child exploitation.

Why does it matter?

Generative AI has made it significantly easier to create realistic child sexual abuse material from ordinary photographs, fundamentally changing the online child protection landscape. Images shared on social media, school websites or other public platforms can now be manipulated without a child’s knowledge, creating new risks for families and increasing the burden on law enforcement and child protection organisations.

The campaign also highlights that preventing AI-enabled abuse requires more than criminal enforcement. Stronger safeguards in AI image-generation tools, improved privacy practices, greater parental awareness and better digital literacy around image sharing and consent are all becoming essential components of online child safety.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

Pew survey finds majority support social media ban for under-16s

A Pew Research Center survey has found that 56% of US adults support banning children under 16 from using social media sites.

The survey, conducted from 26 May to 1 June 2026 among 9,750 US adults, found that 21% oppose such a ban, while 23% are unsure.

Pew said the findings come as governments around the world weigh stronger restrictions on teenagers’ use of social media.

Support for an under-16 ban extends across major demographic and partisan groups. Pew found that 65% of parents with a child under 18 support the measure, compared with 52% of adults without a child under 18.

Support is also higher than opposition among both Republicans and Democrats. Pew reported that 59% of Republicans and Republican-leaning independents support the ban, compared with 54% of Democrats and Democratic-leaning adults.

The survey also found broad support for other measures aimed at minors’ social media use. Around 85% of US adults support requiring parental consent for minors to create social media accounts, while 78% support age verification and 78% support time limits for minors.

Support for these measures has increased since 2023, according to Pew, especially for age verification and time limits.

Why does it matter?

The findings suggest that child online safety restrictions are gaining wider public support in the United States, including across party lines and among adults without children. That could give lawmakers more political space to propose age verification, parental consent and time-limit rules. The survey also shows that support is not limited to outright bans: many Americans favour a broader set of safeguards that would change how platforms verify age and manage minors’ access.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our Diplo chatbot!

EU examines harmful design features in online platforms

The second annual report on systemic risks under the Digital Services Act has highlighted online risks faced by children and young people on very large online platforms and search engines.

The report was published by the Board for Digital Services and developed in cooperation with the European Commission. It provides an overview of recurrent systemic risks in the EU for very large online platforms and search engines.

Risks identified in the report include the spread of illegal content, cyberbullying, grooming and exposure to harmful material such as dangerous viral challenges and adult content.

The report also points to the role of platform design. Interface features and recommender systems can contribute to addiction-like behaviour, increase exposure to harmful content and intensify harmful interactions between users.

Platforms have introduced mitigation measures, including targeted protection tools, content moderation systems and user empowerment features.

The Commission said the report reinforces the role of the DSA as a transparency and accountability tool for understanding how online platforms function and shape risks in society.

The findings will support regulators, civil society, and platforms as the EU continues to monitor DSA implementation and efforts to create a safer online environment for minors.

Why does it matter?

The report shows that the EU platform regulation is moving beyond illegal-content takedown towards a broader assessment of systemic risks created by platform design. For children and young people, recommender systems, interface choices and engagement-driven features can shape exposure to harmful content and unsafe interactions at scale. The DSA reporting process, therefore, provides regulators and civil society with a clearer evidence base for assessing whether very large platforms are doing enough to protect minors.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our chatbot!

India and Japan expand strategic AI partnership

India and Japan have agreed to deepen cooperation on AI, linking AI governance, cybersecurity, infrastructure, research and talent development.

In a joint statement, the two countries described AI as a transformative technology with long-term implications for innovation, economic security, governance and the international order.

Both sides are committed to building a safe, secure, trustworthy, inclusive and human-centric AI ecosystem. They also agreed to strengthen cooperation with partners in the Indo-Pacific and the Global South.

The statement identifies international AI governance, safety and cybersecurity as priority areas. India and Japan said they would coordinate in forums including the G20, OECD, Global Partnership on AI and the UN, while supporting responsible innovation and risk-based governance.

The two countries also agreed to cooperate on AI-enabled cybersecurity and the security of AI systems, with particular attention to critical infrastructure. They highlighted the need for safeguards to ensure AI supports children’s learning and growth rather than causing harm.

AI infrastructure is another focus. India and Japan will strengthen cooperation on data centres, GPU and other compute resources, semiconductors and trustworthy supply chains across the AI technology stack.

The statement also supports collaboration on multilingual, open-source and domain-specific AI models, including models for native languages and public-interest applications. Several memoranda were signed, including partnerships involving IIT Bombay, BharatGen, Japan’s National Institute of Informatics, Sarvam, Preferred Networks, IndiaAI and Japan’s Ministry of Economy, Trade and Industry.

Both sides also committed to researcher exchanges, industry-academia collaboration and talent mobility. Japan reaffirmed its goal of welcoming 500 highly skilled AI professionals from India by 2030.

Why does it matter?

The joint statement shows how AI cooperation is becoming part of broader economic and security strategies in the Indo-Pacific. India and Japan are not only discussing AI governance, but also the infrastructure and supply chains needed to build and deploy AI systems, including compute, semiconductors, data centres and talent. The focus on multilingual and open-source models also matters for countries seeking AI systems that reflect local languages, public-interest needs and Global South priorities.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our chatbot!

Council of the EU backs interim rules on online child abuse detection

The Council of the European Union has adopted its position on interim legislation that would restore a legal basis for online service providers to voluntarily detect, report and remove child sexual abuse material (CSAM) from their platforms.

The proposal aims to restore legal certainty after the previous temporary framework expired on 3 April 2026, while negotiations continue on a permanent EU regulation to combat online child sexual abuse.

The interim regulation introduces a limited derogation from the EU’s electronic communications privacy rules, allowing online platforms to voluntarily detect child sexual abuse material and report suspected offences to law enforcement authorities.

According to the Council, these voluntary measures are essential for identifying children at risk, supporting criminal investigations, prosecuting offenders and reducing the circulation of child sexual abuse material online.

The Council proposes extending the temporary framework until 3 April 2028 to avoid a prolonged legal gap while negotiations continue on the long-term Child Sexual Abuse Regulation.

Irish Minister for Justice, Home Affairs and Migration Jim O’Callaghan said restoring providers’ ability to detect online child sexual abuse is essential to protecting victims and bringing offenders to justice. The proposal will now move to the European Parliament for a second reading, where MEPs may approve, amend or reject the Council’s position.

If adopted, the measure would restore the legal basis for voluntary detection activities while policymakers continue negotiations on a permanent framework governing the detection of child sexual abuse material across digital services in the European Union.

Why does it matter?

The proposal addresses a legal gap that emerged after the previous temporary framework expired, creating uncertainty for online platforms that voluntarily detect and report child sexual abuse material. Restoring a clear legal basis would allow providers to continue supporting law enforcement while longer-term legislation is negotiated.

The debate also reflects the EU’s continuing effort to balance child protection with privacy and fundamental rights. While the interim proposal focuses on voluntary detection, negotiations on a permanent framework are expected to continue raising questions about the appropriate balance between online safety, privacy and the responsibilities of digital platforms.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

Europol Roblox game wins EU award for online child safety

Europol’s Cyber Defenders initiative has won the 2026 European Ombudsman Award for Good Administration.

The free educational game, built on Roblox, is designed to help children recognise online risks and develop safer behaviour in digital environments.

Cyber Defenders received the overall award, selected from 48 nominations submitted by the EU institutions, bodies and agencies. It also won the Excellence in Technological Innovation and the Use of AI category award.

The game teaches children about risks such as fraud, identity theft and online grooming through interactive missions rather than traditional awareness campaigns.

Europol says the project was developed to reach children in online gaming environments they already use, while making them more comfortable asking for help when they encounter risks.

The agency has also published supporting resources for teachers, parents and schools, including a game guide, lesson assessment, poster and letter to parents.

The award follows earlier recognition of Europol digital initiatives, including Trace An Object, which uses public participation to help identify victims of child sexual abuse.

Why does it matter?

Cyber Defenders shows how law enforcement agencies are experimenting with interactive tools to improve children’s digital safety skills. Game-based learning can make online safety more relevant for younger users, especially in gaming environments where risks such as grooming, scams and identity theft may appear. The award also reflects broader recognition that digital literacy and prevention are part of child online safety, alongside regulation, enforcement and platform accountability.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

IWF warns under-16 social media ban is not enough to stop online abuse

The Internet Watch Foundation (IWF) has welcomed the UK government’s decision to restrict social media access for under-16s but argues that the measure alone will not significantly reduce online child sexual exploitation and abuse.

In a new blog, IWF Chief Executive Kerry Smith describes the proposed ban as a major policy milestone while warning that it must be accompanied by broader reforms if it is to deliver lasting improvements in children’s online safety.

According to the IWF, children continue to face a rapidly evolving range of online threats, including grooming, financial sextortion, commercial child sexual abuse and the growing exploitation of young people across digital platforms.

While limiting access to social media may reduce exposure to some risks, the organisation argues that determined offenders will continue to exploit encrypted messaging services, gaming platforms and other online environments if wider safeguards are not introduced.

The charity therefore calls for a more comprehensive regulatory approach centred on safety by design. Its recommendations include stronger safeguards for end-to-end encrypted services, tougher enforcement of the UK’s Online Safety Act, greater accountability for technology companies, and platform design that prevents harmful products and features from reaching users before risks are identified.

The IWF also highlights the need to regulate emerging technologies such as AI chatbots and strengthen device-level protections for children.

Why does it matter?

The IWF’s position reflects a growing international consensus that age restrictions alone cannot address the complex ecosystem of online child exploitation. As abuse increasingly migrates across encrypted services, gaming platforms and AI-powered technologies, policymakers are being encouraged to adopt broader regulatory frameworks that target platform design as well as user access.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

US House of Representatives passes Kids Internet and Digital Safety Act

The US House of Representatives has passed the Kids Internet and Digital Safety Act in a bipartisan 267-117 vote, advancing a broad package that combines 14 online child safety proposals into a single piece of legislation.

The legislation includes provisions requiring AI chatbots to remind users they are not human, provide mental health resources, encourage regular breaks and avoid promoting potentially harmful topics. Lawmakers also removed the original Kids Online Safety Act’s proposed ‘duty of care’ provision after concerns it could lead to censorship, a decision criticised by several senators who co-authored the earlier bill.

Critics, including digital rights organisations and several lawmakers, argue the legislation weakens existing protections and does not go far enough in holding technology companies accountable. The Electronic Frontier Foundation warned that compliance could encourage widespread age verification, potentially requiring users to submit personal information and raising concerns about privacy and freedom of expression.

Supporters reject those criticisms, arguing that the bill does not explicitly require age verification but instead strengthens safeguards for minors and expands parental controls. The legislation now moves to the Senate, where it is expected to face further scrutiny.

Why does it matter?

The legislation represents one of the most comprehensive federal efforts to strengthen online child safety in the United States. Its inclusion of AI chatbot requirements reflects growing recognition that conversational AI introduces new risks for younger users that existing online safety frameworks were not designed to address.

At the same time, the bill highlights the continuing challenge of balancing child protection with privacy and freedom of expression. As it moves to the Senate, debate is likely to focus on whether stronger platform accountability can be achieved without expanding age verification requirements or creating incentives for broader online censorship.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

France and WHO call for stronger safeguards for children online

French President Emmanuel Macron and World Health Organization Director-General Tedros Adhanom Ghebreyesus have called for stronger governance of digital environments to protect children’s health and well-being.

In a joint statement, they argued that social media, gaming platforms, AI and other digital services are increasingly shaping children’s physical, mental and social development.

The authors said digital technologies can support education, healthcare access, creativity and social inclusion, especially for children in remote or disadvantaged communities. However, they argued that these benefits depend on how digital services are designed, regulated and governed.

The statement warns that excessive or poorly governed digital exposure can be linked to anxiety, depression, sleep disruption, sedentary behaviour, online exploitation, harmful content and misinformation amplified by recommendation systems.

Macron and Tedros also describe generative AI as a force multiplier for both opportunity and risk. They said AI could support education, accessibility and healthcare, but warned that its long-term effects on children’s emotional development, relationships and well-being remain uncertain.

The authors pointed to growing international momentum behind child online safety measures, including age restrictions, stronger age assurance and safety-by-design standards.

They called on governments, technology companies, researchers, educators and civil society to build healthier digital ecosystems through regulation, transparency, independent research and stronger safeguards for children.

Why does it matter?

The intervention places child online safety within the language of public health. That broadens the debate beyond content moderation and screen-time advice to include platform design, recommendation systems, business models, AI deployment and digital governance. It also reflects growing international pressure for age-appropriate design, stronger age assurance and safety-by-design rules, while leaving open difficult questions about privacy, enforcement and children’s access to beneficial digital services.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

UNICEF warns millions of children rely on AI for advice and learning

Millions of children worldwide are already using AI for learning, problem-solving and personal guidance, according to UNICEF, which warns that safeguards are not keeping pace with adoption. Data collected across 10 countries suggests that at least 20 million children have used AI tools, with adoption rates significantly higher than among adults.

UNICEF estimates that around 13 million children use AI to support schoolwork, while approximately two million turn to it for advice on personal concerns. The organisation warns that AI is becoming embedded in children’s lives faster than safeguards and oversight mechanisms are being developed.

Young users also reported concerns about misinformation, scams and AI-generated deepfakes. UNICEF is calling on governments and technology companies to strengthen regulation, improve digital literacy and ensure AI systems are designed with children’s rights and safety in mind.

Why does it matter?

The findings suggest that AI is already becoming part of children’s everyday lives, influencing how they learn, seek information and even look for personal support. As adoption accelerates, the gap between technological use and effective safeguards could expose young users to misinformation, manipulation, privacy risks and other online harms.

The report also highlights the growing importance of child-centred AI governance. Decisions made now on regulation, digital literacy and safety-by-design are likely to shape how future generations interact with AI, making children’s rights an increasingly important consideration in global AI policy.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our chatbot!