Child safety online Archives | Page 5 of 86

UK’s Youth Justice Board highlights growing risks of online harms for children

The UK Youth Justice Board has published new evidence on how online harms affect children across England and Wales, warning that digital risks are increasingly linked to safeguarding, well-being and youth justice outcomes.

The Evidence and Insights Pack brings together research, data and practice examples to improve understanding of the risks children face online and how services can protect them more effectively.

The report says children face overlapping digital harms, including cyberbullying, sexual abuse, radicalisation, exploitation and the non-consensual sharing of intimate images. It also warns that harmful content and image-based abuse are becoming increasingly normalised among children, disproportionately affecting girls.

The YJB says many children who engage in problematic online behaviour have complex needs or have experienced abuse themselves. Weak platform design and limited digital literacy among adults can increase children’s vulnerability and make safeguarding more difficult.

The report calls for responses that go beyond criminal justice. It identifies promising approaches, including safety-by-design and teen-by-default platform measures, early intervention, harm-reduction responses, digital media and gaming literacy, healthy relationships education and gender-sensitive programmes.

The YJB also highlights strength-based interventions that promote belonging, critical thinking and positive identity building for children. It says such approaches can help reduce harm while avoiding unnecessary criminalisation.

The publication comes as the UK implements the Online Safety Act and prepares to ban social media for under-16s by spring 2027. The YJB said protecting children will require coordinated action across education, health, policing, local government, housing and social care.

Why does it matter?

The report strengthens the case for treating online harms as a safeguarding and public policy issue, not only a matter for platforms or the police. It shows that children can be victims, perpetrators and vulnerable participants in the same digital environments, especially where abuse, exploitation, misogyny or harmful content are normalised. The YJB’s focus on prevention and early support is important because punitive responses can deepen children’s contact with the justice system without addressing the underlying risks.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

Google proposes a balanced approach to AI governance in the US

Google has published a policy paper proposing a two-track approach to AI governance in the United States, separating oversight of frontier AI models from rules for widely deployed AI applications.

The paper argues that AI policy should avoid what Google describes as a false choice between over-regulation and no regulation. Instead, the company calls for a pragmatic, evidence-based framework that treats the most advanced AI systems differently from everyday AI tools such as chatbots.

For frontier AI, Google proposes the creation of a Frontier AI Regulatory Organisation, or FARO. The industry-funded body would operate under federal oversight and develop standards for safety, security, incident reporting and transparency.

Google says FARO could set scientific benchmarks for frontier capabilities, particularly in areas such as cybersecurity and chemical, biological, radiological and nuclear risks. It could also oversee independent audits and require frontier AI companies to publish and follow safety frameworks before releasing highly capable models.

For widely deployed AI applications, Google argues that the federal government should rely mainly on existing legal frameworks, with targeted updates where needed. The paper says policy should focus on real-world harms and outputs rather than micromanaging AI development.

The company identifies several priority areas, including workforce preparedness, child safety, information integrity, copyright, privacy and energy infrastructure for data centres.

Google supports measures such as AI interaction guidelines for children, disclosures that chatbots are not sentient, rules for self-harm-related queries, watermarking and provenance standards for generative AI, privacy-enhancing technologies and workforce reskilling.

The paper presents the model as a way to address national security and consumer protection risks while preserving US leadership in AI development.

Why does it matter?

Google’s paper is a significant industry intervention in the US AI policy debate. Its two-track model reflects a broader governance trend: frontier AI is increasingly being treated as a national security and safety issue, while everyday AI applications are being handled through consumer protection, child safety, privacy, copyright and labour policy. The proposal could influence federal discussions, but it also reflects Google’s own regulatory preferences, including industry-funded oversight, confidential audit reports and reliance on existing law for many AI applications.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

Canadian ministers to discuss Safe Social Media Act

Canadian Heritage will hold an in-person roundtable in Winnipeg on Bill C-34, the Safe Social Media Act, as the government continues public discussion on its proposed online safety framework.

The event will bring together Marc Miller, Minister of Canadian Identity and Culture and Minister responsible for Official Languages, and Adam van Koeverden, Secretary of State for Sport. Media representatives have been invited to attend the conclusion of the discussion, followed by an informal media availability.

The Safe Social Media Act was introduced on 10 June 2026 and would create new duties for social media services, AI chatbot services and other regulated online services. The government says the bill is intended to make platforms more responsible for addressing harmful content and creating safer online spaces, especially for children and young people.

The bill would enact the Digital Safety Act and establish the Digital Safety Commission of Canada. The proposed framework focuses on platform accountability, child protection, transparency and the prevention of online harms before they occur.

The legislation comes amid growing international debate over children’s access to social media, age restrictions, harmful content, platform design and the role of AI chatbots in online safety.

The Winnipeg roundtable signals continued government engagement with stakeholders as Bill C-34 moves through the parliamentary process.

Why does it matter?

Canada’s Safe Social Media Act is part of a wider global shift towards stronger online safety rules focused on children and young people. By covering social media services and AI chatbots, the bill reflects growing concern that harmful content, platform design and AI-driven interactions can affect child safety, mental health and exposure to exploitation. The proposed Digital Safety Commission would also create a new federal oversight structure for platform accountability.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our Diplo chatbot!

Ofcom strengthens online safety rules against cyberflashing and self-harm content

Ofcom has introduced stronger online safety measures requiring technology companies to take more robust action against cyberflashing and illegal self-harm content across dating, messaging and social media platforms.

The updated guidance builds on the UK’s Online Safety Act by expanding the obligations of online services to detect, moderate and reduce harmful content that disproportionately affects vulnerable users.

Under the revised measures, platforms must make it easier to report unsolicited sexual images, ensure moderation teams are adequately trained and resourced, remove illegal content more quickly and provide blocking and muting tools to help users manage unwanted interactions.

Companies must also strengthen safeguards against illegal self-harm content by reviewing recommendation algorithms, displaying crisis support information for relevant searches and improving reporting systems for harmful predictive search suggestions.

Ofcom also highlighted the growing threat posed by so-called ‘Com’ groups, criminal online networks that groom and manipulate victims into self-harm and other harmful behaviour.

Services offering direct messaging and presenting grooming risks will be expected to implement child safety defaults, ensuring minors can only receive messages from existing contacts. Additional measures targeting suicide and self harm content are expected later in 2026.

Technology companies must now review their online safety risk assessments and implement appropriate mitigation measures before the updated Codes take legal effect following parliamentary approval.

Ofcom said the strengthened framework reflects the evolving nature of online harms while reinforcing expectations that platforms proactively protect users from illegal and harmful content.

Why does it matter?

The updated Online Safety Codes reinforce a shift towards proactive platform accountability. Rather than relying primarily on user reports, online services are expected to identify risks, strengthen content moderation, improve safety-by-design features and reduce users’ exposure to illegal and harmful content before it spreads.

The measures also demonstrate how the UK is translating the Online Safety Act into detailed operational requirements. As regulators around the world consider similar approaches to platform governance, Ofcom’s implementation of risk assessments, child safety defaults and stronger moderation obligations could influence future online safety frameworks beyond the UK.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

Ireland expands Trusted Flagger network under the DSA

Ireland’s media regulator, Coimisiún na Meán, has granted Trusted Flagger status to three additional organisations under the EU Digital Services Act.

The Irish Internet Hotline, the Irish Music Rights Organisation and the Jewish Representative Council of Ireland will join the Central Bank of Ireland, which received Trusted Flagger status in 2025.

Each organisation will submit notices to online platforms within its area of expertise. The Irish Internet Hotline will report child sexual abuse material, non-consensual intimate image sharing, racism, xenophobia, financial scams and fraud. The Irish Music Rights Organisation will focus on copyright infringement, particularly music and lyrical copyright, while the Jewish Representative Council of Ireland will report illegal antisemitic material.

Under the Digital Services Act, Trusted Flaggers are recognised bodies that can notify platforms of illegal content. Platforms must give those notices priority and decide on them without undue delay, although the designation does not guarantee content removal.

Coimisiún na Meán said reports from Trusted Flaggers will also help identify online safety trends and support evidence-based supervision of online platforms.

To qualify, organisations must demonstrate expertise in detecting, identifying and notifying illegal content, operate independently from online platforms and carry out reporting activities diligently, accurately and objectively.

The three new accreditations will remain valid for 3 years and can be reviewed, revoked, or reassessed upon expiration of the accreditation period.

Why does it matter?

Trusted Flaggers are one of the practical enforcement mechanisms of the Digital Services Act. Ireland’s expansion of the network creates specialised reporting channels for different categories of illegal online content, including child sexual abuse material, non-consensual intimate images, scams, copyright infringement and antisemitic material. The model aims to improve the quality and speed of platform responses while keeping final moderation decisions with platforms under DSA procedures.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

IWF backs strengthened EU child protection rules on AI-generated abuse

The Internet Watch Foundation (IWF) has welcomed the political agreement on the revised EU Child Sexual Abuse Directive, saying the legislation marks an important step in strengthening Europe’s response to online child sexual abuse and exploitation.

The organisation says the updated rules address legal gaps created by emerging technologies, particularly the misuse of AI to generate child sexual abuse material.

The revised Directive introduces new criminal offences covering the design, adaptation, distribution and supply of AI systems intended to generate child sexual abuse material. It also criminalises the possession of AI-generated abuse content and materials that provide instructions for committing child sexual abuse.

The revised rules also strengthen protections against online grooming, including cases in which offenders falsely present themselves as children or peers, and extend limitation periods to give survivors more time to pursue justice.

The IWF argues that the legislation reflects the rapidly evolving threat posed by generative AI.

According to the IWF, realistic AI-generated child sexual abuse material increased sharply during 2025, with analysts reporting that many synthetic images and videos are becoming increasingly difficult to distinguish from authentic abuse material.

IWF warns that technological advances are accelerating the scale and sophistication of online child exploitation.

Following the political agreement, the IWF has urged EU member states to transpose the Directive into national law promptly, arguing that timely implementation will strengthen legal protections and law enforcement capabilities across the EU. The organisation argues that timely transposition will be essential to ensure stronger legal protections, improve law enforcement capabilities and reduce opportunities for offenders to exploit AI technologies across the EU.

Why does it matter?

The revised Directive reflects how advances in generative AI are reshaping criminal law and child protection policy. By introducing offences specifically targeting AI systems designed to generate child sexual abuse material, the EU is adapting its legal framework to address emerging forms of technology-enabled exploitation.

The agreement also highlights the growing need for legal systems to evolve alongside AI capabilities. Alongside new offences, the Directive strengthens protections for victims and expands tools available to law enforcement, illustrating how governments are updating criminal legislation to respond to increasingly sophisticated forms of online abuse while seeking greater consistency across EU member states.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

Child safety gaps in AI law flagged by Ireland’s Children’s Rights Alliance

The Children’s Rights Alliance has urged Irish authorities to strengthen protections for children against the risks posed by rapidly advancing AI technologies. The organisation argues that current regulatory efforts do not sufficiently protect young users from emerging digital risks.

The warning comes ahead of a parliamentary debate on the Regulation of Artificial Intelligence Bill, which is intended to support the implementation of the EU AI Act in Ireland.

Government officials have presented the legislation as a step towards ensuring that AI is developed and deployed in an ethical, transparent and accountable manner while reinforcing Ireland’s position as a European digital regulatory hub.

However, the Children’s Rights Alliance has criticised the proposed framework, arguing that it does not explicitly recognise children as a vulnerable group requiring additional safeguards. The organisation also warned that inadequately regulated AI systems could contribute to harms, including deepfakes, online exploitation and the generation of child sexual abuse material.

Advocates are calling for policymakers to prioritise child safety over industry interests as Ireland prepares for its EU Council Presidency. The group is also hosting a discussion on AI accountability, emphasising the need for stronger protections in future regulation.

Why does it matter?

The debate highlights growing concerns that AI governance frameworks may not adequately address the specific risks faced by children. As generative AI tools become more accessible and capable, they can amplify existing online harms while creating new challenges related to deepfakes, manipulation, exploitation and exposure to harmful content.

The discussion also reflects a broader policy question about how vulnerable groups should be protected within emerging AI regulation. Whether children are explicitly recognised within legal frameworks could influence future requirements for risk assessments, safety measures, accountability mechanisms and platform responsibilities. As governments around the world implement AI governance regimes, child protection is increasingly becoming a key test of whether regulation can keep pace with technological change.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our chatbot!

Spain advances law to protect minors in digital environments

Spain’s Minister for Youth and Children, Sira Rego, has said she expects the country’s Law for the Protection of Minors in Digital Environments to be approved by Congress in autumn 2026.

Rego said the bill responds to growing social concern over children’s safety online and the need to regulate digital spaces more effectively.

The bill is currently moving through the Congress of Deputies. Rego said Spain would have a pioneering law to regulate digital environments and that major platforms must take greater responsibility for practices that are especially harmful to children and adolescents.

The proposed law draws on recommendations from a 50-member expert committee convened by the Ministry of Youth and Children. The government says the framework is intended to strengthen the rights of minors in digital spaces, including privacy, reputation, image rights, access to truthful information and responsible technology use.

Measures in the bill include mandatory parental control systems for mobile devices, rules on loot boxes in video games and on platforms, and requirements for schools to regulate the use of mobile phones and digital devices.

The proposal would also introduce criminal law changes covering digital violence. These include penalties restricting aggressors from contacting victims online, offences linked to making pornography indiscriminately available to minors, and criminalisation of sexual or seriously degrading deepfakes.

Large audiovisual service providers and major influencers would also be required to provide reporting channels for inappropriate content, inform users about content that may harm minors, use effective age verification systems and separate pornographic or violent content from other material.

Why does it matter?

Spain’s proposal reflects a wider shift towards stronger child online safety regulation, moving beyond awareness campaigns towards legal duties for platforms, device makers, schools and digital service providers. The bill also shows how child protection debates are expanding from harmful content to design features, age assurance, deepfakes, loot boxes and digital violence. If adopted, it could become one of Europe’s more comprehensive national frameworks for protecting minors online.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

UNESCO launches media literacy guide for families in the digital age

UNESCO has launched a global media literacy guide to help parents, caregivers, and families support children’s safe, informed and critical engagement with digital environments.

The guide, titled Growing Up in a Connected World: A Family Guide for the Digital Age, was launched at UNESCO Headquarters and online, attracting around 700 participants. It is available in English, French, and Spanish.

Developed by UNESCO in partnership with the French Media and Information Literacy Centre, CLEMI / Réseau Canopé, the guide is intended to equip families with media and information literacy skills to help guide children’s digital engagement.

UNESCO said the initiative comes amid growing global debate over whether younger users’ access to social media should be restricted or, in some cases, prohibited altogether. The organisation said such debates reflect broader concerns about safety, wellbeing and exposure to harmful content, but also underline the need to help young people navigate digital spaces safely, critically, and confidently.

The guide addresses both opportunities and risks linked to digital technologies. UNESCO said digital technologies can expand access to knowledge, participation and connection, but can also expose children to cyberbullying, harmful content, misinformation, and hate speech.

Khaled El-Enany, Director-General of UNESCO, said, ‘UNESCO promotes robust, evidence-based Media and Information Literacy policies. There is progress: UNESCO’s 2025 global survey shows that 171 countries now have a MIL policy framework. However, implementation remains uneven, with fewer than half of countries integrating media and information literacy into school curricula. As a result, too many children still receive no structured support at all. And when schools cannot fill this gap, the responsibility falls on families.’

Samuel Vitel, Director General of Réseau Canopé, said, ‘It is often through dialogue with parents that children learn to question information, compare different perspectives, and develop their critical thinking skills. This is why parents need support, just as we already provide it to teachers and to all education stakeholders.’

UNESCO said families are increasingly at the centre of today’s information ecosystems as digital and political transformations reshape society. The organisation said regulatory approaches such as safety by design remain important, but are not sufficient on their own.

The guide is designed to place practical tools directly in the hands of parents and caregivers. UNESCO said the aim is to support informed decision-making, strengthen autonomy within family life, and help families guide digital practices at home.

Mariya Gabriel, UNESCO Assistant Director-General for Communication and Information, said, ‘This new Guide serves as a common foundation of knowledge that every parent should be able to access. Its publication today is, therefore, not the end of our work, but the beginning.’

UNESCO also highlighted the growing influence of AI on information consumption and communication practices. Citing research from the Reuters Institute, it said 15% of young adults aged 18 to 24 use AI weekly to access news, compared with 3% of older users.

The organisation called on regulators, media organisations, experts, and other stakeholders to help empower parents, children, and young people to navigate information ecosystems critically and confidently.

UNESCO said media and information literacy remains one of its core global programmes. Through these initiatives, UNESCO and its partners aim to strengthen critical thinking skills and digital competencies in response to rapid technological change.

Why does it matter?

The guide matters because debates over children’s online safety are moving beyond restrictions and platform rules alone. UNESCO’s approach places media literacy at the centre of child protection, arguing that young people also need support to understand information, assess risks, and navigate digital spaces critically.

It also highlights the role of families in digital governance. Where schools have not yet integrated media and information literacy into curricula, parents and caregivers often become the first line of support against misinformation, harmful content, cyberbullying, and AI-shaped information environments.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our Diplo chatbot!

EU agrees tougher child protection rules against AI-generated abuse

The agreement between the European Parliament and the Council updates legislation first adopted in 2011, reflecting the growing role of digital technologies and AI in facilitating abuse.

Under the revised directive, designing, adapting or distributing AI systems intended to generate child sexual abuse material would become a criminal offence. The updated rules would also cover deepfake abuse material, livestreamed child sexual abuse, sexual extortion, and the possession or distribution of instructions on how to commit such crimes.

The agreement also strengthens rules on consent. It clarifies that consent must be given voluntarily, cannot be inferred from silence, lack of resistance or a previous relationship, and can be withdrawn at any time.

Grooming offences would be expanded to cover situations involving coercion, threats or deception, including cases where offenders falsely present themselves as peers of the child.

Victim protection would also be strengthened through access to healthcare, legal aid, helplines, accommodation support and compensation mechanisms. The agreement also extends limitation periods, recognising that many victims need years or decades before reporting abuse.

The revised directive still requires formal adoption by the European Parliament and the Council before entering into force.

Why does it matter?

The agreement shows how EU criminal law is being adapted to AI-enabled and online forms of child sexual abuse. Criminalising AI systems designed to generate abusive material is especially significant because it targets not only harmful content but also the tools used to produce it. The revised directive also strengthens victim support and prosecution timelines, addressing the reality that many survivors report abuse years after it occurred.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!