Content Policy Archives | Digital Watch Observatory

EU agrees tougher child protection rules against AI-generated abuse

The agreement between the European Parliament and the Council updates legislation first adopted in 2011, reflecting the growing role of digital technologies and AI in facilitating abuse.

Under the revised directive, designing, adapting or distributing AI systems intended to generate child sexual abuse material would become a criminal offence. The updated rules would also cover deepfake abuse material, livestreamed child sexual abuse, sexual extortion, and the possession or distribution of instructions on how to commit such crimes.

The agreement also strengthens rules on consent. It clarifies that consent must be given voluntarily, cannot be inferred from silence, lack of resistance or a previous relationship, and can be withdrawn at any time.

Grooming offences would be expanded to cover situations involving coercion, threats or deception, including cases where offenders falsely present themselves as peers of the child.

Victim protection would also be strengthened through access to healthcare, legal aid, helplines, accommodation support and compensation mechanisms. The agreement also extends limitation periods, recognising that many victims need years or decades before reporting abuse.

The revised directive still requires formal adoption by the European Parliament and the Council before entering into force.

Why does it matter?

The agreement shows how EU criminal law is being adapted to AI-enabled and online forms of child sexual abuse. Criminalising AI systems designed to generate abusive material is especially significant because it targets not only harmful content but also the tools used to produce it. The revised directive also strengthens victim support and prosecution timelines, addressing the reality that many survivors report abuse years after it occurred.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

IWF challenges misconceptions about child abuse detection technologies

The Internet Watch Foundation (IWF) has published a new analysis aimed at countering what it describes as persistent misconceptions about technologies used to detect child sexual abuse material (CSAM) online.

According to the organisation, public discussions increasingly focus on privacy and surveillance concerns while overlooking the role these technologies play in identifying and removing illegal content at scale.

The article argues that detection tools are not experimental technologies but rather adaptations of established cybersecurity methods already used throughout the digital ecosystem.

The IWF highlights hash matching technologies, which compare the mathematical signatures of files against databases of known illegal content, as a long-established and widely used approach to content detection.

The IWF stresses that these systems do not involve mass surveillance and do not require access to the contents of private communications.

The organisation also points to perceptual hashing technologies such as PhotoDNA, which can identify known abuse images even when files have been modified or resized. Similar approaches are commonly used in cybersecurity for malware detection, phishing prevention and file verification.

According to the IWF, the principles behind child protection technologies are therefore consistent with existing online security practices.

The article further argues that no single technology can effectively address the challenge of child sexual abuse material online. Instead, platforms require multiple layers of protection, including known-content detection, identification of previously unknown material, behavioural analysis, reporting mechanisms and human moderation.

The IWF warns that limiting detection capabilities would reduce the ability of platforms and law enforcement authorities to identify abuse and protect victims.

Why does it matter?

The publication contributes to an increasingly important policy debate over how to balance privacy, encryption and child protection online. As governments consider new online safety laws and content moderation requirements, questions about whether detection technologies constitute surveillance have become central to discussions involving regulators, technology companies and civil society groups.

The IWF’s intervention also highlights a broader governance challenge. While privacy advocates warn against measures that could weaken encryption or expand monitoring, child protection organisations argue that effective detection capabilities remain essential for identifying abuse, removing illegal content and supporting law enforcement investigations. The outcome of these debates could shape future approaches to online safety, platform accountability and digital rights worldwide.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

UNESCO launches consultation on fair compensation for news in the AI era

UNESCO has launched a global consultation on its Draft Guidance on Fair Compensation for News, seeking input on how journalism should be remunerated as digital platforms and AI systems increasingly rely on news content.

The draft guidance argues that the media sector is undergoing significant structural change, including declining funding for public-interest journalism and the contraction or closure of local and community news outlets.

According to UNESCO, a small number of major digital platforms and AI companies now play a central role in content discovery, audience access, and digital advertising markets. These developments have significantly altered the economic conditions in which journalism operates.

Governments, regulators, media organisations, civil society groups, academics and other stakeholders are invited to submit feedback until 30 July. UNESCO will also hold regional online roundtables to gather additional input.

The initiative builds on UNESCO’s 2023 Guidelines for the Governance of Digital Platforms and its broader work on AI governance and media sustainability. UNESCO expects to publish the final guidance, together with a summary of consultation contributions, later this year.

Why does it matter?

The consultation reflects growing international concern about the sustainability of journalism in a digital environment increasingly shaped by large technology platforms and AI systems. As news content is used to power search engines, recommendation systems and generative AI applications, policymakers and media organisations are debating how value created from journalistic work should be shared with the publishers and journalists who produce it.

The initiative also sits at the intersection of media policy, platform governance and AI regulation. Questions surrounding compensation, transparency and access to content are becoming increasingly important as AI systems change how people discover and consume news. UNESCO’s guidance could help inform future regulatory approaches and industry practices aimed at supporting independent journalism while preserving an open and innovative digital ecosystem.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our Diplo chatbot!

Spain reports higher removal of online hate speech content

Spain’s Observatory on Racism and Xenophobia identified 31,003 pieces of hate speech and discriminatory content on social media in May 2026, according to its monthly monitoring report.

The Observatory, known as OBERAXE, said digital platforms removed 65% of notified content, up from 56% in April. TikTok, X and Instagram recorded the highest removal rates, while the Trusted Flagger route continued to perform better than ordinary user reporting.

Trusted Flagger notifications accounted for 53% of removed content, compared with 48% in April. Content reported through ordinary user channels reached a removal rate of 12%, up from 8% the previous month.

The report found that 73% of detected content presented targeted groups as a threat, while dehumanising and severely degrading messages increased sharply compared with April. It also recorded frequent use of aggressive language and growing reliance on images, videos, memes and coded expressions.

People from North Africa remained the main target of online hate speech, followed by African and Afro-descendant people and Roma people. Narratives linked to citizen insecurity accounted for the largest share of detected content, followed by content related to social benefits and access to public resources.

OBERAXE said continued cooperation with digital platforms is essential to improve detection, removal procedures and policies aimed at combating discrimination online.

Why does it matter?

The report shows how hate speech monitoring is becoming part of platform governance and anti-discrimination policy. Spain’s data suggest that trusted reporting channels can improve removal rates, but the scale and persistence of hostile narratives show the limits of reactive moderation. The findings also raise wider questions about transparency, platform accountability and how governments can address online hate while protecting freedom of expression.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

Ofcom fines adult site over age check failures

Ofcom has imposed an £80,000 fine on pornography provider First Time Videos LLC after finding that the company failed to implement legally required age assurance measures under the Online Safety Act.

The regulator concluded that the provider failed to implement the ‘highly effective’ age assurance measures required to prevent children from accessing pornographic content. According to Ofcom, robust age assurance measures are a central requirement of the UK’s online safety framework and play a key role in protecting minors online.

Alongside the enforcement action, Ofcom announced its provisional view that xgroovy.com may also have failed to comply with age assurance obligations under the legislation. The regulator further expanded an existing investigation into Sun Social Media Inc. to cover an additional adult website operated by the company.

Ofcom said the penalty was determined with regard to the size and turnover of the service, ensuring that the sanction remained proportionate while reinforcing compliance expectations across the sector.

Why does it matter?

The decision marks an important milestone in the implementation of the UK’s Online Safety Act, demonstrating that age assurance requirements are moving beyond policy commitments into active regulatory enforcement. By imposing financial penalties on non-compliant providers, Ofcom is signalling that online platforms hosting adult content will be expected to adopt effective measures to prevent children’s access.

The case also reflects a broader international trend towards stronger child online safety regulation. Governments and regulators increasingly view age assurance technologies as a key tool for protecting minors in digital environments, while balancing concerns around privacy, proportionality and implementation. Future enforcement actions could shape how platforms design and deploy age verification systems both in the UK and beyond.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

Beijing publishing forum calls for AI copyright standards

Publishing leaders and professionals have called for clearer copyright rules and industry standards for the use of AI in publishing, following discussions at the 2026 International Publishing Forum in Beijing.

The forum, held during the Beijing International Book Fair, brought together nearly 300 publishing executives and professionals from 26 countries and regions. It was jointly organised by the Publishers Association of China and the International Publishers Association.

Participants discussed how AI is reshaping publishing workflows, content production and distribution. They said AI should support, rather than replace, human creativity, with human-machine collaboration helping publishers improve efficiency and expand access to high-quality content.

Speakers also warned that the industry must protect intellectual property, preserve the authenticity and credibility of content, and support linguistic diversity as AI-generated material becomes more widely used.

Participants called for international cooperation on standards and copyright frameworks for AI applications in publishing. They said such rules should define rights and responsibilities, support fair compensation and ensure source traceability.

The discussions reflect growing concern in the publishing sector over how AI systems use copyrighted works, how original creators are recognised, and how publishers can maintain trust in content as synthetic media and automated production tools spread.

Why does it matter?

The forum highlights a central concern for creative industries: AI can improve publishing workflows and content distribution, but it also raises unresolved questions about copyright, attribution, compensation and authenticity. For publishers and authors, clear standards on source traceability and rights could become essential as AI-generated or AI-assisted content becomes more common.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

Eurostat report highlights online hate speech exposure in the EU

More than half of young internet users in the EU encountered hostile or degrading online content in 2025, according to Eurostat data published to mark the International Day for Countering Hate Speech.

Eurostat said 54.0% of internet users aged 25 to 34 and 53.7% of those aged 16 to 24 had encountered hostile or degrading messages during the previous three months. Exposure declined with age, falling to 46.4% among people aged 35 to 44, 38.9% among those aged 45 to 54, 32.8% among those aged 55 to 64, and 28.1% among people aged 65 to 74.

Among internet users aged 16 to 24, young women reported higher exposure than young men, at 57.2% compared with 50.4%. Eurostat said the pattern was observed across all types of hostile or degrading messages.

For both young women and young men, the most commonly reported hostile messages related to political or social views and racial or ethnic origin. The largest gender gaps were recorded for messages concerning sexual orientation, sex and disability.

Eurostat said hostile or degrading content may be directed at respondents or at other people, and can include messages, comments, photos, memes, videos and other online material.

The findings underline the scale of online hostility facing younger internet users in the EU and the continuing challenge for policymakers, platforms and civil society organisations working on digital safety and content governance.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

Research highlights growing use of AI chatbots for news

The growing use of generative AI tools such as ChatGPT and Google Gemini is beginning to reshape how audiences discover, access and engage with news, according to new research. While still representing a minority behaviour, usage is expanding rapidly across global markets, particularly among younger audiences and highly engaged news consumers.

Weekly use of AI chatbots for news has increased in recent years, although only around 1% of users currently identify them as their primary news source. Engagement is highest among news-interested and politically active users, while trust remains low overall but is higher among those already using AI tools.

Survey data suggests that users primarily turn to chatbots to ask follow-up questions, simplify complex stories, summarise information and evaluate the reliability of sources. Motivations include speed, clarity, and deeper contextual understanding, reflecting a shift toward more interactive and personalised news consumption.

The findings also raise concerns for publishers, as AI chatbots can answer user queries directly within their interfaces, potentially reducing referral traffic to news websites. Although search engines and social media remain the dominant sources of referral traffic, AI-powered ‘answer engines’ may push news organisations to invest more heavily in original reporting, verification and distinctive content that is harder to replicate through automated summaries.

Why does it matter?

The findings point to a significant shift in the digital information ecosystem. AI chatbots are changing how people discover and consume news by replacing traditional search and feed-based navigation with conversational interfaces that provide direct answers, summaries and contextual explanations.

This trend has important implications for journalism and platform governance. If users increasingly obtain information through AI intermediaries rather than visiting publisher websites directly, news organisations could face declining traffic, reduced advertising revenues and lower visibility for original reporting. At the same time, AI platforms may gain greater influence over how information is selected, interpreted and presented, raising questions about transparency, attribution, accuracy and media pluralism in the digital age.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our chatbot!

Study raises concerns over AI-generated content on TikTok

New research from Kapwing suggests that AI-generated content now accounts for a significant share of videos shown on TikTok, raising concerns about content quality, authenticity and misinformation. The study suggests that nearly 59% of videos served to new users can be classified as AI-generated ‘slop’, with similarly high levels reported in feeds aimed at children.

Analysis across thousands of videos found that AI-generated material is particularly concentrated in the Kids category, where it accounts for around 57% of content. Science, education and health-related content also showed comparatively high levels of AI-generated production, while categories such as fitness, music and fashion remained largely dominated by human creators.

Researchers warn that the growing volume of AI-generated content could undermine information quality and increase exposure to misleading, repetitive or low-value material, particularly among younger audiences. Concerns focus on how algorithmic recommendation systems amplify such content, shaping early viewing experiences for new users.

In response, TikTok has introduced tools allowing users to adjust the amount of AI content in their feeds and launched initiatives aimed at improving AI literacy. Despite these measures, the findings suggest that AI-generated videos are becoming an increasingly prominent feature of the short-form social media ecosystem.

Why does it matter?

The findings highlight how generative AI is reshaping online content ecosystems by dramatically lowering the cost and effort required to produce large volumes of media. As recommendation algorithms prioritise engagement and scale, AI-generated content can spread rapidly, influencing what users see and how information is consumed.

The trend also raises broader questions about platform governance, content moderation and digital literacy. If synthetic content becomes increasingly difficult to distinguish from human-created material, platforms may face growing pressure to improve labelling, verification and recommendation systems. The issue is particularly significant for younger users and for content categories such as education, science and health, where misinformation can have wider societal consequences.

Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our chatbot!

IWF backs Pope Leo XIV call for responsible AI development

The Internet Watch Foundation has welcomed Pope Leo XIV’s reflections on AI, arguing that AI systems must be developed with stronger safeguards to protect children from abuse.

In a blog post, the IWF said the Pope’s message that technology should serve the common good and remain subject to human judgement and accountability reflects the risks its analysts are already seeing online.

The organisation warned that AI is being used to generate highly realistic child sexual abuse images and videos at scale. It said the number of AI-generated child sexual abuse videos identified by the IWF in 2025 increased by more than 260%, with nearly two-thirds falling into the most severe category of abuse.

The IWF also raised concerns about AI-nudification tools, which can generate realistic sexualised images of children and other individuals. Following the Child Dignity in the Artificial Intelligence Era conference in Rome, the organisation joined more than 100 organisations and individuals in supporting calls for a global ban on such tools.

The IWF said AI safety should be built into products from the earliest stages of development. Through its Safety by Design work, the organisation is calling for companies to assess, test and mitigate risks before AI systems reach the public.

It also called for stronger regulation, global alignment and enforceable safety-by-design standards to prevent the creation and spread of AI-generated child sexual abuse material.

Why does it matter?

The IWF’s warning shows how generative AI is creating urgent child protection risks, especially through realistic synthetic abuse material and nudification tools. The issue is no longer only content moderation after harm occurs; it increasingly concerns model design, testing, deployment and accountability before AI systems reach users. That makes safety by design, developer responsibility and international coordination central to AI governance.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!