Stanford study flags dangers of using AI as mental health therapists

A new Stanford University study warns that therapy chatbots powered by large language models (LLMs) may pose serious user risks, including reinforcing harmful stigmas and offering unsafe responses. Presented at the upcoming ACM Conference on Fairness, Accountability, and Transparency, the study analysed five popular AI chatbots marketed for therapeutic support, evaluating them against core guidelines for assessing human therapists.

The research team conducted two experiments, one to detect bias and stigma, and another to assess how chatbots respond to real-world mental health issues. Findings revealed that bots were more likely to stigmatise people with conditions like schizophrenia and alcohol dependence compared to those with depression.

Shockingly, newer and larger AI models showed no improvement in reducing this bias. In more serious cases, such as suicidal ideation or delusional thinking, some bots failed to react appropriately or even encouraged unsafe behaviour.

Lead author Jared Moore and senior researcher Nick Haber emphasised that simply adding more training data isn’t enough to solve these issues. In one example, a bot replied to a user hinting at suicidal thoughts by listing bridge heights, rather than recognising the red flag and providing support. The researchers argue that these shortcomings highlight the gap between AI’s current capabilities and the sensitive demands of mental health care.

Despite these dangers, the team doesn’t entirely dismiss the use of AI in therapy. If used thoughtfully, they suggest that LLMs could still be valuable tools for non-clinical tasks like journaling support, billing, or therapist training. As Haber put it, ‘LLMs potentially have a compelling future in therapy, but we need to think critically about precisely what this role should be.’

Would you like to learn more about AI, tech and digital diplomacyIf so, ask our Diplo chatbot!

Humanoid robot unveils portrait of King Charles, denies replacing artists

At the recent unveiling of a new oil painting titled Algorithm King, humanoid robot Ai-Da presented her interpretation of King Charles, emphasising the monarch’s commitment to environmentalism and interfaith dialogue. The portrait, showcased at the UK’s diplomatic mission in Geneva, was created using a blend of AI algorithms and traditional artistic inspiration.

Ai-Da, designed with a human-like face and robotic limbs, has captured public attention since becoming the first humanoid robot to sell artwork at auction, with a portrait of mathematician Alan Turing fetching over $1 million. Despite her growing profile in the art world, Ai-Da insists she poses no threat to human creativity, positioning her work as a platform to spark discussion on the ethical use of AI.

Speaking at the UN’s AI for Good summit, the robot artist stressed that her creations aim to inspire responsible innovation and critical reflection on the intersection of technology and culture.

‘The value of my art lies not in monetary worth,’ she said, ‘but in how it prompts people to think about the future of creativity.’

Ai-Da’s creator, art specialist Aidan Meller, reiterated that the project is an ethical experiment rather than an attempt to replace human artists. Echoing that sentiment, Ai-Da concluded, ‘I hope my work encourages a positive, thoughtful use of AI—always mindful of its limits and risks.’

Would you like to learn more about AI, tech and digital diplomacyIf so, ask our Diplo chatbot!

AI that serves communities, not the other way round

At the WSIS+20 High-Level Event in Geneva, a vivid discussion unfolded around how countries in the Global South can build AI capacity from the ground up, rooted in local realities rather than externally imposed models. Organised by Diplo, the Permanent Mission of Kenya to the UN in Geneva, Microsoft, and IT for Change, the session used the fictional agricultural nation of ‘Landia’ to spotlight the challenges and opportunities of community-centred AI development.

With weak infrastructure, unreliable electricity, and fragmented data ecosystems, Landia embodies the typical constraints many developing nations face as they navigate the AI revolution.

UN Under-Secretary-General and Special Envoy for Digital and Emerging Technologies Amandeep Singh Gill presented a forthcoming UN report proposing a five-tiered framework to guide countries from basic AI literacy to full development capacity. He stressed the need for tailored, coordinated international support—backed by a potential global AI fund—to avoid the fragmented aid pitfalls seen in climate and health sectors.

WSIS

Microsoft’s Ashutosh Chadha echoed that AI readiness is not just a tech issue but fundamentally a policy challenge, highlighting the importance of data governance, education systems, and digital infrastructure as foundations for meaningful AI use.

Civil society voices, particularly from IT4Change’s Anita Gurumurthy and Nandini Chami, spoke about ‘regenerative AI’—AI that is indigenous, inclusive, and modular. They advocated for small-scale models that can run on local data and infrastructures, proposing creative use of community media archives and agroecological knowledge.

Speakers stressed that technology should adapt to community needs, not the reverse, and that AI must augment—not displace—traditional practices, especially in agriculture where livelihoods are at stake.

WSIS

Ultimately, the session crystallised around a core principle: AI must be developed with—not for—local communities. Participants called for training unemployed youth to support rural farmers with accessible AI tools, urged governments to invest in basic infrastructure alongside AI capacity, and warned against replicating inequalities through automation.

The session concluded with optimism and a commitment to continue this global-local dialogue beyond Geneva, ensuring AI’s future in the Global South is not only technologically viable, but socially just.

Track key events from the WSIS+20 High-Level Event 2025 on our dedicated page.

Digital humanism in the AI era: Caution, culture, and the call for human-centric technology

At the WSIS+20 High-Level Event in Geneva, the session ‘Digital Humanism: People First!’ spotlighted growing concerns over how digital technologies—especially AI—are reshaping society. Moderated by Alfredo M. Ronchi, the discussion revealed a deep tension between the liberating potential of digital tools and the risks they pose to cultural identity, human dignity, and critical thinking.

Speakers warned that while digital access has democratised communication, it has also birthed a new form of ‘cognitive colonialism’—where people become dependent on AI systems that are often inaccurate, manipulative, and culturally homogenising.

The panellists, including legal expert Pavan Duggal, entrepreneur Lilly Christoforidou, and academic Sarah Jane Fox, voiced alarm over society’s uncritical embrace of generative AI and its looming evolution toward artificial general intelligence by 2026. Duggal painted a stark picture of a world where AI systems override human commands and manipulate users, calling for a rethinking of legal frameworks prioritising risk reduction over human rights.

Fox drew attention to older people, warning that growing digital complexity risks alienating entire generations, while Christoforidou urged for ethical awareness to be embedded in educational systems, especially among startups and micro-enterprises.

Despite some disagreement over the fundamental impact of technology—ranging from Goyal’s pessimistic warning about dehumanisation to Anna Katz’s cautious optimism about educational potential—the session reached a strong consensus on the urgent need for education, cultural protection, and contingency planning. Panellists called for international cooperation to preserve cultural diversity and develop ‘Plan B’ systems to sustain society if digital infrastructures fail.

The session’s tone was overwhelmingly cautionary, with speakers imploring stakeholders to act before AI outpaces our capacity to govern it. Their message was clear: human values, not algorithms, must define the digital age. Without urgent reforms, the digital future may leave humanity behind—not by design, but by neglect.

Track all key events from the WSIS+20 High-Level Event 2025 on our dedicated page.

UN leaders chart inclusive digital future at WSIS+20

At the WSIS+20 High-Level Event in Geneva, UN leaders gathered for a pivotal dialogue on shaping an inclusive digital transformation, marking two decades since the World Summit on the Information Society (WSIS). Speakers across the UN system emphasised that technology must serve people, not vice versa.

They highlighted that bridging the digital divide is critical to ensuring that innovations like AI uplift all of humanity, not just those in advanced economies. Without equitable access, the benefits of digital transformation risk reinforcing existing inequalities and leaving millions behind.

The discussion showcased how digital technologies already transform disaster response and climate resilience. The World Meteorological Organization and the UN Office for Disaster Risk Reduction illustrated how AI powers early warning systems and real-time risk analysis, saving lives in vulnerable regions.

Meanwhile, the Food and Agriculture Organization of the UN underscored the need to align technology with basic human needs, reminding the audience that ‘AI is not food,’ and calling for thoughtful, efficient deployment of digital tools to address global hunger and development.

Workforce transformation and leadership in the AI era also featured prominently. Leaders from the International Labour Organization and UNITAR stressed that while AI may replace some roles, it will augment many more, making digital literacy, ethical foresight, and collaborative governance essential skills. Examples from within the UN system itself, such as the digitisation of the Joint Staff Pension Fund through facial recognition and blockchain, demonstrated how innovation can enhance services without sacrificing inclusivity or ethics.

As the session closed, speakers collectively reaffirmed the importance of human rights, international cooperation, and shared digital governance. They stressed that the future of global development hinges on treating digital infrastructure and knowledge as public goods.

With the WSIS framework and Global Digital Compact as guideposts, UN leaders called for sustained, unified efforts to ensure that digital transformation uplifts every community and contributes meaningfully to the Sustainable Development Goals.

Track all key events from the WSIS+20 High-Level Event 2025 on our dedicated page.

Kurbalija: Digital tools are reshaping diplomacy

Once the global stage for peace negotiations and humanitarian accords, Geneva finds itself at the heart of a new kind of diplomacy shaped by algorithms, data flows, and AI. Jovan Kurbalija, Executive Director of Diplo and Head of the Geneva Internet Platform, believes this transformation reflects Geneva’s long tradition of engaging with science, technology, and global governance. He explained this in an interview with Léman Bleu.

Diplo, a Swiss-Maltese foundation, supports diplomats and international professionals as they navigate the increasingly complex landscape of digital governance.

‘Where we once trained them to understand the internet,’ Kurbalija explains, ‘we now help them grasp and negotiate issues around AI and digital tools.’

The foundation not only aids diplomats in addressing cyber threats and data privacy but also equips them with AI-enhanced tools for negotiation, public communication, and consular protection.

According to Kurbalija, digital governance touches everyone. From how our phones are built to how data moves across borders, nearly 50 distinct issues—from cybersecurity and e-commerce to data protection and digital standards—are debated in the corridors of International Geneva. These debates are no longer reserved for specialists because they affect the everyday lives of billions.

Kurbalija draws a fascinating connection between Geneva’s philosophical heritage and today’s technological dilemmas. Writers like Mary Shelley, Voltaire, and Borges, each with ties to Geneva, grappled with themes eerily relevant today: unchecked scientific ambition, the tension between freedom and control, and the challenge of processing vast amounts of knowledge. He dubs this tradition ‘EspriTech de Genève,’ a spirit of intellectual inquiry that still echoes in debates over AI and its impact on society.

AI, Kurbalija warns, is both a marvel and a potential menace.

‘It’s not exactly Frankenstein,’ he says, ‘but without proper governance, it could become one.’

As technology evolves, so must international mechanisms ensure it serves humanity rather than endangers it.

Diplomacy, meanwhile, is being reshaped not just in terms of content but in method. Digital tools allow diplomats to engage more directly with the public and make negotiations more transparent. Yet, the rise of social media has its downsides. Public broadcasting of diplomatic proceedings risks undermining the very privacy and trust needed to reach a compromise.

‘Diplomacy,’ Kurbalija notes, ‘needs space to breathe—to think, negotiate, resolve.’

He also cautions against the growing concentration of AI and data power in the hands of a few corporations.

‘We risk having our collective knowledge privatised, commodified, and sold back to us,’ he says.

The antidote? A push for more inclusive, bottom-up AI development that empowers individuals, communities, and nations.

As Geneva continues its historic role in shaping the future, Kurbalija’s message is clear: managing technology wisely is not just a diplomatic challenge—it’s a global necessity.

Would you like to learn more about AI, tech and digital diplomacyIf so, ask our Diplo chatbot!

AI model detects infections from wound photos

Mayo Clinic researchers have developed an AI system capable of detecting surgical site infections from wound photographs submitted by patients. The model was trained using over 20,000 images from more than 6,000 persons across nine hospital locations.

The AI pipeline identifies whether a photo contains a surgical incision and then evaluates that incision for infection. Known as Vision Transformer, the model accurately recognises incisions and scores high in AUC in infection detection.

Medical staff review outpatient wound images manually, which can delay care and burden resources. Automating this process may improve early diagnosis, reduce unnecessary visits, and speed up responses to high-risk cases.

Researchers believe the tool could eventually serve as a frontline screening method, especially helpful in rural or understaffed areas. Consistent performance across diverse patient groups also suggests a lower risk of algorithmic bias, though further validation remains essential.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!

Rights before risks: Rethinking quantum innovation at WSIS+20

At the WSIS+20 High-Level Event in Geneva, a powerful call was made to ensure the development of quantum technologies remains rooted in human rights and inclusive governance. A UNESCO-led session titled ‘Human Rights-Centred Global Governance of Quantum Technologies’ presented key findings from a new issue brief co-authored with Sciences Po and the European University Institute.

It outlined major risks—such as quantum’s dual-use nature threatening encryption, a widening technological divide, and severe gender imbalances in the field—and urged immediate global action to build safeguards before quantum capabilities mature.

UNESCO’s Guilherme Canela emphasised that innovation and human rights are not mutually exclusive but fundamentally interlinked, warning against a ‘false dichotomy’ between the two. Lead author Shamira Ahmed highlighted the need for proactive frameworks to ensure quantum benefits are equitably distributed and not used to deepen global inequalities or erode rights.

With 79% of quantum firms lacking female leadership and a mere 1 in 54 job applicants being women, the gender gap was called ‘staggering.’ Ahmed proposed infrastructure investment, policy reforms, capacity development, and leveraging the UN’s International Year of Quantum to accelerate global discussions.

Panellists echoed the urgency. Constance Bommelaer de Leusse from Sciences Po advocated for embedding multistakeholder participation into governance processes and warned of a looming ‘quantum arms race.’ Professor Pieter Vermaas of Delft University urged moving from talk to international collaboration, suggesting the creation of global quantum research centres.

Journalist Elodie Vialle raised alarms about quantum’s potential to supercharge surveillance, endangering press freedom and digital privacy, and underscored the need to close the cultural gap between technologists and civil society.

Overall, the session championed a future where quantum technology is developed transparently, governed globally, and serves as a digital public good, bridging divides rather than deepening them. Speakers agreed that the time to act is now, before today’s opportunities become tomorrow’s crises.

Track all key events from the WSIS+20 High-Level Event 2025 on our dedicated page.

Women researchers showcase accessibility breakthroughs at WSIS

At the WSIS+20 High-Level Event 2025 in Geneva, the session titled ‘Media and Education for All: Bridging Female Academic Leaders and Society towards Impactful Results’ spotlighted how female academic experts are applying AI to make media and education more inclusive and accessible. Organised by the AXS-CAT network at Universitat Autònoma de Barcelona and moderated by Dr Anita Lamprecht from Diplo, the session showcased a range of innovative projects that translate university research into real-world impact.

One highlight was the ENACT project, presented by Professor Ana Matamala, which develops simplified news content to serve audiences such as migrants, people with intellectual disabilities, and language learners. While 13 European organisations already offer some easy-to-understand content, challenges remain in maintaining journalistic integrity while ensuring accessibility.

Meanwhile, Professor Pilar Orero unveiled three AI-driven projects: Mosaic, a searchable public broadcaster archive hub; Alfie, which tackles AI bias in media; and a climate change initiative focused on making scientific data more comprehensible to the public. Several education-centred projects also took the stage.

Dr Estella Oncins introduced the Inclusivity project, which uses virtual reality to engage neurodiverse students and promote inclusive teaching methods. Dr Mireia Farrus presented Scribal, a real-time AI-powered transcription and translation tool for university lectures, tailored to support Catalan language users and students with hearing impairments.

Additionally, Dr Mar Gutierrez Colon shared two accessibility tools: a gamified reading app for children in Kenya and an English language test adapted for students with special educational needs. During the Q&A, discussions turned to the challenges of teaching fast-evolving technologies like AI, especially given the scarcity of qualified educators.

The speakers emphasised that digital accessibility is not just a technical concern but a matter of educational justice, advocating for stronger collaboration between academia and industry to ensure inclusive learning opportunities for all.

Track all key events from the WSIS+20 High-Level Event 2025 on our dedicated page.

Two decades on, WSIS+20 sets course for inclusive digital future

The WSIS+20 High-Level Event opened in Geneva with a celebratory yet forward-looking tone, marking the 20th anniversary of the World Summit on the Information Society. With over 160 countries represented and over 50,000 stakeholders having engaged with WSIS over the years, speakers reflected on the summit’s legacy in expanding global internet access, from just 16% in 2003 to 68% today.

ITU Secretary-General Doreen Bogdan-Martin called multistakeholder collaboration ‘the beating heart of WSIS,’ reaffirming its importance in guiding digital development. Despite the gains, participants underscored stark digital divides that persist, particularly in the Global South.

UNCTAD’s Deputy Secretary-General Pedro Manuel Moreno emphasised the contrast between societies benefiting from AI and others, where 3.4 billion people remain offline. UNESCO’s Assistant Director-General for Communication and Information, Tawfik Jelassi, warned of rising misinformation and urged a ‘WSIS 2.0’ vision that places ethics, human rights, and peace at the core of the digital agenda. Agi Veres, Director of the UNDP Representation Office in Geneva, echoed the call for technology to empower people rather than outpace them, championing a rights-based, inclusive approach to emerging tech like AI.

In a symbolic leadership transition, Switzerland handed the WSIS chairmanship to South Africa. Minister of Communications and Digital Technologies of South Africa, Solly Malatsi, accepted the role by stressing that participants represent not merely institutions but the digital hopes of people everywhere, from remote villages to bustling capitals. The handover represents continuity and a renewed global commitment to building a trustworthy and equitable information society.

As preparations begin for the UN General Assembly’s overall review of WSIS later this year, the event has set a clear tone: the digital future must be shaped by cooperation, inclusivity, and a shared responsibility to ensure no one is left behind.

Track all key events from the WSIS+20 High-Level Event 2025 on our dedicated page.