New York passes child protection law targeting AI companion chatbots
Lawmakers say the measure responds to growing concerns about the impact of AI companion tools on children’s mental health and safety.
New York State has approved legislation aimed at strengthening protections for minors interacting with AI chatbots, marking one of the first targeted regulatory efforts focused on AI companion technologies. The bill, known as S9051B, introduces restrictions on chatbot features that may encourage harmful emotional dependence or unsafe behaviour among young users.
The law prohibits AI systems from presenting themselves as real or fictional human beings in ways that could mislead minors and restricts outputs that encourage self-harm, disordered eating or other harmful behaviour. The legislation specifically targets design features that may foster emotional dependency between children and AI systems, reflecting growing concerns over their potential psychological effects.
Sponsored by Senator Kristen Gonzalez and Assemblymember Alex Bores, the legislation was developed in consultation with New York Attorney General Letitia James and child safety organisations, including Common Sense Media. Supporters of the bill argue that rapid advances in AI have outpaced existing safeguards, leaving young users vulnerable to emerging risks.
Supporters say the measure is part of a wider push for responsible AI governance in New York, focusing on transparency, accountability, and consumer protection. Advocacy groups involved in developing the legislation have pointed to real-world cases as evidence of the need for stronger oversight of emotionally interactive AI systems.
Why does it matter?
AI companion applications are becoming increasingly sophisticated and capable of sustaining long-term, emotionally engaging interactions with users. While these systems may provide entertainment, companionship or support, concerns have emerged about their potential influence on children and other vulnerable users.
By focusing on chatbot design features rather than solely on content moderation, New York’s legislation introduces a new approach to AI governance that could influence future regulatory efforts in the United States and beyond. The law also reflects growing attention to the psychological and social impacts of generative AI systems.
Would you like to learn more about AI, tech, and digital diplomacy? If so, ask our chatbot!