OpenAI and Anthropic sign AI safety deals with US government

The US AI Safety Institute will gain early access to new AI models from OpenAI and Anthropic under deals that aim to assess capabilities and ensure responsible development.

OpenAI has secured content-sharing deals with top news outlets like The Washington Post, Politico, and Vox, providing ChatGPT users with summaries, quotes, and links to original reporting.

AI startups OpenAI and Anthropic have agreed with the US Artificial Intelligence Safety Institute to collaborate on research, testing, and evaluating their advanced AI models. The deals come as regulatory scrutiny over AI’s safe and ethical development increases across the tech industry.

The agreements allow the US AI Safety Institute early access to significant new AI models from both companies before and after their release. The partnership will evaluate their capabilities and potential risks and provide feedback on safety improvements. OpenAI’s chief strategy officer, Jason Kwon, supported the initiative, citing its importance in setting a global framework for AI safety.

Anthropic, backed by Amazon and Alphabet, did not immediately comment on the deal. The US AI Safety Institute is also working closely with its counterpart in the UK to ensure international collaboration on AI safety. The institute was established as part of an executive order by President Biden to address risks associated with emerging AI technologies.