Sam Altman says GPT-4o demand overwhelmed OpenAI’s GPU supply

GPT-4o’s image tool brought in a million users in under an hour.
Sam Altman believes AI models may begin generating novel insights by 2026, signalling a new frontier in artificial intelligence research.

OpenAI faced a significant infrastructure strain after its GPT-4o image generator went viral for producing Ghibli-style memes. The sudden influx of user demand added a million new users in under an hour, putting immense pressure on the company’s systems.

CEO Sam Altman admitted that OpenAI had to slow feature rollouts and borrow computing power from its research division to keep the service running. The platform temporarily introduced rate limits as it coped with overloaded GPUs.

Altman described the situation as unprecedented, saying no other company has had to manage such intense viral spikes. He noted that image generation with GPT-4o requires significant compute resources, which the company could not fully meet with its current GPU inventory.

Despite the challenges, Altman maintained that OpenAI is committed to managing high user demand while continuing development. The company is also considering watermarking the AI images created by free users to help manage scale and traceability.

Would you like to learn more about AI, tech and digital diplomacy? If so, ask our Diplo chatbot!