Mistral introduces edge AI models for privacy-first applications
Mistral claims its new AI models, Ministral 3B and 8B, outperform competitors like Llama and Gemma, offering robust instruction-following capabilities for edge devices.
Mistral, a French AI startup, has launched its first generative AI models, ‘Les Ministraux,’ designed to run on edge devices like laptops and mobile phones. The models, Ministral 3B and Ministral 8B, offer versatile applications such as on-device translation and autonomous robotics, catering to privacy-focused, low-latency scenarios.
Both models can process 128,000 tokens, roughly the length of a 50-page book. While Ministral 8B is available for research purposes, commercial licences for self-deployment are being offered directly by Mistral. Developers can also access the models through Mistral’s cloud platform, La Platforme.
Smaller AI models are increasingly in demand due to their cost-effectiveness and efficiency. Mistral claims that its Ministral models outperform competitors like Llama and Gemma across several benchmarks, offering strong instruction-following and problem-solving capabilities.
Paris-based Mistral, which has raised $640 million in venture capital, continues to expand its AI portfolio. The company has introduced services such as developer testing and model fine-tuning, positioning itself as a competitor to major players like OpenAI and Anthropic.