Llama-4

Llama 4 is Meta's open-weight, multimodal AI model series: it leverages a Mixture-of-Experts (MoE) architecture for superior efficiency and performance.

Llama 4, released by Meta in April 2025, represents a significant architecture shift to Mixture-of-Experts (MoE), boosting efficiency and performance. The initial release includes two primary models: Scout and Maverick. Scout features 17 billion active parameters (109B total) and a 10 million token context window, optimized for single-GPU deployment. Maverick scales up with 17 billion active parameters (400B total) and 128 experts, delivering competitive results against market leaders. Both models are natively multimodal (text and image input) and multilingual, making them a powerful, open-weight foundation for a wide range of advanced AI applications.

https://llama.com