Llama 3

Meta's state-of-the-art, openly available Large Language Model: Llama 3 delivers superior performance with 8B and 70B parameter versions.

Llama 3 is Meta's next-generation LLM, setting new benchmarks for openly available models. We released initial versions at 8B and 70B parameters, both instruction-tuned for peak performance (outperforming models like Gemini Pro 1.5 and Claude 3 Sonnet on key industry metrics). The model was trained on a massive 15 trillion token dataset (7x Llama 2's data) and features a 128,000-token vocabulary and 8,192-token context length: this architecture enables enhanced reasoning and multilingual capabilities across over 30 languages. Llama 3 is designed for scale and efficiency, integrating Grouped Query Attention (GQA) for faster inference.

https://llama.com