GPT4o August + 100% Structured Outputs for All (GPT4o August edition)

**OpenAI** released the new **gpt-4o-2024-08-06** model with **16k context window** and **33-50% lower pricing** than the previous 4o-May version, featuring a new Structured Output API that improves output quality and reduces retry costs. **Meta AI** launched **Llama 3.1**, a **405-billion parameter** model surpassing **GPT-4** and **Claude 3.5 Sonnet** on benchmarks, alongside expanding the **Llama Impact Grant** program. **Google DeepMind** quietly released **Gemini 1.5 Pro**, outperforming **GPT-4o**, **Claude-3.5**, and **Llama 3.1** on LMSYS benchmarks and leading the Vision Leaderboard. **Yi-Large Turbo** was introduced as a cost-effective upgrade priced at $0.19 per million tokens. In hardware, **NVIDIA H100 GPUs** were highlighted by **John Carmack** for their massive AI workload power, and **Groq** announced plans to deploy **108,000 LPUs** by Q1 2025. New AI tools and techniques include **RAG (Retrieval-Augmented Generation)**, the **JamAI Base** platform for Mixture of Agents systems, and **LangSmith**'s enhanced filtering capabilities. Google DeepMind also introduced **PEER (Parameter Efficient Expert Retrieval)** architecture.