Mozilla's AI Second Act

**Mozilla** showcased detailed live demos of **llamafile** and announced **sqlite-vec** for vector search integration at the AIE World's Fair. **LlamaIndex** launched **llama-agents**. **Anthropic** introduced new UI features and **Projects** for **Claude** with a 200K context window. **Etched AI** revealed a specialized inference chip claiming **500k tokens/sec**, though benchmark claims are questioned. **Sohu** chip enables **15 agent trajectories/sec**. **Tim Dettmers** shared theoretical GPU inference limits of ~300k tokens/sec for 8xB200 NVLink on 70B Llama. **Deepseek Coder v2** outperforms **Gemini** and GPT-4 variants in coding and reasoning. The **PyTorch documentary** launched to little attention.