Contextual Document Embeddings: `cde-small-v1`

**Meta** announced a new text-to-video model, **Movie Gen**, claiming superior adaptation of **Llama 3** to video generation compared to OpenAI's Sora Diffusion Transformers, though no release is available yet. Researchers Jack Morris and Sasha Rush introduced the **cde-small-v1** model with a novel **contextual batching** training technique and **contextual embeddings**, achieving strong performance with only **143M parameters**. **OpenAI** launched Canvas, a collaborative interface for ChatGPT with synthetic data training. **Google DeepMind** welcomed Tim Brooks to work on video generation and world simulators. Google released **Gemini 1.5 Flash-8B**, improving cost and rate limits with algorithmic efficiency.