← All news

Not much happened today

**RAGFlow** open sourced, a deep document understanding RAG engine with **16.3k context length** and natural language instruction support. **Jamba v0.1**, a **52B parameter** MoE model by Lightblue, released but with mixed user feedback. **Command-R** from **Cohere** available on Ollama library. Analysis of **GPT-3.5-Turbo** architecture reveals about **7 billion parameters** and embedding size of **4096**, comparable to OpenChat-3.5-0106 and Mixtral-8x7B. AI chatbots, including **GPT-4**, outperform humans in debates on persuasion. **Mistral-7B** made amusing mistakes on a math riddle. Hardware highlights include a discounted **HGX H100 640GB** machine with 8 H100 GPUs bought for $58k, and CPU comparisons between **Epyc 9374F** and **Threadripper 1950X** for LLM inference. GPU recommendations for local LLMs focus on VRAM and inference speed, with users testing **4090 GPU** and **Midnight-miqu-70b-v1.0.q5_k_s** model. Stable Diffusion influences gaming habits and AI art evaluation shows bias favoring human-labeled art.
Read original at AINews / smol.ai →