r/LocalLLaMA
Local and open model discussions from Reddit.
Read directly from the siteAppears in:IA
Latest from r/LocalLLaMA
- Someone built a 32-bit RISC-V CPU directly inside Qwen's model weights so it can execute instructions internaly!há 11 d
- mtmd: enable video input support for LFM3 model family by tdakhran · Pull Request #31283 · ggml-org/llama.cpphá 11 d
- JEV arena blog and benchmarkhá 11 d
- Two days tuning a single Tesla P40: 35B MoE, full 262k context, ~60 t/s short and ~30 t/s at 100k deep. No sub-Q4 quants.há 11 d
- Princeton and Polymathic AI release FlashMap: Flow Map Speculative Decodinghá 11 d
- What is something you will want an AI model to do (not necessarily LLMs, anything AI) that it currently cannot?há 11 d
- AA is getting ridiculous now. Zero open weights in the Most Attractive Quadrant.há 11 d
- Gemma 5 models soon ??há 11 d
- Diffuspace/Clover-35B-A3B-Preview · Hugging Facehá 11 d
- 4B 3D coding model update: much better one-shot results and visual qualityhá 11 d
- Dirt cheap GPUs coming next yearhá 11 d
- Artificial Analysis Intelligence Index v5 (major update)há 11 d
- They released a tesseract successor (datalab-to/indra)há 11 d
- DeepSeek-V4.1-Flash-1017 at 41 tok/s on one 3090há 11 d
- SK Hynix expects demand to outpace supply through 2030há 11 d
- New audio model: LFM3-Audio-2Bhá 11 d
- OpenAI's major results over the last 3 months came from scaling test-time compute with agent swarms. I've been building an open-source equivalent for the past year, and I'd love for you guys to try it.há 11 d
- The reason why 5090's are $10k now...há 12 d
- LiquidAI/LFM3-Omni-2B-GGUFhá 12 d
- Statistically Lossless Qwen3.8 27B GGUFshá 12 d
- Real-time video captioning with LFM3-VL-2B running locally in-browser on WebGPUhá 12 d
- LiquidAI/LFM3-1.7B · Hugging Facehá 12 d
- I am a King, but local 😂há 12 d
- Debunking Cohere's claim of Qwen 3.8 Flash Next uploading to Alibaba remote URLhá 12 d
- [Bi-Weekly Megathread] Project Showcasehá 20 d