r/LocalLLaMA

Local and open model discussions from Reddit.

Read directly from the siteAppears in:KI

Latest from r/LocalLLaMA

  1. Someone built a 32-bit RISC-V CPU directly inside Qwen's model weights so it can execute instructions internaly!vor 11 Tg.
  2. mtmd: enable video input support for LFM3 model family by tdakhran · Pull Request #31283 · ggml-org/llama.cppvor 11 Tg.
  3. JEV arena blog and benchmarkvor 11 Tg.
  4. Two days tuning a single Tesla P40: 35B MoE, full 262k context, ~60 t/s short and ~30 t/s at 100k deep. No sub-Q4 quants.vor 11 Tg.
  5. Princeton and Polymathic AI release FlashMap: Flow Map Speculative Decodingvor 11 Tg.
  6. What is something you will want an AI model to do (not necessarily LLMs, anything AI) that it currently cannot?vor 11 Tg.
  7. AA is getting ridiculous now. Zero open weights in the Most Attractive Quadrant.vor 11 Tg.
  8. Gemma 5 models soon ??vor 11 Tg.
  9. Diffuspace/Clover-35B-A3B-Preview · Hugging Facevor 11 Tg.
  10. 4B 3D coding model update: much better one-shot results and visual qualityvor 11 Tg.
  11. Dirt cheap GPUs coming next yearvor 11 Tg.
  12. Artificial Analysis Intelligence Index v5 (major update)vor 11 Tg.
  13. They released a tesseract successor (datalab-to/indra)vor 11 Tg.
  14. DeepSeek-V4.1-Flash-1017 at 41 tok/s on one 3090vor 11 Tg.
  15. SK Hynix expects demand to outpace supply through 2030vor 11 Tg.
  16. New audio model: LFM3-Audio-2Bvor 11 Tg.
  17. OpenAI's major results over the last 3 months came from scaling test-time compute with agent swarms. I've been building an open-source equivalent for the past year, and I'd love for you guys to try it.vor 11 Tg.
  18. The reason why 5090's are $10k now...vor 12 Tg.
  19. LiquidAI/LFM3-Omni-2B-GGUFvor 12 Tg.
  20. Statistically Lossless Qwen3.8 27B GGUFsvor 12 Tg.
  21. Real-time video captioning with LFM3-VL-2B running locally in-browser on WebGPUvor 12 Tg.
  22. LiquidAI/LFM3-1.7B · Hugging Facevor 12 Tg.
  23. I am a King, but local 😂vor 12 Tg.
  24. Debunking Cohere's claim of Qwen 3.8 Flash Next uploading to Alibaba remote URLvor 12 Tg.
  25. [Bi-Weekly Megathread] Project Showcasevor 20 Tg.

Follow it on the KI page