r/LocalLLaMA

Local and open model discussions from Reddit.

Read directly from the siteAppears in:AI

Latest from r/LocalLLaMA

  1. Someone built a 32-bit RISC-V CPU directly inside Qwen's model weights so it can execute instructions internaly!11d ago
  2. mtmd: enable video input support for LFM3 model family by tdakhran · Pull Request #31283 · ggml-org/llama.cpp11d ago
  3. JEV arena blog and benchmark11d ago
  4. Two days tuning a single Tesla P40: 35B MoE, full 262k context, ~60 t/s short and ~30 t/s at 100k deep. No sub-Q4 quants.11d ago
  5. Princeton and Polymathic AI release FlashMap: Flow Map Speculative Decoding11d ago
  6. What is something you will want an AI model to do (not necessarily LLMs, anything AI) that it currently cannot?11d ago
  7. AA is getting ridiculous now. Zero open weights in the Most Attractive Quadrant.11d ago
  8. Gemma 5 models soon ??11d ago
  9. Diffuspace/Clover-35B-A3B-Preview · Hugging Face11d ago
  10. 4B 3D coding model update: much better one-shot results and visual quality11d ago
  11. Dirt cheap GPUs coming next year11d ago
  12. Artificial Analysis Intelligence Index v5 (major update)11d ago
  13. They released a tesseract successor (datalab-to/indra)11d ago
  14. DeepSeek-V4.1-Flash-1017 at 41 tok/s on one 309011d ago
  15. SK Hynix expects demand to outpace supply through 203011d ago
  16. New audio model: LFM3-Audio-2B11d ago
  17. OpenAI's major results over the last 3 months came from scaling test-time compute with agent swarms. I've been building an open-source equivalent for the past year, and I'd love for you guys to try it.11d ago
  18. The reason why 5090's are $10k now...11d ago
  19. LiquidAI/LFM3-Omni-2B-GGUF12d ago
  20. Statistically Lossless Qwen3.8 27B GGUFs12d ago
  21. Real-time video captioning with LFM3-VL-2B running locally in-browser on WebGPU12d ago
  22. LiquidAI/LFM3-1.7B · Hugging Face12d ago
  23. I am a King, but local 😂12d ago
  24. Debunking Cohere's claim of Qwen 3.8 Flash Next uploading to Alibaba remote URL12d ago
  25. [Bi-Weekly Megathread] Project Showcase20d ago

Follow it on the AI page