r/LocalLLaMA
Local and open model discussions from Reddit.
Read directly from the siteAppears in:KI
Latest from r/LocalLLaMA
- Someone built a 32-bit RISC-V CPU directly inside Qwen's model weights so it can execute instructions internaly!vor 11 Tg.
- mtmd: enable video input support for LFM3 model family by tdakhran · Pull Request #31283 · ggml-org/llama.cppvor 11 Tg.
- JEV arena blog and benchmarkvor 11 Tg.
- Two days tuning a single Tesla P40: 35B MoE, full 262k context, ~60 t/s short and ~30 t/s at 100k deep. No sub-Q4 quants.vor 11 Tg.
- Princeton and Polymathic AI release FlashMap: Flow Map Speculative Decodingvor 11 Tg.
- What is something you will want an AI model to do (not necessarily LLMs, anything AI) that it currently cannot?vor 11 Tg.
- AA is getting ridiculous now. Zero open weights in the Most Attractive Quadrant.vor 11 Tg.
- Gemma 5 models soon ??vor 11 Tg.
- Diffuspace/Clover-35B-A3B-Preview · Hugging Facevor 11 Tg.
- 4B 3D coding model update: much better one-shot results and visual qualityvor 11 Tg.
- Dirt cheap GPUs coming next yearvor 11 Tg.
- Artificial Analysis Intelligence Index v5 (major update)vor 11 Tg.
- They released a tesseract successor (datalab-to/indra)vor 11 Tg.
- DeepSeek-V4.1-Flash-1017 at 41 tok/s on one 3090vor 11 Tg.
- SK Hynix expects demand to outpace supply through 2030vor 11 Tg.
- New audio model: LFM3-Audio-2Bvor 11 Tg.
- OpenAI's major results over the last 3 months came from scaling test-time compute with agent swarms. I've been building an open-source equivalent for the past year, and I'd love for you guys to try it.vor 11 Tg.
- The reason why 5090's are $10k now...vor 12 Tg.
- LiquidAI/LFM3-Omni-2B-GGUFvor 12 Tg.
- Statistically Lossless Qwen3.8 27B GGUFsvor 12 Tg.
- Real-time video captioning with LFM3-VL-2B running locally in-browser on WebGPUvor 12 Tg.
- LiquidAI/LFM3-1.7B · Hugging Facevor 12 Tg.
- I am a King, but local 😂vor 12 Tg.
- Debunking Cohere's claim of Qwen 3.8 Flash Next uploading to Alibaba remote URLvor 12 Tg.
- [Bi-Weekly Megathread] Project Showcasevor 20 Tg.