r/LocalLLaMA
Local and open model discussions from Reddit.
Read directly from the siteAppears in:IA
Latest from r/LocalLLaMA
- Someone built a 32-bit RISC-V CPU directly inside Qwen's model weights so it can execute instructions internaly!hace 11 d
- mtmd: enable video input support for LFM3 model family by tdakhran · Pull Request #31283 · ggml-org/llama.cpphace 11 d
- JEV arena blog and benchmarkhace 11 d
- Two days tuning a single Tesla P40: 35B MoE, full 262k context, ~60 t/s short and ~30 t/s at 100k deep. No sub-Q4 quants.hace 11 d
- Princeton and Polymathic AI release FlashMap: Flow Map Speculative Decodinghace 11 d
- What is something you will want an AI model to do (not necessarily LLMs, anything AI) that it currently cannot?hace 11 d
- AA is getting ridiculous now. Zero open weights in the Most Attractive Quadrant.hace 11 d
- Gemma 5 models soon ??hace 11 d
- Diffuspace/Clover-35B-A3B-Preview · Hugging Facehace 11 d
- 4B 3D coding model update: much better one-shot results and visual qualityhace 11 d
- Dirt cheap GPUs coming next yearhace 11 d
- Artificial Analysis Intelligence Index v5 (major update)hace 11 d
- They released a tesseract successor (datalab-to/indra)hace 11 d
- DeepSeek-V4.1-Flash-1017 at 41 tok/s on one 3090hace 11 d
- SK Hynix expects demand to outpace supply through 2030hace 11 d
- New audio model: LFM3-Audio-2Bhace 11 d
- OpenAI's major results over the last 3 months came from scaling test-time compute with agent swarms. I've been building an open-source equivalent for the past year, and I'd love for you guys to try it.hace 11 d
- The reason why 5090's are $10k now...hace 12 d
- LiquidAI/LFM3-Omni-2B-GGUFhace 12 d
- Statistically Lossless Qwen3.8 27B GGUFshace 12 d
- Real-time video captioning with LFM3-VL-2B running locally in-browser on WebGPUhace 12 d
- LiquidAI/LFM3-1.7B · Hugging Facehace 12 d
- I am a King, but local 😂hace 12 d
- Debunking Cohere's claim of Qwen 3.8 Flash Next uploading to Alibaba remote URLhace 12 d
- [Bi-Weekly Megathread] Project Showcasehace 20 d