r/LocalLLaMA
Local and open model discussions from Reddit.
Read directly from the siteAppears in:IA
Latest from r/LocalLLaMA
- Someone built a 32-bit RISC-V CPU directly inside Qwen's model weights so it can execute instructions internaly!il y a 11 j
- mtmd: enable video input support for LFM3 model family by tdakhran · Pull Request #31283 · ggml-org/llama.cppil y a 11 j
- JEV arena blog and benchmarkil y a 11 j
- Two days tuning a single Tesla P40: 35B MoE, full 262k context, ~60 t/s short and ~30 t/s at 100k deep. No sub-Q4 quants.il y a 11 j
- Princeton and Polymathic AI release FlashMap: Flow Map Speculative Decodingil y a 11 j
- What is something you will want an AI model to do (not necessarily LLMs, anything AI) that it currently cannot?il y a 11 j
- AA is getting ridiculous now. Zero open weights in the Most Attractive Quadrant.il y a 11 j
- Gemma 5 models soon ??il y a 11 j
- Diffuspace/Clover-35B-A3B-Preview · Hugging Faceil y a 11 j
- 4B 3D coding model update: much better one-shot results and visual qualityil y a 11 j
- Dirt cheap GPUs coming next yearil y a 11 j
- Artificial Analysis Intelligence Index v5 (major update)il y a 11 j
- They released a tesseract successor (datalab-to/indra)il y a 11 j
- DeepSeek-V4.1-Flash-1017 at 41 tok/s on one 3090il y a 11 j
- SK Hynix expects demand to outpace supply through 2030il y a 11 j
- New audio model: LFM3-Audio-2Bil y a 11 j
- OpenAI's major results over the last 3 months came from scaling test-time compute with agent swarms. I've been building an open-source equivalent for the past year, and I'd love for you guys to try it.il y a 11 j
- The reason why 5090's are $10k now...il y a 12 j
- LiquidAI/LFM3-Omni-2B-GGUFil y a 12 j
- Statistically Lossless Qwen3.8 27B GGUFsil y a 12 j
- Real-time video captioning with LFM3-VL-2B running locally in-browser on WebGPUil y a 12 j
- LiquidAI/LFM3-1.7B · Hugging Faceil y a 12 j
- I am a King, but local 😂il y a 12 j
- Debunking Cohere's claim of Qwen 3.8 Flash Next uploading to Alibaba remote URLil y a 12 j
- [Bi-Weekly Megathread] Project Showcaseil y a 20 j