#local inference
6 articles
Latest
Tools
MiniMax M2.7 NVFP4 Hits New Speeds on Dual Blackwell GPUs
Quantized model achieves production-ready inference on professional-grade hardware.
about 1 month ago2 min read
Tools
LocalLLaMA Community Tackles Real-World AI on Tight Hardware
Reddit's open-source AI community solves practical problems with limited compute resources.
about 1 month ago3 min read
Tools
Google's Gemma 4 Arrives With Local Fine-Tuning and Multi-Token Prediction
The new open model runs on 8GB VRAM and includes hidden multi-token prediction capabilities.
about 1 month ago4 min read
Tools
Gemma 4 Finally Works in llama.cpp After Critical Fixes
KV cache and tokenizer bugs squashed. Local inference actually viable now.
about 1 month ago1 min read
Tools
Gemma 4 Dominates Local AI: Real-World Performance Surprises
Google's open model sweeps comparisons. Early users report better reasoning and lower memory demands than expected.
about 1 month ago4 min read
Tools
Alibaba MNN Adds TurboQuant Support for Local LLM Inference
The framework now supports aggressive KV-cache compression, making on-device models faster to run.
about 2 months ago1 min read