Local LLMs
Local LLMs are language models that run directly on your own hardware — a laptop, a PC with a GPU or a home server — with no cloud, no subscriptions and no data leaving your machine. Ollama, llama.cpp and LM Studio, plus quantized GGUF builds of Llama, Qwen and Gemma, make it possible even on a decade-old graphics card. Here is all our coverage of running AI locally: guides, hardware tests, quantization and privacy.
Agentic search on open-source models: who it found, what it cost, and where it all broke
A Habr author spent $20 on an experimental agentic search system: he tested six open-source models, found that gemma4 with a simple JEV filter works best, and…
How to Build a RAG Bot on a T4 for Civics Textbooks: Qwen Instead of Web Search
A RAG bot for 9th and 10th grade civics textbooks runs on a free T4 in Colab. Qwen2.5-3B-Instruct searches for answers in specific paragraphs via FAISS, not the…
The Verge Launches a Local AI Diary: Hermes, Qwen and a Mac Studio
The Verge starts a local AI diary: Hermes Agent, Qwen, an Asus TUF A14 and a Mac Studio. The key question is whether results justify the price of a computer with…
When Small LLMs Beat the Swarm: How Splitting Data Into Sections Gave a Weak Model a 4x Boost
Programmer Mikhail Singatullin Files Offline Memory System for AI Agents With Russia's Software Registry
FlexSoft Promises Zero Time-to-Market in Fintech Through AI-Native Platforms
Unsloth and Llama 3: How to Teach a Model to Call APIs Reliably via JSON
10 Free AI Tools to Replace Paid Data Science Software
DataRobot costs $50,000 a year, Tableau costs $900 per user. But Ollama, AutoGluon, PandasAI, and seven other open tools now fully replace paid analytics and…
Open-source video editor Wunjo Make can now get plugins written via Claude Code, Codex and Cursor
The Wunjo Make repo now includes a builder and skills for cloud LLMs, so plugins that use local neural networks or APIs can be written with three AI agents and…
Phase-HDC trains a model with no optimizer history and stores 16–23x less than Adam
LLMs Draft Road-Work Plans for WisDOT: 14B Barely Beats 7B
Apple Cuts Hardware Engineering Staff to Speed Up Development Under Ternus
A Simple Formula Predicts When Chatbots Will Go Off the Rails
How to Become an AI Architect in 2026: A Roadmap from Engineer to Systems Designer
KDnuggets published a step-by-step plan for engineers who want to grow into AI architects: what to study, how to make system decisions, and develop leadership…
Local RAG with FastAPI and Ollama: From a Simple LLM Call to a Production Backend
A developer on Habr shows how to turn a single POST request to Ollama into a backend system with an API contract, sources, logging, and negative tests.