Local LLMs
Local LLMs are language models that run directly on your own hardware — a laptop, a PC with a GPU or a home server — with no cloud, no subscriptions and no data leaving your machine. Ollama, llama.cpp and LM Studio, plus quantized GGUF builds of Llama, Qwen and Gemma, make it possible even on a decade-old graphics card. Here is all our coverage of running AI locally: guides, hardware tests, quantization and privacy.
PrismML's Bonsai 27B: Qwen3-27B Runs on a Smartphone for the First Time
Caltech researchers' startup PrismML compressed Qwen3.6-27B 14x with 1-bit weights. The 27-billion-parameter Bonsai 27B now runs directly on a smartphone, retaining…
Selectel Tests Mac mini M4 Pro as a Local LLM Server for OpenClaw
Selectel tested a Mac mini with the M4 Pro chip as a portable LLM server running the OpenClaw agent. Apple Silicon's unified memory removes the main barrier to…
BitNet b1.58: How Ternary Quantization Lets a 27B Model Run Without a GPU
Networks whose weights take just three values {-1, 0, 1} fit 27B models into 6–7 GB of RAM and run on an ordinary laptop with no graphics card.
How Yandex Profiles Memory on Millions of Alice Smart Speakers: The Fight for 256 MB
Apple Foundation Models SDK for Python: Local Apple Intelligence Inside the Hermes Agent
StarGuard AI: Why Enterprise LLMs Need a Firewall, and How Orion Soft Is Building One
4 Mac Studios in One Cluster: 1.5 TB of Memory for Trillion-Parameter LLMs
Developer Trained an AI Agent to Automatically Apply to Job Openings on HH.ru
An author on Habr demonstrated an autonomous AI agent for HH.ru: a local neural network filters job listings, and the bot writes personalized cover letters and…
Developer Built a Local Spam Filter with ruBert-base-antispam Model Without VPN
An author on Habr assembled a multi-layer spam filter: after Yandex, Mail, and SpamAssassin, emails are checked by a local BERT model with 177 million parameters.
How Context Engineering Makes Weak Local LLM a Reliable Agent
Qwen3.6 and MCP: How to Build a Local AI System Without Integration Code for Each Model
Five AI plugins for Obsidian that help retain knowledge from notes
AMD Shows How to Run AI Agents on PCs with 128 GB of Memory
OpenAI Introduced GPT-Live — Updated Voice ChatGPT with GPT-5.5 Support
OpenAI launched GPT-Live — an updated voice mode for ChatGPT that can delegate complex tasks to GPT-5.5.
MiniMax Raises $2B for AI Model Development Through Share Offering
Chinese company MiniMax has launched fundraising of $2 billion through new share issuance and convertible bonds, joining the wave of AI investments.