Nvidia Builds a 512 GB Mini-Cluster from Four DGX Spark Units for Models Up to 700B Parameters
When you run large models at your desk, the bottleneck is memory, not speed: the weights simply don't fit. At SC26, Nvidia showed the DGX Spark HPC Developer Kit, four mini-computers with 128 GB each, for 512 GB of memory in total. The company says this is enough to run models up to 700B parameters locally, without the cloud. Nvidia has not disclosed a price, but four DGX Spark units bought separately cost almost $28,000.
AI-processed from Habr AI; edited by Hamidun News
The main problem with running large language models locally is not compute speed but memory: if the weights don't fit, the model simply won't start. At the SC26 conference in Chicago, Nvidia showed the DGX Spark HPC Developer Kit, a cluster of four compact DGX Spark computers. Each has 128 GB of memory, for 512 GB in total.
According to the company, that is enough to run models of up to 700B parameters locally. The simplest way to picture it: a 700B-parameter model in a 4-bit format takes roughly 350 GB (this is our own estimate, not an Nvidia figure). It won't fit on a single machine with 128 GB, but it will fit on four machines combined.
For a developer, this means they can work with proprietary code or data on their own premises, without renting cloud GPUs.
What's inside
Each node is built around the GB10 Grace Blackwell superchip: a 20-core Arm processor and a Blackwell GPU. A node has 128 GB of LPDDR5X memory shared between the CPU and GPU, so data does not need to be copied between system RAM and video memory. Peak performance of a single node is 1 petaflop in FP4 operations. A petaflop is a quadrillion operations per second, and FP4 is a 4-bit number format often used to run compressed models. Across the four nodes, that adds up to about 4 petaflops on the same metric. Total NVMe storage is 16 TB.
The nodes are linked in a ring through Nvidia ConnectX-7 network cards: each DGX Spark connects to two neighbors. As a result, no separate network switch is needed, which simplifies assembly on a desk or in a small lab. The announcement gives no details on the data transfer speed between nodes.
Who it's for and what about software
The kit is aimed at researchers and developers who need to run AI models locally, debug distributed applications and carry out resource-intensive calculations. Imagine a team writing a scientific program for a large supercomputer. They can first test the code on four nodes in their own lab, then submit it to the queue of an expensive system.
For such tasks, Nvidia is preparing deployment instructions for the HPC SDK. The package includes GPU-accelerated C, C++ and Fortran compilers, libraries and MPI message-passing tools for scientific applications.
Price and what to watch for
The kit can already be ordered, but Nvidia does not list a price on its website: for details, you have to submit a request. Retail prices offer a benchmark: four separate DGX Spark units with 128 GB of memory and a 4 TB SSD cost almost $28,000. That excludes networking and additional hardware. How much the ready-made kit will cost is unknown.
The practical takeaway is this. If the workload is constant and the data is sensitive (internal code, medical or legal documents), a local cluster can be a reasonable alternative to the cloud. If you need the model only occasionally, renting will most likely stay cheaper, but you should calculate your own workload to reach a firm conclusion.
There is also a caveat. The 700B-parameter claim comes from the manufacturer, and there are no independent measurements yet of generation speed on models that large. LPDDR5X memory is typically slower than the memory in server accelerators, so response speed on the largest models may turn out to be modest. Before buying, it makes sense to wait for the first independent tests and compare them with your requirements.
- Nov 19, 2026Nodul Runs DeepSeek V4.1 Flash on 2 H200s Instead of 8 and Speeds Up Generation to 36.4 Tokens/s
- Nov 19, 2026Rubin delivers 50 PFLOPS per chip, TPU 8t 12.6 — but Google wins on scale
- Nov 18, 2026AWS adds Dynamo to HyperPod: Qwen3-235B delivers 207 tokens/s per GPU instead of 101
- Nov 18, 2026Huang steps down as NVIDIA CEO, company loses more than $1 trillion in market cap
Key Questions Answered
What's inside?
Each node is built around the GB10 Grace Blackwell superchip: a 20-core Arm processor and a Blackwell GPU. A node has 128 GB of LPDDR5X memory shared between the CPU and GPU, so data does not need to be copied between system RAM and video memory. Peak performance of a single node is 1 petaflop in FP4 operations. A petaflop is a quadrillion operations per second, and FP4 is a 4-bit number format often used to run compressed models. Across the four nodes, that adds up to about 4 petaflops on the same metric.
Who it's for and what about software?
The kit is aimed at researchers and developers who need to run AI models locally, debug distributed applications and carry out resource-intensive calculations. Imagine a team writing a scientific program for a large supercomputer. They can first test the code on four nodes in their own lab, then submit it to the queue of an expensive system. For such tasks, Nvidia is preparing deployment instructions for the HPC SDK.
What are the key details on Price and what to watch for?
The kit can already be ordered, but Nvidia does not list a price on its website: for details, you have to submit a request. Retail prices offer a benchmark: four separate DGX Spark units with 128 GB of memory and a 4 TB SSD cost almost $28,000. That excludes networking and additional hardware. How much the ready-made kit will cost is unknown. The practical takeaway is this.
Test Frontier LLMs & Autonomous Agents in One Workspace
Run Claude Opus 5.5, GPT-6, Gemini 3.1, and DeepSeek side-by-side in Nomad AI (nomadnet.ai) — unified model routing, deep research, and multimodal workflows under one subscription.
The AI world, distilled — once a week
Seven stories that actually mattered, hand-picked. No noise, no reposts, no press releases.
Done! Check your inbox for a confirmation.