Infrastructure3DNews AI→ original

Why ChatGPT Keeps Getting More Expensive: New GPUs Won't Save Prices

Inference (running deployed AI models) is getting more expensive as the load on infrastructure keeps growing. A new generation of GPUs and specialized accelerators promises to ease demand for compute and cut costs for developers. But users are unlikely to see lower prices: companies won't cut their margins.

AI-processed from 3DNews AI; edited by Hamidun News
Why ChatGPT Keeps Getting More Expensive: New GPUs Won't Save Prices
Source: 3DNews AI. Collage: Hamidun News.
Listen to article

Every day, ChatGPT, DeepSeek, and other AI models get more expensive to run as the load on infrastructure keeps growing.

What is inference in neural networks?

Inference is the phase in which a trained model does its job and answers user requests. A model is trained once, then run thousands of times a day across thousands of servers.

Why are

ChatGPT and other AI models getting more expensive if GPUs are getting cheaper? Every user request has to be computed on a GPU. When millions of people message ChatGPT at the same time, that creates a massive load that demands expensive hardware, even as the chips themselves get cheaper.

Why are ChatGPT and AI services getting more expensive?

The cause is the growing load on infrastructure. Every user request requires computation on graphics processing units (GPUs), and when millions of people use ChatGPT at the same time, that puts enormous strain on the company's servers.

Story

Key Questions Answered

What is inference in neural networks?

Inference is the phase in which a trained model does its job and answers user requests. A model is trained once, then run thousands of times a day across thousands of servers.

Why are ChatGPT and other AI models getting more expensive if GPUs are getting cheaper?

Every user request has to be computed on a GPU. When millions of people message ChatGPT at the same time, that creates a massive load that demands expensive hardware, even as the chips themselves get cheaper.

Why are ChatGPT and AI services getting more expensive?

The cause is the growing load on infrastructure. Every user request requires computation on graphics processing units (GPUs), and when millions of people use ChatGPT at the same time, that puts enormous strain on the company's servers.

ZK
Zhemal Khamidun — CPO at Alpina Digital, product manager of AlpinaGPT. Building AI products since 2019. Hamidun News is a pet project that grew into a production aggregator with 6,000+ readers.
✦ Unified AI Workspace · Nomad

Test Frontier LLMs & Autonomous Agents in One Workspace

Run Claude Opus 5.5, GPT-6, Gemini 3.1, and DeepSeek side-by-side in Nomad AI (nomadnet.ai) — unified model routing, deep research, and multimodal workflows under one subscription.

Try Nomad AI →Launch Nomad Agent
What do you think?
Loading comments…