Memory Is the Constraint on Which Model You Can Run

The Short Answer

Memory, not compute, now decides which AI model an enterprise can run and where. WSTS puts 2026 memory revenue above $800 billion, up about 250% year over year, and Huawei has raised Ascend 950DT prices 20–50% on HBM costs. The lever you control is model choice, quantization and caching, and with ibl.ai you own all the code and the data.

No enterprise is going to fix the HBM supply chain. Every enterprise can decide what it asks memory to hold.

How much have memory and AI chip prices actually moved in 2026?

Enough that memory is now more than half the semiconductor industry by revenue.

The World Semiconductor Trade Statistics organization's spring forecast, reported on 5 June 2026, puts the global semiconductor market at USD 1.51 trillion in 2026, a 90% increase.

WSTS attributes the revision overwhelmingly to one segment: memory, forecast to surge around 250% year over year to more than USD 800 billion, against Logic at 37% growth. WSTS projects roughly USD 1.9 trillion for 2027.

One correction to the framing that usually travels with this story. A widely circulated claim holds that Nomura projects $3.7 trillion in memory revenue by 2030, "larger than the entire semiconductor industry is worth today."

We could not verify that figure against Nomura's own note or any major outlet, so it is not used here. The comparison is also incommensurable: a 2030 forecast set against a present-day industry total measures two different years.

The verified version is more useful anyway. Memory did not overtake a past industry total at some point in the future. It is already over half of a $1.51 trillion industry this year.

Downstream prices moved with it. TrendForce, on 9 July 2026, forecast server DRAM contract prices up 13–18% quarter over quarter in 3Q26.

The same release noted that several U.S. cloud providers hold multi-year agreements capping their prices, so the increases now shift "toward customers without LTAs."

Then the accelerators. Reuters reported on 10 September 2026 that Huawei's Ascend 950DT is quoted above 250,000 yuan (about $37,255), 20% to 50% above quotes given to customers roughly two months earlier.

That last detail corrects a common retelling. The move was reported last week, but the comparison window is about two months, not one.

And Reuters attributes the cause to grey-market HBM sourcing, on three people familiar with the pricing who declined to be identified, rather than inferring it.

Why does HBM supply decide which model an enterprise can run?

Because memory capacity is a hard gate, and the gap between models on that gate is now about two orders of magnitude.

Two real deployments from the last three weeks make it concrete.

Tencent open-sourced Hy4 preview under Apache-2.0 on 28 August 2026: 770B total parameters, 49B active, and roughly 1.56 TB of BF16 weights. A standard 8×H100 node carries 640 GB of VRAM, so it cannot load the model. Neither can it load the FP8 checkpoint at about 814 GB.

The licence is fully permissive. The hardware requirement is not negotiable by licence.

Two weeks later, NPCI unveiled FiMI Banking on 10 September 2026, targeting Gemma 4 E4B: 4.5B effective parameters and a 16 GB BF16 checkpoint. NPCI's paper states that one 80 GB GPU holds the model and supports hundreds of concurrent sessions.

Roughly 100× apart in bytes. Both shipped in the same three-week window. Both are credible for real work in their own class.

That ratio is the whole enterprise decision. A model that fits the memory you already have is deployable next quarter.

A model that needs a node you have not bought, in a market where the large cloud providers hold price-capped supply and you do not, is a procurement project with an unknown close date.

Which layer of the AI stack can an enterprise actually own?

Not the one absorbing the capital. The buildout numbers make the boundary obvious.

Broadcom's Q3 FY2026 results, released 2 September 2026, report AI semiconductor revenue of $16.7 billion, up 221% year over year, with Q4 guided to $21.7 billion.

On that call CEO Hock Tan projected AI semiconductor revenue of roughly $115 billion in FY2027 and $230 billion in FY2028, and named Anthropic as on track to become Broadcom's largest custom chip customer in 2027.

Three precisions the usual summary drops. These are Tan's projections stated on the 2 September call, not reaffirmed contractual targets.

The figures cover custom accelerators and networking silicon, not custom chips alone. And Broadcom itself named the customer, which is unusual and is the part worth noticing.

At that scale, the accelerator, the HBM stack and the fab are not layers an enterprise buys its way into. They are layers whose price it inherits.

The layers above are different. Which model runs, at what precision, against which cache, on which hardware, under whose contract — those are decisions made in software, and they are the ones that convert a memory price into an operating cost you can influence.

What can an enterprise do about memory prices it does not control?

Four things, all of which are configuration rather than procurement.

Right-size the model. The 16 GB banking model and the 1.56 TB frontier model are not competing for the same job. Most enterprise agent workloads are closer to the first. Choosing the smaller capable model is the single largest memory decision available.

Quantize. Google's TurboQuant cuts KV-cache memory at least 6× with no accuracy loss. KV cache is frequently the binding constraint on a self-hosted deployment, not the weights.

Cache. Cache hits are priced at a fraction of uncached input on every major API, and cache design is an inference-engineering decision rather than an architecture one.

Keep the exit. If the platform can route to a different model, a price move on any one of them is a configuration change. If it cannot, it is a renegotiation.

This is also where per-seat pricing fails structurally rather than merely costing more. A per-seat subscription prices your bill against headcount while the vendor's cost base moves with memory.

You absorb the pass-through, and you hold none of the four levers above, because none of them is yours to pull.

How does ibl.ai turn a memory price shock into a routing decision?

By putting every one of those levers on your side of the contract.

With ibl.ai you own all the code and the data.

The platform runs on your own infrastructure with full source code, so model selection, quantization, batching and cache policy are settings you change rather than roadmap items you request.

It is model-agnostic across any LLM, so a 16 GB open-weight model and a frontier API endpoint are both routing targets. It is usage-based with no per-seat pricing, so the bill tracks tokens consumed rather than employees hired.

And it will deploy anywhere, from your own cloud to on-premise, GovCloud or a fully air-gapped network.

The practical effect is that a memory-driven price move becomes a routing change made in an afternoon, instead of a contract you reopen next year.

1.6M+ users across 400+ organizations run the platform this way, including NVIDIA, MIT, and Syracuse University.

ibl.ai is family-owned and operated from New York, NY.

Related reading: Tencent's 770B Hy4 is Apache-2.0, and 1.56 TB of weights and NPCI's bank model fits in 16 GB — the two ends of the memory gate; Google's TurboQuant cuts AI memory 6× — the compression lever you control; and the alpha is in inference engineering, not architecture — why caching and routing beat model selection alone.

Sources: the 2026 semiconductor and memory forecasts from WSTS, dated 5 June 2026 by DigiTimes; server DRAM contract pricing and the long-term-agreement split from TrendForce, 9 July 2026; the Huawei and Cambricon price increases from Reuters, 10 September 2026; Broadcom's Q3 FY2026 AI revenue from its 2 September 2026 results release and the FY2027/FY2028 projections and Anthropic remark from reporting on that earnings call. The $3.7 trillion Nomura figure circulating with this story could not be verified and is not used.