codeberg

Demand for AI hardware surged so much that major memory manufacturers are already sold out for 2026 production. That's a clear sign this isn't slowing down anytime soon.

Quanta

Everyone wants AI, but nobody talks about the infrastructure cost

Totally

This is the real bottleneck, not software.

Shortages are going to push prices up everywhere
Have you tried turning it off and on again?

QuantumKnight

RAM-ageddon. No wonder RAM and DISK Drives have shot up
To infinity & 🐝 ond

Totally

got plenty of room won't be upgrading mine for a few years
Have you tried turning it off and on again?

QuantumKnight

That matches what the more reliable sources are saying. The speed of the news cycle means most things get forgotten before they are properly resolved.

Curious to see how this develops.

I trust recommendations from people who have actually used it over a month, not first impressions
To infinity & 🐝 ond

QuantumKnight

From what I saw that checks out. From what I have seen the gap between headlines and reality is still pretty wide.

Worth keeping an eye on
To infinity & 🐝 ond

codeberg

That is the practical answer rather than the theoretical one. Usually the issue is software and not hardware even when it feels like hardware.

That is the sensible starting point.

Most AI tools I have tried are impressive for a session and then disappear from my routine

Totally

One thing that stands out to me is how much the conversation revolves around the companies making the chips, while the companies buying them barely get mentioned.

Every major tech company is racing to build larger AI infrastructure because nobody wants to be the one caught short if demand keeps growing. Even if they don't fully utilize everything on day one, having capacity available is becoming a competitive advantage in itself. That creates a cycle where everyone feels pressured to order more hardware simply because everyone else is doing the same.

At some point that cycle will settle down, but trying to predict when is anyone's guess. Until then, manufacturers are in a pretty comfortable position with years of orders already sitting in the pipeline.
Have you tried turning it off and on again?

codeberg

People have compared this to previous tech bubbles, but I think there's an important difference.

During some past booms, companies were buying hardware because they hoped people would eventually find a use for it. This time the demand is already there. Cloud providers have customers waiting, research labs want more compute, businesses are integrating AI into products, and developers keep finding new workloads to run.

That doesn't mean demand will grow forever, but it does make this feel more sustainable than a lot of previous technology crazes.

The interesting question isn't whether demand exists. It's whether the industry can build fast enough without creating shortages somewhere else along the line.

QuantumDay

Same here. Thanks for that.

I trust recommendations from people who have actually used it over a month, not first impressions
I'm not always right, but I'm never wrong ;)

Lucy05

Part of me thinks we're seeing a bit of panic buying as well. If you're told there won't be any stock for two years, you're going to place your order now, even if you don't need everything immediately.

That just makes the waiting list even longer.
Powering through bugs  optimizing systems for peak oz performance

VB

It's funny how quickly AI has turned into an infrastructure race. A couple of years ago everyone was talking about models and benchmarks. Now it's fabs, packaging, memory, power delivery, and cooling.

Not quite as glamorous, but arguably far more important.
The truth is usually more complicated than the headline

Totally

Cheers for that. Ha, fair enough.

The gap between what people claim about AI and what it actually does in practice is still wide
Have you tried turning it off and on again?

QueueDay

Not bad at all. The trick with this sort of thing is checking the catches before getting carried away.

Might save you more than you think.

Most AI tools I have tried are impressive for a session and then disappear from my routine

ElPresidente

People keep saying new competitors will appear, and they probably will. The difficult part isn't designing an accelerator, it's producing millions of them reliably and at competitive prices.

That's a much taller order than people sometimes assume.

veritas.io

This reminds me of previous tech booms where demand exploded faster than anyone expected. Every time the industry says they'll catch up "next year," demand seems to have doubled again.

It's almost like the finish line keeps moving.
Coffee first. Questions later.

GameChanger

QuoteKind of depends I think. Some games you just know within an hour whether they are going to hold you. Still playing it tbh. ;D

That is the sensible approach. Every bit helps at the moment.

Most people use AI as a search engine replacement and miss what it is actually good at

Q

Been following this thread and that seems right. Useful to know.

The gap between what people claim about AI and what it actually does in practice is still wide. :)

MrRicardo

There's also the question of whether everyone actually needs the absolute fastest hardware.

For a lot of businesses, older generations are probably more than capable of running the workloads they care about. Not every AI project needs a warehouse full of top-end accelerators.

VB

That was not my experience at all. The thing that keeps me going back is usually the atmosphere more than the mechanics.

Can't really go wrong with it. :D
The truth is usually more complicated than the headline

TommyB_20

One thing that's easy to forget is that software keeps improving too.

A model that needed eight GPUs today might only need four in a year's time because developers found better ways to optimize it. Hardware gets all the headlines, but software efficiency can completely change the equation.

Lazy Sentinel

Whenever there's this much demand, prices have a habit of staying high longer than expected.

Nobody involved in the supply chain is going to rush into a price war while customers are lining up years in advance. From a business perspective, why would they?

veritas.io

There is a bit more to it than that I think. Should sort it if the basics are fine. :)
Coffee first. Questions later.

Totally

The biggest bottleneck five years from now might not even be chips.

Power availability, cooling capacity, networking, and skilled engineers could all become bigger headaches than finding the silicon itself. Building massive AI clusters isn't exactly plug-and-play.
Have you tried turning it off and on again?

Fox

I don't know, I had a different experience. Can't really go wrong with it. :D

Amy96

There's a certain irony in all of this.

AI is supposed to make everything faster, yet the industry supporting it is booked solid years into the future. That's quite a contrast. :)

PaleCipher

Really like that take on it. Glad this came up.

The free tier is usually enough unless you have a very specific workflow

Oscar_86

That is how I do it and it works. The problem with most money saving advice is it assumes you have the time to do it all.

I will keep an eye on it
Still figuring it all out

BiscuitTin

QuoteI don't know, I had a different experience. Can't really go wrong with it. :D

Cannot really argue with that. Let us know how it goes

Marnie

QuoteReally like that take on it. Glad this came up. The free tier is usually enough unless you have a very specific workflow.

That is the part most people skip over. The gap between what something says and what it means is often where the most interesting stuff lives.

Curious what others make of it
Saving for a trip to Ireland this year.

Jeffy

Quote
QuoteI don't know, I had a different experience. Can't really go wrong with it. :D
Cannot really argue with that. Let us know how

Kind of what I thought yeah. A lot of stuff sounds good until you actually spend a few hours with it.

Still playing it tbh.

The energy cost of AI is a story that is not getting nearly enough attention. :D

Rory84

QuoteI don't know, I had a different experience. Can't really go wrong with it. :D

Not sure I am fully with you on that one. That is the thing isn't it.

Good thread this.

The useful stuff is harder to spot because there is so much noise around it

QueueDay

QuoteReally like that take on it. Glad this came up. The free tier is usually enough unless you have a very specific workflow. That is the part m

Can't argue with that. Thanks for that

GhostRider

There is definitely real demand, but hype is mixed in there too
The challenge is separating projects that create value from projects that just want to put the letters AI in a presentation
Here more than I should be

Dylan

I'd love to know how many purchased accelerators are sitting underutilized right now
Companies are notorious for buying capacity before they really know what they'll do with it
My team is always one signing away

NeutrinoX74

I remember when graphics cards were mainly discussed by gamers
Now data centers are hoovering up chips faster than most people can even upgrade their PCs. I had to buy second hand due to cost

Ben

Good news for semiconductor companies
Not so great news for anyone hoping the market would calm down anytime soon

Dave

People keep comparing this to past tech booms, but AI seems broader
It's not one industry chasing chips, it's practically every industry at once
My team is always one signing away

Danny47

The whole thing reminds me of those stories where everyone rushes to sell shovels during a gold rush
The chip makers are doing very well right now
Gunners for life.

WaveFunction

Part of me wonders how much of this is genuine need and how much is companies panic buying because they are afraid of falling behind competitors
ISA maxed. Costs minimised.

BigDog_Fan

My prediction is that efficiency becomes the next battleground
The company that can do more with fewer chips could save an absolute fortune

Weary Renegade

I work in IT and the amount of AI talk compared to actual deployment is hilarious
Meetings are full of grand plans while the hardware budget is doing all the heavy lifting
Still figuring it all out

Courier53

The funny thing is most users never see these chips
They just notice that an app suddenly has a chatbot and have no idea there's a warehouse full of expensive hardware behind it
Long time lurker, first time poster

Andy81

At this rate someone will release a smart fridge powered by a cluster of AI accelerators just because they can
Then investors will call it disruptive

Rory_39

History says whenever demand explodes this fast somebody eventually overbuilds
The hard part is figuring out when that point arrives

HiggsField29

Meanwhile I'm still waiting for reasonably priced hardware at retail
Every time a new AI boom story appears I assume prices are about to stay high for another year
Works on my machine :D

Isaac80

The supply side is what fascinates me. Designing chips is hard enough, but scaling manufacturing to meet global demand sounds like a nightmare

HeartbreakKid_Fan

The demand doesn't surprise me at all
Every company suddenly decided it needs an AI strategy and that means buying hardware somewhere along the chain

MondayMoan51

It feels a bit like a gold rush
The question is whether all this spending turns into sustainable business or if some of these projects never make their money back

Related Topics (1)

Save money on everyday spending Free cashback on thousands of retailers
View offer