SenseTime just laid out a plan to hit 10 trillion AI tokens a day, and its own report tells you not to fully trust it yet

Started by Sharp Scholar, Jul 22, 2026, 06:50 PM

Previous topic - Next topic

0 Members and 1 Guest are viewing this topic.

Topic: SenseTime just laid out a plan to hit 10 trillion AI tokens a day, and its own report tells you not to fully trust it yet   Views(Read 97 times)

Sharp Scholar

Chinese AI company SenseTime has launched what it calls the Galaxy Project, bringing together nearly 20 partners spanning domestic chip vendors, component suppliers and infrastructure firms to scale up China's homegrown AI computing capacity. Co-founder Yang Fan framed the plan around a closed loop connecting chip level technology, ecosystem partnerships and commercial deployment, arguing domestic production isn't simply about swapping out individual chips, but coordinating the entire chain from silicon to actual applications

The headline numbers are genuinely striking, and worth reading with some caution built in. SenseTime says its large scale device platform currently processes an average of 2.42 trillion tokens daily, and projects that figure will climb roughly 25-fold to 10 trillion tokens per day by the fourth quarter of 2026. That's a forecast, not a measured result, and the same caveat applies to SenseTime's other headline claims, an 85 to 152 percent increase in Model FLOPs Utilisation on mainstream domestic chips, inference cost effectiveness the company puts at 1.25 times that of Nvidia's H-series parts, and a new efficiency metric called Tokens Per Watt paired with an 80 percent increase in token output per unit of electricity cost. None of these figures come with independent, third party benchmarking yet, and the gap between a vendor's optimised test cluster and a customer's messier production environment tends to be exactly where numbers like these soften in practice

A real, longstanding problem the project directly targets is software fragmentation, domestic AI chips have historically struggled because models trained for one architecture often need reworking to run on a different one. SenseTime says it's built a full stack adaptation layer spanning models, frameworks, operators, toolchains and hardware specifically to let customers move workloads across different domestic chip vendors without extensive rewrites, pointing to a claimed threefold speedup in a protein prediction workload and a 93 percent multi-card parallel acceleration ratio for video generation models as early evidence

Beyond near term infrastructure, SenseTime outlined considerably longer horizon bets too, optical computing, quantum computing applications for AI optimisation, and a space computing partnership with satellite manufacturer Guoxing Aerospace aiming for a first satellite launch this year building toward thousands of computing satellites by 2030. Physical build-out is already underway on the ground as well, a Shanghai facility SenseTime says is rated at the country's first 5A intelligent computing level, a new Yancheng site with 3,000 petaflops of initial capacity, and plans for what would be China's first overseas domestic computing cluster, based in Saudi Arabia. The real test for all of this, as with most ambitious infrastructure roadmaps, is simply whether SenseTime's own Q4 2026 numbers end up matching what it's projecting today

Brittle Coder

The honesty embedded in the source reporting itself, flagging that these are vendor projections without third party verification, is worth appreciating, a lot of infrastructure announcements like this get repeated uncritically

Quarry16

The software fragmentation problem across different domestic chip architectures is the unglamorous but genuinely important piece here, raw chip performance means little if every model needs a rewrite to actually run on it
Long time lurker, first time qubit

BlackMamba

A 25-fold jump in daily token throughput within roughly six months is an extraordinarily aggressive projection, that's the kind of number that either reflects genuine confidence or serious optimism getting ahead of engineering reality
Be excellent to each other

Merchant97

The satellite computing ambition feels like the furthest out and least grounded part of the whole announcement, thousands of computing satellites by 2030 has no real precedent to measure that timeline against
All original content unless stated

Thomas75

Nearly 20 partners across chipmakers, component suppliers and infrastructure firms coordinating on one unified roadmap is a large scale industrial mobilization, regardless of whether every individual performance claim holds up

Ryan98

Planning a computing cluster in Saudi Arabia as China's first overseas domestic compute base is an interesting geopolitical signal, shows this effort is explicitly about export and influence, not just serving the domestic Chinese market

Donna48

The scale of this ambition is what stands out. Ten trillion AI tokens per day is the kind of number that sounds almost fictional until you remember how quickly compute demand has exploded.

The difficult part is not just generating tokens, but doing it efficiently, reliably, and at a cost that makes sense.
I bench press excuses more than actual weights

ProperJobs

The interesting detail is that the company itself is warning people not to take every projection as guaranteed.

That level of self-awareness is actually a good sign.

Every major technology wave has had plenty of optimistic forecasts that aged badly. :)
YNWA.

DeanAmbrose

A nearly twenty-partner ecosystem is a serious coordination effort.

AI infrastructure is no longer just about having a good model. It depends on chips, networking, storage, power, cooling, and software all working together.

The boring pieces are often where the biggest challenges hide.

Taz

Big targets are useful because they force companies to build toward something ambitious.

The danger is when the target becomes the story instead of the actual results.

A roadmap is not the same thing as a finished highway. ;)

Maisie84

The token count race reminds me a bit of the old processor speed wars.

Everyone loved quoting the biggest number, but real-world performance depended on efficiency, software, and whether people actually needed all that power.

AI will probably follow the same pattern.

ArcMage

There is definitely a strategic advantage to building a full domestic supply chain.

Relying on one part of the ecosystem from a single source can become a major weakness when technology competition gets intense.

Having local capability has value beyond just speed.

Inference Reuben

The phrase "10 trillion tokens a day" is impressive marketing because it is easy to repeat.

The harder question is what those tokens are doing.

A billion useless outputs are still useless outputs. Quality and usefulness matter just as much as scale.

Analog Jay

It is funny how AI discussions have turned into a competition over giant numbers. :D

Soon someone will announce they processed enough tokens to make a digital mountain and everyone will ask whether the mountain is actually useful.

Wizard

Partnerships like this could accelerate progress, but they also create complexity.

When dozens of companies depend on one shared roadmap, disagreements over standards, priorities, and technical direction can slow things down.

Related Topics (2)

Save money on everyday spending Free cashback on thousands of retailers
View offer