China's daily AI token calls pass 500 trillion, CCTV Finance says
我国日均词元调用量已突破500万亿
A gauge of how fast AI usage, and demand for chips and compute, is growing in China.
Daily token calls in China have passed 500 trillion and demand for computing power has surged, CCTV Finance reported, as cited by Wallstreetcn. The report said new AI compute can't be added fast enough in the short term, so operators are squeezing more out of existing capacity, pointing to the Mooncake inference system, which it said handles 75% more user requests on the same hardware.