Daily Tech Wizard Newsletter

Stories / / By Daily Tech Wizard

OpenAI's Altman says PCs waste scarce DRAM, favours cloud

Your PC wastes scarce memory 95% of the time, says OpenAI's boss

OpenAI CEO Sam Altman says it's "quite terrible" for people to hold the world's limited DRAM in their own computers.

Speaking on the Cheeky Pint podcast, he said: "From a global allocation perspective, actually it's quite terrible to have everyone have a bunch of the world's limited supply of DRAM sitting in their own computer, and be used 5% of the time."

His argument is about utilization. In a supply-constrained environment, he said, you want maximum utilization in the cloud, and he added that many people's intuition is the opposite.

PC Gamer's Jess Kinghorn reads the comment as aimed less at gamers and more at solo AI enthusiasts craving compute power and local inference. She sees it as Altman bemoaning an inefficiency within the AI industry.

The backdrop is that AI data centres are consuming available memory, which drives up prices and makes DRAM scarce for PC gamers. Kinghorn finds it a bit rich for Altman to complain about a scarcity that OpenAI and ChatGPT helped create. She also notes the rapid AI build-out has caused many of big tech's greener energy goals to fall by the wayside.

AI companies face their own pressures too: Google's AI features appear to be cannibalising search ad revenue, Amazon's data centre build-out has made free cash flow negative, and investors haven't been overjoyed with AI stock performance, leading to a big sell-off earlier this month.

Do you think memory belongs in your PC or in the cloud?

Video: AI to Superintelligence on YouTube