Artificial Intelligence1 min read

When talking about local inference, Sam Altman says supply-constrained DRAM is better used in data centers than sitting in PCs and "being used 5% of the time" (Andrew E. Freedman/Tom's Hardware)

By · Published by Everything Blog

In short

OpenAI CEO Sam Altman argued that supply-constrained DRAM is far better utilized inside centralized data centers than in local personal computers. He asserted that memory allocated to individual PCs largely sits idle, noting it is typically utilized only five percent of the time. Because Altman relies on memory-heavy enterprise facilities to power operations, he maintains that concentrating hardware resources optimizes overall system efficiency.

Key points

  • Directing limited DRAM supplies toward enterprise data centers yields greater overall eff…: Directing limited DRAM supplies toward enterprise data centers yields greater overall efficiency than distributing them to PCs.
  • Consumer personal computers underutilize high-demand hardware components during routine d…: Consumer personal computers underutilize high-demand hardware components during routine day-to-day operation.
  • Centralized infrastructure remains the preferred approach for high-demand processing over…: Centralized infrastructure remains the preferred approach for high-demand processing over distributed local computing setups.

Sources checked by our analysis pipeline: 1

Andrew E. Freedman / Tom's Hardware : When talking about local inference, Sam Altman says supply-constrained DRAM is better used in data centers than sitting in PCs and “being used 5% of the time”   —  With data centers full of RAM, your PC is apparently the problem. … OpenAI CEO Sam Altman has data centers full of memory …

Artificial Intelligence