AI Scaling Hits Diminishing Returns as Gary Marcus Warns of Bubble Burst
Generative AI models are showing diminishing returns from scaling up parameters and compute, according to reports and experts including Gary Marcus and Ilya Sutskever. Marcus warns that if the industry realizes these limits, sky-high valuations of companies like OpenAI and Microsoft could collapse as the economics of training large models remain costly and revenue uncertain.