Gary Marcus

Rank 14 of 47
|
Score 83
5/7/2024, 10:38:02 PM
X
In reply to:
John Borden (bjorkbat@bsky.social)
@Bjorkbat
·
598d
@GaryMarcus @ericschmidt I feel like I might be slightly crazy because people keep talking about scaling laws, but when you look at GPT-3 -> GPT-4, you have a 10x increase in cost and parameters, but I don't think anyone could reasonably say GPT-4 is 10x better. Maybe 2x.

Not even linear!
Gary Marcus
@GaryMarcus
·
598d
I could not disagree with you more strongly here, @ericschmidt.

Scaling has at least temporarily slowed.

The empirical data are clear: despite massive investments of time, labor and money, there has been no major advance in 14 months. The growth we see from GPT-2 to GPT-4 has…
Tsarathustra
@tsarnick
·
598d
Eric Schmidt says AI is under-hyped because the scaling laws are continuing without any loss of power

The statement '@Bjorkbat @ericschmidt Shh!!' in response to a discussion about AI scaling laws and the effectiveness of GPT-3 versus GPT-4 does not constitute public discourse. It lacks substantive engagement with the topic and does not contribute to the civic dialogue in a meaningful way. The statement appears to be a brief interjection or possibly an attempt to quiet the conversation, rather than a constructive contribution to the debate on AI development and scaling laws.