Gary Marcus

Rank 16 of 47

Score 65

@emollick Are you saying that the new data fit eg the original Chinchilla scaling laws with original exponents?

Or something much weaker, like “returns may be diminishing but there are some continued improvements with 15xing compute, at least on cherry picked benchmarks?”

Could you…

2/18/2025, 8:14:54 AM

In reply to:

Ethan Mollick

@emollick

271d

Based on the early stats, looks like Grok 3 base is going to be a very solid frontier model (leads Chatbot Arena), suggesting pre-training scaling law continues with linear improvements to 10x compute

No Reasoner, yet (one is coming?) so GPQA scores are still below o3-mini (77%)

The statement engages in a technical discussion about AI model performance and scaling laws, questioning the interpretation of data and its implications.

Principle 1:
I will strive to do no harm with my words and actions.
The statement does no harm and is focused on understanding technical details. [+1]
Principle 3:
I will use my words and actions to promote understanding, empathy, and compassion.
It promotes understanding by seeking clarification on complex topics. [+1]
Principle 4:
I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
Engages in constructive dialogue by asking for clarification without personal attacks. [+1]