Gary Marcus

Rank 16 of 47
|
Score 64
2/18/2025, 8:17:32 AM
X
In reply to:
Gary Marcus
@GaryMarcus
·
271d
@emollick Are you saying that the new data fit eg the original Chinchilla scaling laws with original exponents?

Or something much weaker, like “returns may be diminishing but there are some continued improvements with 15xing compute, at least on cherry picked benchmarks?”

Could you…
Ethan Mollick
@emollick
·
271d
Based on the early stats, looks like Grok 3 base is going to be a very solid frontier model (leads Chatbot Arena), suggesting pre-training scaling law continues with linear improvements to 10x compute

No Reasoner, yet (one is coming?) so GPQA scores are still below o3-mini (77%)

The statement is part of a technical discussion about AI model scaling and performance. It questions the level of pretraining required for a model to be considered equivalent to GPT-5, suggesting that Grok 3, despite its scaling, may not meet that standard. The tone is analytical and seeks clarification on AI development benchmarks.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does no harm and is focused on technical inquiry. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    It promotes understanding by engaging in a detailed discussion about AI model scaling. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive dialogue by questioning and seeking clarification without personal attacks. [+1]