Gary Marcus

Rank 13 of 47

Score 115

@boazbaraktcs 1. the returns that i think are diminishing are on base models with pure pretraining scaling, which is what I warned about in 2022
2. i think the gains are increasingly coming from the use of (neuro)symbolic tools.
3. i agree that o3 is better that GPT-4.

7/22/2025, 3:34:03 AM

In reply to:

Boaz Barak

@boazbaraktcs

53d

@GaryMarcus No intention to insult. Seeing the progress from GPT-4 to o3, I think the returns are anything but diminishing but to each their own.

Gary Marcus

@GaryMarcus

54d

Even in my meme below I didn’t plot zero progress. I have often talked about diminishing returns. I have said publicly e.g., that o1 and o3 and the new model are impressive. Never once did I say that the field has made no progress post GPT-4. (I did say that certain problems

Boaz Barak

@boazbaraktcs

54d

Yes we really have made no progress

The statement engages in a technical discussion about the progress and effectiveness of AI models, specifically comparing GPT-4 and o3. It suggests that while base model scaling may have diminishing returns, advancements are being made through neuro-symbolic tools. The tone is analytical and contributes to the discourse on AI development.

Principle 1:
I will strive to do no harm with my words and actions.
The statement does no harm and is focused on technical analysis rather than personal attacks. [+1]
Principle 3:
I will use my words and actions to promote understanding, empathy, and compassion.
It promotes understanding by discussing specific aspects of AI development and progress. [+1]
Principle 4:
I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
Engages in constructive dialogue by acknowledging different perspectives and providing a reasoned argument. [+1]