Gary Marcus

Rank 12 of 47
|
Score 83
6/25/2025, 1:24:55 PM
X
In reply to:
Rajeev Gangal
@GangalRajeev
·
221d
@GaryMarcus @ParshinShojaee dunno what all the hullabaloo is about. That was quite apparent. What battle has apple won other than touting it's own intelligence? they should have benchmark that as well. Just a messaging strategy
Gary Marcus
@GaryMarcus
·
221d
Wow!

The core finding in the much-maligned Apple paper from @ParshinShojaee et al – that reasoning models generalize poorly in the face of complexity – has been conceptually replicated three times in three weeks.

C. Opus sure didn’t see that coming. And a lot of people owe Ms.
Laura Ruis
@LauraRuis
·
221d
@GaryMarcus @JonnyCoook @silviasapora @aahmadian_ @akbirkhan @_rockt @j_foerst @ParshinShojaee @i_mirzadeh @MFarajtabar @nouhadziri The programs we look at are quite simple and all represent novel combinations of familiar operations. We also find lower performance for more complex programs, especially for the compositions. Also, I have a sense that LLMs can handle OOD problems easier when represented in code

The statement is part of a broader discussion on the performance and generalization capabilities of reasoning models, particularly in the context of complexity, as highlighted by recent research papers. The conversation involves multiple participants discussing the implications of these findings, which contributes to public discourse on AI and machine learning.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not appear to cause harm; it invites others to read essays for further understanding, which is a neutral action.
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by directing others to essays that presumably elaborate on the significance of the research findings. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement does not engage in personal attacks or ad hominem arguments; it maintains a focus on the research and its implications. [+1]
  4. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement uses the platform to share information and promote further reading, which is a responsible use of free speech. [+1]