Gary Marcus

Rank 13 of 47
|
Score 84
6/27/2025, 6:30:33 PM
X
In reply to:
RV
@renoirvieira
·
228d
@GaryMarcus Do you realize that LLMs will only get better ?
Gary Marcus
@GaryMarcus
·
229d
BREAKING: Explosive new paper from MIT/Harvard/UChicago.

Things just got worse — a lot worse — for LLM’s and the myth that they can understand and reason.

The paper documents a pattern they called Potemkins, a kind of reasoning inconsistency (see figure below). They show that

The statement engages in a discussion about the development and limitations of large language models (LLMs), specifically addressing expectations for future improvements. It suggests skepticism about significant advancements in upcoming versions, which contributes to the ongoing debate about AI capabilities.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not cause harm and contributes to a reasoned discussion about AI development. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    It promotes understanding by acknowledging the potential limitations of LLMs, fostering a realistic view of AI progress. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages constructively with differing opinions, providing a counterpoint to the idea that LLMs will continuously improve. [+1]