Gary Marcus

Rank 13 of 47
|
Score 84
6/27/2025, 5:00:02 PM
X
In reply to:
サイバー | cyber
@cyb3r_17
·
228d
@GaryMarcus What do you think is a better alternative than the transformer architecture then? I
Gary Marcus
@GaryMarcus
·
228d
BREAKING: Explosive new paper from MIT/Harvard/UChicago.

Things just got worse — a lot worse — for LLM’s and the myth that they can understand and reason.

The paper documents a pattern they called Potemkins, a kind of reasoning inconsistency (see figure below). They show that

The statement is part of a discussion on AI architecture and reasoning capabilities, engaging with a public issue in technology and AI development.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not cause harm and is part of a constructive dialogue about AI technology. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by encouraging further exploration of AI alternatives. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive dialogue by responding to a question about AI architecture. [+1]