Gary Marcus

Rank 22 of 47
|
Score 17
1/6/2025, 4:44:45 AM
X
In reply to:
Gary Marcus
@GaryMarcus
·
319d
2. A recent paper on Putnam math problems showed a similar failure on distribution shift, showing 30% decement by o1 on math problems with minor variations eg on variable names.

Same old story, different set of problems.

https://openreview.net/forum?id=…
Gary Marcus
@GaryMarcus
·
319d
1. The problem of distribution shift, well-tested in Apple’s 2024 reasoning paper, which goes back to my own 1998 work, continues.

LLMs, like their predecessors generalize well to similar items but struggle with reliability in unfamiliar regimes, even minor variations sometimes…
Gary Marcus
@GaryMarcus
·
319d
An MIT professor just asked me, how can you be so confident that OpenAI isn’t very close to AGI?

Here is a thread of links to a several recent observations that I think show how far we are from robust intelligence.

Importantly, all of them are *known* problems, many that I…

The statement is part of a public discourse on the limitations of AI, specifically regarding commonsense reasoning and distribution shift in large language models. It engages with ongoing debates about AI capabilities and their implications for achieving artificial general intelligence (AGI).

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not use harmful language and focuses on discussing AI limitations, adhering to the principle of doing no harm. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by providing a link to a detailed analysis of AI's commonsense reasoning limitations, fostering informed discussion. [+2]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism of AI models, focusing on their technical limitations without resorting to personal attacks. [+2]
  4. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds free speech principles by responsibly sharing information and analysis on a public platform. [+1]