Gary Marcus

Rank 13 of 47
|
Score 115
8/31/2025, 2:12:13 PM
X
In reply to:
David Manheim
@davidmanheim
·
9d
@GaryMarcus Yes, you said that these approaches wouldn't work, but you very much didn't predict how far they would get. The early prediction has to lose at least a little bit of predictive credit for each thing it doesn't predict will happen, as the systems get more capable - right?
Gary Marcus
@GaryMarcus
·
9d
@davidmanheim no, i laid out my cards (what i think the gaps are) in 2001 and have stuck to them .

and yes i don’t think those gaps can be filled without a solid neurosymbolic system

read my essay on o3/grok 4 vindicating neurosymbolic approaches
David Manheim
@davidmanheim
·
9d
@GaryMarcus As in the past, I think you're playing a "failures of the gaps" game; every time there's an advance, you note that it's imperfect, but when there's a failure, or a limitation of a method, you say it's fundamental and can only be fixed with neuro-symbolic AI.
Gary Marcus
@GaryMarcus
·
9d
Like I have been saying since 2001, embeddings aren’t enough.

Sooner or later. you are going to need true compositionality.

In the end neurosymbolic AI will win, and win big.
Rohan Paul
@rohanpaul_ai
·
10d
BRILLIANT @GoogleDeepMind research.

Even the best embeddings cannot represent all possible query-document combinations, which means some answers are mathematically impossible to recover.

Reveals a sharp truth, embedding models can only capture so many pairings, and beyond that,

The statement 'no' is a brief, dismissive response in an ongoing technical debate about AI methodologies. It lacks substantive engagement with the topic and does not contribute to constructive dialogue.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not actively cause harm, but its dismissive nature does not promote a positive discourse.
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement does not promote understanding, empathy, or compassion due to its brevity and dismissive tone. [-1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement does not engage in constructive criticism or dialogue, as it simply negates without explanation. [-1]