Gary Marcus

Rank 15 of 47
|
Score 76
6/16/2024, 1:28:03 PM
X
In reply to:
nikhil kamma
@nikhilkamma
·
512d
@thegartsy @GaryMarcus and people like Hinton maybe extrapolating not based on LLMs but based on neurosymbolic AI as well. So this is a great point about that progress might happen very fast. Wonder what @GaryMarcus thinks
Tess Hegarty
@thegartsy
·
512d
@GaryMarcus Yes it does appear that this particular research points to a combo of techniques.

It’s a good point that it would be good to also share & compare to benchmarks for just LLMs alone.

But at the same time, it seems to me that I don’t particularly care what combo of techniques is…
Gary Marcus
@GaryMarcus
·
512d
@thegartsy This is actually an LLM combined with a classical symbolic search mechanism. an LLM on its own could not do this.
Tess Hegarty
@thegartsy
·
512d
I’ve seen people compare LLMs to calculators, or search, or call it just mimicry. That seems so disingenuous to me, relative to all the different benchmarks LLMs have achieved.
Deedy
@deedydas
·
512d
It's finally here. Q* rings true. Tiny LLMs are as good at math as a frontier model.

By using the same techniques Google used to solve Go (MTCS and backprop), Llama8B gets 96.7% on math benchmark GSM8K!

That’s better than GPT-4, Claude and Gemini, with 200x less parameters!

The statement engages in a technical discussion about the development and potential of artificial general intelligence (AGI) and neurosymbolic AI, referencing prominent figures in the field. It contributes to the public discourse on AI advancements and the necessary breakthroughs for AGI.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not cause harm and is focused on a technical discussion, thus adhering to the principle of doing no harm. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by engaging in a detailed discussion about AI techniques and their implications, aligning with the principle of promoting understanding, empathy, and compassion. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive dialogue without personal attacks, adhering to the principle of engaging in constructive criticism and dialogue. [+1]