Gary Marcus

Rank 13 of 47
|
Score 83
5/18/2025, 12:41:58 AM
X
In reply to:
Carlos E. Perez
@IntuitMachine
·
241d
@GaryMarcus More precisely pre-training has reached maxes out at GPT-4 level capability, it's currently be extended via long reasoning approaches which is also maxing out at o3/o4 levels. Which is now being extended by AlphaEvolve meta-cognitive frameworks which are discover new solutions
Gary Marcus
@GaryMarcus
·
241d
!!!

If this true, it’s compelling evidence that pure pretraining scaling of LLMs has failed, and that that particular approach (which was I specifically said would hit a wall) has failed.
Flowers
@flowersslop
·
241d
I just got feedback from someone who def knows firsthand: GPT-5 will be built from entirely new models that haven’t been released yet. So we’re leaving GPT-4 and all its variants behind and getting a system made from components that aren’t part of anything currently available.

The statement is part of a technical discussion about the development and applicability of AI models, specifically AlphaEvolve, in the context of pre-training and reasoning capabilities. It questions the general applicability of AlphaEvolve, contributing to a broader debate on AI development strategies.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not cause harm; it is a neutral expression of skepticism about a technical claim.
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement does not promote understanding, empathy, or compassion, but it does engage in a technical discussion which can contribute to understanding in the field.
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism by questioning the applicability of AlphaEvolve without resorting to personal attacks. [+1]
  4. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds free speech by contributing to a technical debate and uses the platform responsibly. [+1]