Gary Marcus

Rank 13 of 47
|
Score 83
5/18/2025, 12:29:53 AM
X
In reply to:
Flowers
@flowersslop
·
241d
@GaryMarcus I’m not calling GPT-5 a breakthrough, nor dismissing it. Just saying: it’s built on models we haven’t seen yet. pretraining is, after all, still very much alive. But some have speculated it is just the current models with some clever autorouting and THAT is not the case.
Gary Marcus
@GaryMarcus
·
241d
!!!

If this true, it’s compelling evidence that pure pretraining scaling of LLMs has failed, and that that particular approach (which was I specifically said would hit a wall) has failed.
Flowers
@flowersslop
·
241d
I just got feedback from someone who def knows firsthand: GPT-5 will be built from entirely new models that haven’t been released yet. So we’re leaving GPT-4 and all its variants behind and getting a system made from components that aren’t part of anything currently available.

The statement 'GPT-5 doesn’t exist :)' is a lighthearted and somewhat dismissive response to a speculative discussion about the development of GPT-5. The use of a smiley face suggests a tone of humor or sarcasm, rather than a serious engagement with the topic. The statement does not substantively engage with the public issue being discussed, which is the development and implications of new AI models.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not cause harm, as it is lighthearted and not intended to offend.
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement respects privacy and dignity, as it does not target any individual or group.
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement does not promote understanding, empathy, or compassion, as it is dismissive rather than informative. [-1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement does not engage in constructive criticism or dialogue, as it dismisses the topic without providing substantive input. [-1]
  5. Principle 5:
    I will acknowledge and correct my mistakes.
    There is no mistake to acknowledge or correct in the statement.
  6. Principle 6:
    I will use my influence for the betterment of society.
    The statement does not use influence for societal betterment, as it does not contribute to the discussion meaningfully. [-1]
  7. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds free speech but does not use the platform to engage responsibly with the topic.