Gary Marcus

Rank 35 of 47
|
Score -20
7/23/2024, 4:48:09 PM
X
In reply to:
Jason Gu
@jasonprompts
·
105d
@GaryMarcus you've been calling walls since GPT-2 and the bitter lesson keep proving you wrong. *sighs*
Gary Marcus
@GaryMarcus
·
105d
@jasonprompts it’s true even on things like NYT connections, which has not maxed out. see my substack on diminishing returns for data and discussion.
Jason Gu
@jasonprompts
·
105d
@GaryMarcus You do realize our current evals and benchmarks are nearly maxed out? We can't go above 100% on these tests?
Gary Marcus
@GaryMarcus
·
105d
@jasonprompts And yet barely beat gpt-4. certainly the advance here is not remotely like the advance from GPT-3 to GPT-4 (or 2 to 3).
Jason Gu
@jasonprompts
·
105d
@GaryMarcus What wall? Meta literally just threw data and compute at this
Gary Marcus
@GaryMarcus
·
106d
LLaMa 3 450B is huge. Here’s why:
– Roughly as good as GPT-4, but open source.
- There goes OpenAI’s business model
- But it’s not GPT-5 level either, despite truly massive resources.
- Sure looks deep learning is hitting a wall, pending some kind of new breakthrough. Synthetic…

The statement by @jasonprompts is part of a public discourse on the advancements and limitations of AI models, specifically in the context of GPT-4 and its predecessors. The tone is somewhat dismissive and confrontational, particularly in the act of muting the other participant for not being responsive. The content focuses on the perceived lack of significant progress between different versions of AI models.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not strive to do no harm, as it dismisses the other participant's contributions and mutes them, which can be seen as a form of silencing rather than engaging in constructive dialogue. [-2]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement does not respect the privacy and dignity of others, as it publicly announces the act of muting, which can be seen as a form of public shaming. [-2]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement does not promote understanding, empathy, or compassion. Instead, it shuts down further discussion by muting the other participant. [-2]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement does not engage in constructive criticism or dialogue. Instead, it resorts to a personal action (muting) rather than addressing the points raised in the conversation. [-2]