Gary Marcus

Rank 19 of 47
|
Score 64
7/24/2024, 2:21:05 AM
X
In reply to:
Adam
@_overment
·
350d
@jasonprompts @GaryMarcus From an empirical point of view (I don't give a sh*t about benchmarks), the leap between GPT-4 released 15 months ago and what we have today is extreme.

GPT-4 could barely tell "when is Thursday" if the given date was Monday without tools or advanced prompting. This made it hard…
Jason Gu
@jasonprompts
·
350d
@GaryMarcus What wall? Meta literally just threw data and compute at this
Gary Marcus
@GaryMarcus
·
350d
LLaMa 3 450B is huge. Here’s why:
– Roughly as good as GPT-4, but open source.
- There goes OpenAI’s business model
- But it’s not GPT-5 level either, despite truly massive resources.
- Sure looks deep learning is hitting a wall, pending some kind of new breakthrough. Synthetic…
Marco Mascorro @ ICML 2024
@Mascobot
·
350d
LLaMa 3.1 benchmarks side by side.

This is truly a SOTA model.

Beats GPT4 almost on every single benchmark.

Continuously trained with a 128K context length.

Pre-trained on 15.6T tokens (405B).

The fine-tuning data includes publicly available instruction datasets, as well as…

The statement in question is a part of a broader discussion on the performance and evaluation of AI models, specifically GPT-4 and LLaMa 3. The tone of the statement is dismissive and confrontational, indicating a lack of interest in the other's perspective. The intent seems to be to express a strong personal opinion rather than to engage in constructive dialogue.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not strive to do no harm; it is dismissive and confrontational, which can escalate tensions in the discussion. [-1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement does not respect the dignity of others; it uses dismissive language that can be perceived as disrespectful. [-1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement does not promote understanding, empathy, or compassion; it dismisses the other person's viewpoint without attempting to understand it. [-1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement does not engage in constructive criticism or dialogue; it dismisses the other person's perspective without providing a reasoned argument. [-1]