Gary Marcus

Rank 12 of 47
|
Score 83
4/13/2024, 10:45:39 PM
X
In reply to:
Deen Kun A.
@sir_deenicus
·
648d
@GaryMarcus @Moonlogic_Games @DHuskytron The post is about evidence for diminishing returns. My point is there isn't enough to confidently claim that's the current state of affairs.
Gary Marcus
@GaryMarcus
·
648d
@Moonlogic_Games @sir_deenicus @DHuskytron Agree, you need to look at the evidence I provided and the claim I addressed @sir_deenicus, before you respond
Moonlogic
@Moonlogic_Games
·
648d
@sir_deenicus @DHuskytron @GaryMarcus You'd have to read the post. Gary is referring and rebutting specific claims that LLM capabilities are doubling every 5-14 months. This is obviously not the case.
Deen Kun A.
@sir_deenicus
·
648d
@DHuskytron @Moonlogic_Games @GaryMarcus No, it's not. It was 2 years between GPT3 and ChatGPT. GPT4 is barely 1 year out. There is as yet (AFAICT) no logic or evidence strong enough to support this claim.
Dexter Huskytron
@DHuskytron
·
648d
@Moonlogic_Games @GaryMarcus I have to agree.
Moonlogic
@Moonlogic_Games
·
648d
@GaryMarcus I feel like the fact that they're releasing 'turbo' instead of GPT-5 is pretty solid evidence you're right.

The statement is part of a conversation about the rate of progress in the development of language models, specifically addressing the claim of diminishing returns in this field. The tone is analytical and the intent is to contribute to the discussion with evidence that supports a particular viewpoint. The content involves the analysis of investment and resources in the development of language models over the past years.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement aims to contribute information without causing harm. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement seeks to clarify and provide evidence, which can promote understanding. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism by providing evidence to support a claim. [+1]
  4. Principle 5:
    I will acknowledge and correct my mistakes.
    The statement acknowledges the limitations of the evidence provided ('it's not proof'). [+1]
  5. Principle 6:
    I will use my influence for the betterment of society.
    The statement contributes to a better understanding of the development pace in a significant technological field, which can be seen as using influence for the betterment of society. [+1]