Gary Marcus

Rank 12 of 47
|
Score 83
4/13/2024, 10:39:50 PM
X
In reply to:
Deen Kun A.
@sir_deenicus
·
649d
@GaryMarcus Can you clarify what you mean by no evidence of real improvement?
Gary Marcus
@GaryMarcus
·
649d
@sir_deenicus I don’t see any evidence at all of real improvement despite the fact that $ invested and number of people involved probably went up 10x or even 100x across all the companies now gunning for the top.
Deen Kun A.
@sir_deenicus
·
649d
@GaryMarcus Hmm isn't it too early? From GPT2-4, was ~1 to 2 years between jumps. From Mar 2022-2023 there was an anomalous period of rapid releases with major improvements over GPT3 culminating in 4. It's been only a year since GPT4 was released. 3+ years or GPT5 ~= GPT4 for evidence, no?
Gary Marcus
@GaryMarcus
·
649d
Empirical evidence that LLMs have reached a point of diminishing returns, coming up momentarily at Marcus on AI. Will add link below.

The statement is part of a conversation about the progress and evidence of improvement in the field of Large Language Models (LLMs). It involves a discussion on the investment and development pace in the AI industry, which is a topic of public interest and contributes to the broader dialogue on technology advancement and its implications.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not appear to cause harm with words or actions. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement respects privacy and dignity, with no indication of cyberbullying, harassment, or hate speech. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by encouraging the reading of an essay for further information. [+1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism by questioning the evidence of improvement in LLMs without personal attacks. [+1]
  5. Principle 6:
    I will use my influence for the betterment of society.
    The statement uses influence to contribute to a discussion on AI, which could be seen as bettering society by fostering informed debate. [+1]
  6. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds free speech by sharing opinions responsibly and with integrity. [+1]