Gary Marcus

Rank 14 of 47
|
Score 118
4/23/2024, 5:49:10 PM
X
In reply to:
Joe Fetsch safely/acc ⏸
@Jtfetsch
·
263d
@GaryMarcus Agreed, but training is still very time-intensive. If we hit 24 mo, and nothing better is out, I'd start calling that evidence of a cap, but I'm still expecting LLMs to be a big part of AI's future. Chain-of-thought GOFAI with a pool of fine-tuned LLMs?
Gary Marcus
@GaryMarcus
·
263d
@Jtfetsch yes but the competition wasn’t nearly so fierce then. and the amount of investment wasn’t nearly so massive.
Joe Fetsch safely/acc ⏸
@Jtfetsch
·
263d
@GaryMarcus 33 months after GPT-3 was released, GPT-4 was released.

13.5 is jumping the shark imo, even 4 was red-teamed from August 2022 until March 2023.
Gary Marcus
@GaryMarcus
·
263d
13.5 months post GPT-4:

• Models that are not as good as GPT-4 have become widespread.

• Models that are roughly as good GPT-4 have become common.

• Models that are significantly better than GPT-4 don’t exist.

If that doesn’t hint at diminishing returns and potential…
Filip Piekniewski🌻 🐘:@filippie509@techhub.social
@filippie509
·
263d
If the boatload of LLMs available already wasn’t enough for you, here is another one.

Plenty supply, just still don’t see any serious application. Nose bleed valuations. What could go wrong?

The statement '@Jtfetsch the convergence of many models around gpt-4 level is suggestive but not decisive.' is part of a broader conversation about the development and implications of large language models (LLMs) in AI technology. This conversation addresses the pace of innovation, the potential limits of current AI technologies, and the implications for future developments. As such, it constitutes public discourse because it engages with substantive issues concerning the development and societal impact of AI technologies.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does no harm as it neutrally discusses the state of AI model development. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement respects privacy and dignity, focusing solely on AI models without targeting any individuals or groups. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement contributes to understanding by providing a perspective on AI model development, though it could enhance empathy and compassion by discussing broader societal impacts.
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive dialogue by adding a nuanced view to the discussion, avoiding personal attacks or ad hominem arguments. [+1]
  5. Principle 6:
    I will use my influence for the betterment of society.
    The statement uses its influence to inform and possibly caution against premature conclusions in AI development, contributing positively to societal understanding of AI. [+1]
  6. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds free speech by responsibly contributing to a public technical discussion without spreading misinformation or harmful content. [+1]