Gary Marcus

Rank 13 of 47

Score 84

@AvikonHadoop it’s not the laws of statistics per se. diminishing returns seem likely for three reasons
– lack of enough good quality data, having already trained on large fraction of internet (plus LLM-induced contamination of fresh data)
- possible not enough compute
- lack of real solution…

5/22/2024, 9:55:59 PM

In reply to:

Avik Dey

@AvikonHadoop

625d

@GaryMarcus also, nobody is rooting for the models to hit a plateau. all we are saying is because of the laws of statistics it’s highly improbable that current LLMs will get much better.

Gary Marcus

@GaryMarcus

625d

That’s the thing. Sam himself acknowledged that the current models haven’t had the transformative impact many expected.

Promising that they will “transform industries” is aspirational, not yet really grounded in fact.

Kenny Smith 🐀

@KennyoftheSmith

625d

Even if we hit a plateau -- which some people seem to be rooting for -- the current batch of LLMs are impressive all on their own. They will transform industries even if we don't make any additional progress.

The statement by @AvikonHadoop constitutes public discourse as it engages substantively with the public issue of the development and limitations of large language models (LLMs). The tone is analytical and aims to provide a reasoned argument about the potential plateau in LLM performance.

Principle 1:
I will strive to do no harm with my words and actions.
The statement does not appear to cause harm with words or actions. It is a reasoned argument based on perceived limitations of LLMs. [+1]
Principle 3:
I will use my words and actions to promote understanding, empathy, and compassion.
The statement promotes understanding by providing specific reasons for the potential plateau in LLM performance, which can foster a more informed discussion. [+2]
Principle 4:
I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
The statement engages in constructive criticism by addressing the technical limitations of LLMs without resorting to personal attacks or ad hominem arguments. [+2]
Principle 7:
I will uphold the principles of free speech and use my platform responsibly and with integrity.
The statement upholds the principles of free speech and uses the platform responsibly by contributing to a meaningful discussion on the limitations of LLMs. [+2]