Gary Marcus

Rank 14 of 47

Score 83

I suspect that AI researchers like @rao2z @MelMitchell1 @YejinChoinka @tdietterich @demishassabis and even @ylecun would all agree here, both with @karpathy and what I added.

9/15/2024, 3:21:36 AM

In reply to:

Gary Marcus

@GaryMarcus

489d

To a surprisingly large degree I agree with @karpathy here

But what I would add to it is that statistical modeling of token streams works well only when you don’t need genuine reasoning, planning, or world models, and when the distribution is relatively stationary.

Where…

Andrej Karpathy

@karpathy

490d

It's a bit sad and confusing that LLMs ("Large Language Models") have little to do with language; It's just historical. They are highly general purpose technology for statistical modeling of token streams. A better name would be Autoregressive Transformers or something.

They…

The statement constitutes public discourse as it engages in a substantive discussion about the nature and limitations of AI, specifically Large Language Models (LLMs). The conversation involves notable figures in the AI research community and addresses important issues related to AI technology and its applications.

Principle 1:
I will strive to do no harm with my words and actions.
The statement does not appear to cause harm with words or actions. It is a professional and respectful engagement in a technical discussion. [+1]
Principle 2:
I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
The statement respects the privacy and dignity of others. It does not engage in cyberbullying, harassment, or hate speech. [+1]
Principle 3:
I will use my words and actions to promote understanding, empathy, and compassion.
The statement promotes understanding by referencing the opinions of multiple experts in the field, which can foster a more comprehensive view of the topic. [+1]
Principle 4:
I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
The statement engages in constructive dialogue by building on the points made by others without resorting to personal attacks or ad hominem arguments. [+1]
Principle 7:
I will uphold the principles of free speech and use my platform responsibly and with integrity.
The statement upholds the principles of free speech and uses the platform responsibly by contributing to an informed discussion on AI technology. [+1]