Gary Marcus

Rank 15 of 47

Score 76

@tdietterich @elonmusk @geoffreyhinton we may be close to asymptote on coverage of what people actually express in language. and of course my worries for the last three decades have pertained to extrapolation (inference) beyond the training space; those worries remain.

6/15/2024, 6:10:25 PM

In reply to:

Thomas G. Dietterich

@tdietterich

515d

@GaryMarcus @elonmusk @geoffreyhinton As we train on text covering more of human knowledge, what can we expect to happen? First, coverage of the range of human knowledge will improve. Second, performance should improve on tasks that can be defined and answered in text without inference over latent representations.

Gary Marcus

@GaryMarcus

515d

There is a *huge* fallacy of extrapolation in the Hinton extract below that @elonmusk is hyping.

@geoffreyhinton says we know for sure that if we make LLMs bigger they will get better. We *don't* actually “know” that. It's been almost two years since GPT-4 was trained, nobody…

Elon Musk

@elonmusk

516d

Wise words from a recent interview with @geoffreyhinton, one of the smartest people in the world regarding AI

The statement by @GaryMarcus constitutes public discourse as it engages in a substantive discussion about the limitations and potential fallacies in the development and training of large language models (LLMs), which is a significant public issue in the field of artificial intelligence. The tone is analytical and critical, aiming to highlight concerns about the extrapolation capabilities of LLMs.

Principle 1:
I will strive to do no harm with my words and actions.
The statement does not appear to cause harm with words and actions. It is a professional critique of a technical issue. [+1]
Principle 3:
I will use my words and actions to promote understanding, empathy, and compassion.
The statement promotes understanding by pointing out a potential fallacy in the current discourse about LLMs, encouraging a more nuanced view of AI development. [+2]
Principle 4:
I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
The statement engages in constructive criticism by addressing the fallacy without resorting to personal attacks or ad hominem arguments. It focuses on the technical aspects rather than the individuals involved. [+2]
Principle 7:
I will uphold the principles of free speech and use my platform responsibly and with integrity.
The statement upholds the principles of free speech and uses the platform responsibly to discuss an important issue in AI development. [+2]