Gary Marcus

Rank 14 of 47
|
Score 83
6/7/2025, 12:07:07 AM
X
In reply to:
Gary Marcus
@GaryMarcus
·
204d
And to think Geoff Hinton told me LLMs don’t store any text.

Not everyone who has a Nobel Prize knows what they are talking about.

Every model does effectively store text to some degree and bigger models store more.
Rohan Paul
@rohanpaul_ai
·
204d
How much information do LLMs really memorize?

Now we know, thanks to Paper by @AIatMeta, @GoogleDeepMind , @NVIDIAAIDev and Cornell Univ.

This paper will be absolutely crucial for ongoing lawsuits between AI Companies and data creators/rights owners/copyright-holders.

The statement involves a critique of Geoffrey Hinton's views on language models, suggesting a misunderstanding or disagreement. It references a broader discussion on AI model memorization, which is relevant to ongoing legal and ethical debates in AI.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement could be seen as potentially harmful if it misrepresents Hinton's views, but it also contributes to a critical discussion on AI. [-1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement aims to promote understanding by analyzing Hinton's argument, though it may lack empathy if it frames the critique as a personal attack.
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism by addressing the content of Hinton's argument, though it risks becoming personal. [+1]