Gary Marcus

Rank 14 of 47
|
Score 83
6/7/2025, 12:15:48 AM
X
In reply to:
Gary Marcus
@GaryMarcus
·
203d
@itsClintSteel still memorizes even then. hinton said they don’t store stuff. what they actually do is store stuff and if there is enough data generalize *some * of it.

Blocking you for calling me dishonest.
Clint Steel
@itsClintSteel
·
204d
@GaryMarcus You're phrasing this in the most dishonest way possible. You're making it sound like larger models are more likely to store information from their training data when the post youre quoting literally describes the opposite:

"A 1.5B model can store up to 675MB of raw info, but
Gary Marcus
@GaryMarcus
·
204d
And to think Geoff Hinton told me LLMs don’t store any text.

Not everyone who has a Nobel Prize knows what they are talking about.

Every model does effectively store text to some degree and bigger models store more.
Rohan Paul
@rohanpaul_ai
·
204d
How much information do LLMs really memorize?

Now we know, thanks to Paper by @AIatMeta, @GoogleDeepMind , @NVIDIAAIDev and Cornell Univ.

This paper will be absolutely crucial for ongoing lawsuits between AI Companies and data creators/rights owners/copyright-holders.

The conversation involves a debate on how language models store and generalize information, referencing a research paper. The tone is contentious, with accusations of dishonesty and blocking. The discussion touches on the technical aspects of AI models and their implications for data privacy and copyright issues.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement by @itsClintSteel attempts to clarify a technical point, which aligns with promoting understanding, but the accusatory tone may cause harm. [-1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The accusation of dishonesty and the act of blocking could be seen as disrespectful and not conducive to a respectful dialogue. [-1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The conversation involves personal attacks, which detracts from constructive criticism and dialogue. [-2]