Gary Marcus

Rank 14 of 47
|
Score 83
6/6/2025, 10:41:12 PM
X
In reply to:
Polytope
@Polytope13
·
204d
@GaryMarcus Is this some evidence for AI=compression argument?
Gary Marcus
@GaryMarcus
·
204d
And to think Geoff Hinton told me LLMs don’t store any text.

Not everyone who has a Nobel Prize knows what they are talking about.

Every model does effectively store text to some degree and bigger models store more.
Rohan Paul
@rohanpaul_ai
·
204d
How much information do LLMs really memorize?

Now we know, thanks to Paper by @AIatMeta, @GoogleDeepMind , @NVIDIAAIDev and Cornell Univ.

This paper will be absolutely crucial for ongoing lawsuits between AI Companies and data creators/rights owners/copyright-holders.

The statement engages in a technical discussion about AI, specifically addressing whether large language models (LLMs) function as compression mechanisms. It contributes to the broader debate on AI's capabilities and limitations, particularly in relation to data storage and memorization.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not cause harm and contributes to a technical discussion, aligning with the principle of doing no harm. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    By engaging in a factual discussion, the statement promotes understanding of AI technologies. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive dialogue by addressing a specific aspect of AI, without resorting to personal attacks. [+1]