Gary Marcus

Rank 19 of 47
|
Score 64
6/18/2025, 3:29:44 PM
X
In reply to:
Trevor 🇨🇦
@TrevorsIdeas
·
18d
@GaryMarcus @Rahll Don't understand this quote from that article: "AI companies can make choices that increase or reduce memorization. It's not an inevitable feature of AI; they have control over it."

How? Finetune it away? For every bit of scraped content? Seems impossible to achieve.
Gary Marcus
@GaryMarcus
·
19d
Please stop bitching about the term “stochastic parrots” (coined by Bender et al).

No metaphor is perfect, but this new study (and my 2024 article with @rahll that the Disney lawsuit cites many times) show decisively that both sides of the metaphor are correct.

Llama can
Gary Marcus
@GaryMarcus
·
19d
Geoff Hinton. 2023: “Gary Marcus .. is making up .. how he thinks it works. [LLMs] don't pastiche together text that they've read on the web, because they're not storing any text.”

New study: “Meta's AI tool Llama 'almost entirely' memorized Harry Potter book… Llama 3.1 has

The statement engages in a discussion about AI's ability to create art without being derivative, suggesting the need for new algorithms. It addresses the broader issue of AI creativity and originality, which is a public concern.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does no harm and contributes to a constructive discussion about AI and creativity. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    It promotes understanding by highlighting the difference between human creativity and AI capabilities, suggesting a need for innovation. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive dialogue by responding thoughtfully to a question about AI memorization. [+1]