Gary Marcus

Rank 13 of 47
|
Score 115
8/31/2025, 7:26:22 PM
X
In reply to:
Ali Mortazavi
@AAMortazavi
·
12d
@plibin @GaryMarcus Not really.. its Achilles heels are well known, no need to keep tapping them. The interesting thing is what we can get out of them?
Phil Libin
@plibin
·
12d
@AAMortazavi @GaryMarcus Admittedly, this is a casual benchmark designed to be hard for image generation to get right. That’s how we can measure progress.
Ali Mortazavi
@AAMortazavi
·
12d
@GaryMarcus Come on, you’re trying to trip it up on purpose now… use it for what it’s good at?
Gary Marcus
@GaryMarcus
·
12d
🎺 Presenting The Libin Image Generation Benchmark 🎺

How well can your favorite model do?

“A realistic closeup image of a bookshelf with exactly seventeen books of varying sizes. The titles and authors should all be clearly legible and be real English books. No title should

The statement engages in a discussion about the fairness and purpose of benchmarking AI models, particularly focusing on their weaknesses. It questions the validity of highlighting known weak spots in AI performance and whether it contributes to meaningful progress.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not cause harm but rather engages in a critique of benchmarking practices.
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    It promotes understanding by questioning the approach to benchmarking, encouraging a deeper look at how progress is measured. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism by challenging the rationale behind focusing on AI's weaknesses. [+1]