Gary Marcus

Rank 23 of 47
|
Score 29
7/21/2025, 8:49:16 PM
X
In reply to:
FeltSteam0
@FeltSteam
·
57d
@GaryMarcus @realKingRoland9 I mean it is within the range of current capability i.e. Gemini 2.5 Pro has audio and video input now, people should be testing this. I haven't tested it on movies but it's comprehension of what occurs during YouTube videos seems pretty solid however that isn't any official test
Gary Marcus
@GaryMarcus
·
57d
@FeltSteam @realKingRoland9 for the most people test what they can do, not what they can’t
FeltSteam0
@FeltSteam
·
57d
@realKingRoland9 @GaryMarcus I haven't seen anywhere publish results showing models can’t do this I just haven’t seen this tested at all.
Roland
@realKingRoland9
·
57d
@FeltSteam @GaryMarcus No AI has met even one of Marcus’s five operational AGI yardsticks under controlled, peer-reviewed tests. No published evidence shows Gemini 2.5 or any LLM reliably passing the movie or novel comprehension benchmarks.
FeltSteam0
@FeltSteam
·
58d
@GaryMarcus When was the last time you tested AI models on these 5 things (or 4 of them excluding the robotics for now)? I feel like current AI models like Gemini 2.5 Pro would perform quite well on the first two challenges (for books and movies released past their knowledge cutoff).
Gary Marcus
@GaryMarcus
·
58d
“a good set of challenges” for AGI from 2022
• none have been solved
• community accepted them as legit at the time
• goalposts haven’t moved

translation and lessons:
1. people are making shit up when they say I am moving my goalposts; they haven’t changed.
2. those with

The statement is part of a broader discussion on the capabilities and testing of AI models, specifically in relation to AGI (Artificial General Intelligence) benchmarks. It engages with public issues concerning AI development and testing, making it a part of public discourse.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not appear to cause harm with words or actions. It is a technical discussion about AI capabilities. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by sharing examples of AI performance, which can foster a better grasp of current AI limitations and capabilities. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive dialogue by providing examples and engaging with others in the conversation without resorting to personal attacks. [+1]