Gary Marcus

Rank 19 of 47
|
Score 64
12/20/2024, 9:27:46 PM
X
In reply to:
Michael Gruen
@Michaelgr1011
·
202d
@GaryMarcus do you have the link handy by chance?
Gary Marcus
@GaryMarcus
·
202d
@Michaelgr1011 Would be a reasonable test to explore.

My comprehension challenge (New Yorker article in 2014) is much easier and I haven’t even seen any real progress there.
Michael Gruen
@Michaelgr1011
·
202d
@GaryMarcus My big (underrated) AGI test is its ability to handle litigation motion practice/legal research. IDK if that is ridiculous of me, but it seems like something that requires deep thinking, understanding real nuance, and general intelligence of the law and case law. So far every…
Gary Marcus
@GaryMarcus
·
202d
@Michaelgr1011 yes, 100%.

what was most notable was almost all the evals were coding and one other heavily discussed benchmark; nothing (at least that I saw) addressed to open-ended reasoning, and certainly nothing establish reliability.

fan boys seem confused about what they saw.
Michael Gruen
@Michaelgr1011
·
202d
@GaryMarcus still think these predictions are correct post seeing the evals?
Gary Marcus
@GaryMarcus
·
202d
Three o3 predictions:
– People will initially be amazed
- Once they dive in, they will see that it is not reliable
- It will work best in closed-domains (like math problems) but less reliably in open-ended domains (like everyday reasoning about the real world).

The statement is part of a public discourse on the topic of artificial intelligence and its evaluation, specifically in relation to the Turing Test and its implications for AI development. The conversation involves sharing resources and opinions on the capabilities and limitations of AI, which is a significant public issue.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not cause harm and is focused on sharing information and resources. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by providing a link to an article that discusses AI, encouraging further reading and comprehension. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive dialogue by responding to a request for information without personal attacks. [+1]
  4. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement uses the platform to responsibly share information relevant to the discussion on AI. [+1]