Gary Marcus

Rank 19 of 47

Score 64

Terence Tao reporting on the same problem we have seen endlessly in other domains: LLM’s produce output that “looks” correct but is often deeply wrong and even stupid on careful inspection.

I know of no domain in which this is NOT the case.

And yet people seem surprised over

vitrupo

@vitrupo

24d

Terence Tao says today's AIs pass the eye test -- but fail miserably on the smell test.

They generate proofs that look flawless. But the mistakes are subtle, and strangely inhuman.

“There's a metaphorical mathematical smell.. it's not clear how to get AI to duplicate that.”

6/15/2025, 6:12:32 AM

The statement critiques the reliability of AI-generated outputs, particularly in mathematical proofs, highlighting a gap between appearance and accuracy. It emphasizes the need for caution and deeper inspection of AI results.

Principle 1:
I will strive to do no harm with my words and actions.
The statement aims to prevent harm by warning about potential inaccuracies in AI outputs. [+1]
Principle 3:
I will use my words and actions to promote understanding, empathy, and compassion.
It promotes understanding by explaining the subtlety of errors in AI-generated content. [+1]
Principle 4:
I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
The statement engages in constructive criticism of AI capabilities without personal attacks. [+1]