Gary Marcus

Rank 12 of 47

Score 83

Reposted by Gary Marcus

The fact that something that has ingested the entirety of human literature can't figure out how to generalize multiplication past 13 digits is actually a sign of the fact that it has no understanding of what a multiplication algorithm is.

Yuntian Deng

@yuntiandeng

343d

For those curious about how o3-mini performs on multi-digit multiplication, here's the result. It does much better than o1 but still struggles past 13×13. (Same evaluation setup as before, but with 40 test examples per cell.)

2/14/2025, 2:13:36 AM

The statement critiques the limitations of AI models in performing multi-digit multiplication, suggesting a lack of understanding of multiplication algorithms despite extensive training data. It engages in a technical discussion about AI capabilities.

Principle 1:
I will strive to do no harm with my words and actions.
The statement does not cause harm; it is a technical critique.
Principle 3:
I will use my words and actions to promote understanding, empathy, and compassion.
The statement promotes understanding by discussing AI limitations. [+1]
Principle 4:
I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
The statement engages in constructive criticism without personal attacks. [+1]