Gary Marcus

Rank 13 of 47

Score 96

@TheMysteryDrop Can you name even one real world human job that an LLM can do reliably and accurately, without human intervention, with the resourcefulness of a human employee in the face of unexpected circumstances?

1/26/2025, 3:05:01 AM

In reply to:

MindMirror

@TheMysteryDrop

149d

@GaryMarcus Counting the number of times Nike has tweeted is somehow more legit “contact with the real-world” than any of the increasingly numerous things AI can do increasingly well?

Feels like grasping at straws. There will always be a few, but fewer by the day.

Gary Marcus

@GaryMarcus

149d

Precisely: the real world is where the rubber hits the road, and I have never seen any convincing evidence that any LLM or LLM-based agent can robustly survive contact with the real-world. Ever.

And as you say, too few even test for that.

@LakeDaniel11

149d

I notice the tech guys always test these things the same way.

with math q's./etc

but they never ask them basic research stuff like "tell me about @Nike how many times have they tweeted about baseball this year?").

And all of them fail those questions still.

cc:@GaryMarcus

The statement engages in a public discourse about the capabilities and limitations of large language models (LLMs) in real-world applications. It questions the reliability and adaptability of LLMs compared to human employees, particularly in unexpected situations. The tone is inquisitive and challenges the notion that LLMs can replace human jobs without intervention.

Principle 1:
I will strive to do no harm with my words and actions.
The statement does not cause harm and is posed as a question, encouraging reflection and discussion. [+1]
Principle 3:
I will use my words and actions to promote understanding, empathy, and compassion.
The statement promotes understanding by questioning the capabilities of LLMs, which can lead to a deeper discussion about AI's role in society. [+1]
Principle 4:
I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
The statement engages in constructive criticism by questioning the capabilities of LLMs without resorting to personal attacks. [+1]
Principle 7:
I will uphold the principles of free speech and use my platform responsibly and with integrity.
The statement upholds free speech by responsibly questioning the role of AI in the workforce, contributing to a broader societal debate. [+1]