Gary Marcus

Rank 19 of 47

Score 64

@iScienceLuvr Pure LLM scaling is hitting a wall, but you are confounding that with a separate issue which is about what DeepSeek means for the notion that massive clusters are a necessary next step for LLMs.

1/27/2025, 3:53:56 AM

In reply to:

Tanishq Mathew Abraham, Ph.D.

@iScienceLuvr

165d

Some people claim that Project Stargate must be a complete waste of money, look at what DeepSeek did with so little money!

This is such a bad take!

DeepSeek provided NO EVIDENCE that scaling is hitting a wall!! More compute for an R1 training approach would likely give better…

The statement engages in a technical discussion about the scalability of large language models (LLMs) and the implications of a project called DeepSeek. It addresses a public issue within the field of artificial intelligence research, specifically the debate over the necessity of massive computational resources for advancing LLMs.

Principle 1:
I will strive to do no harm with my words and actions.
The statement does not use harmful language and maintains a neutral tone, focusing on clarifying a technical point rather than attacking individuals. [+1]
Principle 3:
I will use my words and actions to promote understanding, empathy, and compassion.
The statement aims to promote understanding by addressing a misconception in the ongoing discussion about LLM scaling and DeepSeek's implications. [+1]
Principle 4:
I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
The statement engages in constructive criticism by pointing out a misunderstanding in the original argument without resorting to personal attacks. [+1]