Gary Marcus

Rank 13 of 47

Score 84

@RobS142 No, it counts as using a different technique. The point of scaling was that some curve was meet given some amount of data or compute and nothing else. That has been refuted. Now we are into new hypotheses.

12/14/2024, 5:44:52 AM

In reply to:

Rob S.

@RobS142

421d

@GaryMarcus Increasing inference time compute counts as scaling

Gary Marcus

@GaryMarcus

421d

Looks like this turned out to be wrong.

Tsarathustra

@tsarnick

700d

There is no limit: Dario Amodei says that even without better algorithms, scaling will continue to lead to amazing improvements in AI models

The statement is part of a technical discussion about AI scaling and hypotheses, engaging in a debate about the limits and techniques in AI development. It does not address broader societal issues or public concerns, thus not constituting public discourse.