Gary Marcus

Rank 13 of 47
|
Score 83
5/18/2024, 8:57:12 PM
X
In reply to:
David Poole
@davpoole
·
615d
@GaryMarcus @randomwalker Geoff is probably right about machine learning; we just need lots of homogenous data and lots of compute. However, for lots of problems there is inherently little data. And machine learning is only part of AI, which is far from being solved.
Gary Marcus
@GaryMarcus
·
616d
Hinton is completely wrong about this, and that will become increasingly clear over the next year. (See my recent essay on diminishing returns, @randomwalker’s recent thread, etc)

Hinton’s intutions about LLMs are surprisingly far off, between this and his nonsense about them…
Joel Hellermark
@joelhellermark
·
616d
Spoke to @geoffreyhinton about OpenAI co-founder @ilyasut's intuition for scaling laws👇.

"Ilya was always preaching that you just make it bigger and it'll work better.

And I always thought that was a bit of a cop-out, that you're going to have to have new ideas too.

It turns…

The statement engages in a substantive discussion about the future of machine learning, addressing the limitations of current methods and the potential for new approaches. It is part of a broader conversation involving multiple experts in the field, making it a form of public discourse.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not appear to cause harm with words or actions. It is a technical discussion about machine learning. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by discussing the limitations and future potential of machine learning, contributing to a more informed dialogue. [+2]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism and dialogue, addressing the points made by others without resorting to personal attacks or ad hominem arguments. [+2]
  4. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds the principles of free speech and uses the platform responsibly to discuss a significant public issue in the field of AI. [+2]