Gary Marcus

Rank 15 of 47
|
Score 76
6/15/2024, 6:27:36 PM
X
In reply to:
AGIHound
@TrueAIHound
·
515d
@gcolbourn @GaryMarcus @elonmusk @geoffreyhinton Scaling is for weak minds, very weak minds, like Hinton's. 😇
Greg ⏹️ Colbourn
@gcolbourn
·
515d
@GaryMarcus @elonmusk @geoffreyhinton No one has made an LLM significantly bigger than GPT-4 though! You are being way too premature in calling the end to scaling. Wait until we have a model trained on at least 100x GPT-4 compute before calling it (currently we haven't even had one that is 5x).
Gary Marcus
@GaryMarcus
·
515d
There is a *huge* fallacy of extrapolation in the Hinton extract below that @elonmusk is hyping.

@geoffreyhinton says we know for sure that if we make LLMs bigger they will get better. We *don't* actually “know” that. It's been almost two years since GPT-4 was trained, nobody…
Elon Musk
@elonmusk
·
515d
Wise words from a recent interview with @geoffreyhinton, one of the smartest people in the world regarding AI

The statement 'Hinton 2024 ≠ Hinton 1990' is a part of a public discourse as it engages in a substantive discussion about the evolution of Geoffrey Hinton's views on AI, which is a significant public issue. The tone is somewhat neutral and factual, aiming to highlight a change in perspective over time.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does no harm with words and actions. It simply points out a difference in time and perspective without any derogatory language or harmful intent. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement respects the privacy and dignity of others. It does not engage in cyberbullying, harassment, or hate speech. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by highlighting the evolution of Hinton's views, which can foster a deeper discussion about the development of AI. [+1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement does not engage in personal attacks or ad hominem arguments. It focuses on the change in Hinton's views rather than attacking his character. [+1]
  5. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds the principles of free speech and uses the platform responsibly and with integrity by contributing to a meaningful discussion about AI. [+1]