Gary Marcus

Rank 14 of 47
|
Score 83
3/26/2024, 5:24:32 PM
X
In reply to:
Trenton Bricken
@TrentonBricken
·
645d
@GaryMarcus I agree that organization and wiring matter! But I think we would disagree over the extent to which Transformers already approximate important computations done by the brain. References: https://arxiv.org/abs/2111.05498 (video: https://www.youtube.com/watch?v=…)
Gary Marcus
@GaryMarcus
·
645d
We’re not going to get to AGI just by having the right number of parameters.

Organization and pre-wiring matter a lot.

If you scramble the genes that guide brain wiring, you don’t get intelligence.
Dwarkesh Patel
@dwarkesh_sp
·
645d
Given that you need 100x more effective compute between model generations, if we don’t get AGI by GPT-7, will we just never get it?

@_sholtodouglas: “GPT-4 costs, let's call it, $100 million. The $1B, $10B, and $100B run, all seem very plausible by private company standards. You…

The statement is a technical opinion contributing to a discussion on AI and neuroscience. It uses an analogy to express skepticism about the capabilities of AI models in comparison to the complexity of the brain.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does no harm. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement respects privacy and dignity. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding through analogy. [+1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement is part of constructive dialogue. [+1]
  5. Principle 6:
    I will use my influence for the betterment of society.
    The statement contributes to scientific discussion beneficial to society. [+1]
  6. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds free speech. [+1]