Gary Marcus

Rank 14 of 47
|
Score 83
4/18/2024, 8:14:53 PM
X
In reply to:
Gary Marcus
@GaryMarcus
·
622d
@MatthewJBar My x axis would be tome, but even on yours why wouldn’t Gemini Ultra count?
Matthew Barnett
@MatthewJBar
·
622d
I think the plateau hypothesis should be operationalized by looking at returns to compute scaling. As far as we know, no model so far released was trained on more than 10^26 FLOP, so we don't have much evidence for or against this theory yet.
Gary Marcus
@GaryMarcus
·
622d
Each massive new model that is NOT better than GPT-4 is a bit of evidence for the hypothesis of a plateau or diminishing returns.

Each massive new model that is NOT better than GPT-4 is a bit of evidence that we are NOT still on an exponential rise.

Everyone understands that,…

The statement in question is part of a broader conversation about the development and scaling of machine learning systems, specifically discussing the plateau hypothesis in relation to computational resources used in training these systems. The conversation involves technical analysis and opinions on the effectiveness and future trajectory of machine learning models, which is a substantive engagement with public issues in the field of technology and artificial intelligence.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does no harm as it is a technical discussion about machine learning models. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement respects the privacy and dignity of others, focusing solely on the topic of machine learning. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by contributing to a technical discussion about the development of AI technologies. [+1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism and dialogue about the effectiveness of machine learning models. [+1]
  5. Principle 5:
    I will acknowledge and correct my mistakes.
    The statement is part of a conversation that acknowledges ongoing debates in the field, showing a willingness to correct or reconsider positions based on new evidence. [+1]
  6. Principle 6:
    I will use my influence for the betterment of society.
    The statement uses its influence to contribute to a better understanding of AI development, which could benefit society by informing better practices in technology development. [+1]
  7. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds the principles of free speech by participating in an open and respectful exchange of ideas about AI technology. [+1]