Gary Marcus

Rank 28 of 47
|
Score 37
7/10/2024, 1:55:16 PM
X
In reply to:
The Harbinger (ACF) 🇵🇹 🇫🇷 🇰🇷 🇺🇸
@PeacekeeperBH
·
104d
@GaryMarcus @wellingmax My main issue with the so-called 'scaling laws' is that there is an obvious barrier to current approaches, data scarcity.
Most models got better as they were trained w/more & more data, but we already exhausted most of the internet and there are clear OOD issues w/synthetic data.
Gary Marcus
@GaryMarcus
·
104d
Please don’t reduce the greatest scientific-engineering question of our time—will scaling take us to AGI?—to a kind of “he-said, she-said”, as the otherwise brilliant @wellingmax does below.

Instead, consider the actual evidence.

•  Although we saw massive leaps from GPT-2 to…
Max Welling
@wellingmax
·
104d
As I read these posts I find it intriguing to see how confident people are about their beliefs; on both sides, while the future fate of AI seems truly very uncertain to me. I see parallels with religion (my God the only real one). At least one must have badly calibrated beliefs.

The statement '@PeacekeeperBH @wellingmax agreed' is a brief agreement in a conversation about the future of AI and the limitations of current scaling laws. The tone is neutral and the intent is to show concurrence with the points made by @PeacekeeperBH and @wellingmax. The content is minimal and does not provide any substantive engagement with the public issue being discussed.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does no harm with words and actions. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement respects the privacy and dignity of others and does not engage in cyberbullying, harassment, or hate speech. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement does not actively promote understanding, empathy, or compassion, but it also does not detract from these values.
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement does not engage in constructive criticism or dialogue, but it also does not engage in personal attacks or ad hominem arguments.
  5. Principle 5:
    I will acknowledge and correct my mistakes.
    The statement does not involve any mistakes that need acknowledgment or correction.
  6. Principle 6:
    I will use my influence for the betterment of society.
    The statement does not use influence for the betterment of society, but it also does not misuse influence.
  7. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds the principles of free speech and uses the platform responsibly and with integrity. [+1]