Gary Marcus

Rank 12 of 47
|
Score 83
5/20/2024, 2:46:37 PM
X
In reply to:
Carlos E. Perez
@IntuitMachine
·
616d
@GaryMarcus @bindureddy I don't think we've hit a wall in the basic approach and architecture. There is still a lot of room for growth. The current bottleneck is more advanced training approaches and sets.
Carlos E. Perez
@IntuitMachine
·
616d
@GaryMarcus @bindureddy I think your reasoning is flawed. If LLMs are to hit an intrinsic wall then competitors will likely catch-up ,(which they have) and OpenAI has no moat. So even if Altman is ASPD, it doesn't matter in the long run. Assuming of course we've hit a wall.
Gary Marcus
@GaryMarcus
·
619d
To clear up some common concerns and confusions:

I don’t think LLMs per se are becoming too powerful (i do in fact expect them to stall), but it worries me that one of the biggest, most well-funded AI companies seems hellbent on world-domination (as @bindureddy just put it) and…
Toonami Aftermath
@ToonamiAfter
·
619d
@NeilMcDevitt_ @GaryMarcus If we're being generous to Gary, it seems he thinks that LLMs are both becoming too powerful AND unreliable.

I don't know how to reconcile his position that LLMs are hitting a wall in capability with that though.

I btw think they will improve and am not particularly concerned.

The statement by @GaryMarcus constitutes public discourse as it engages in a substantive debate about the progress and challenges of deep learning, a significant topic in the field of artificial intelligence. The statement critiques the current state of deep learning and references a detailed review, contributing to the ongoing dialogue about AI development and its implications.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not appear to cause harm with words and actions. It is a critique of a technological approach rather than an attack on individuals. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement respects the privacy and dignity of others. It does not engage in cyberbullying, harassment, or hate speech. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement aims to promote understanding by providing a review of the current state of deep learning, although it could be more empathetic in tone. [+1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism of deep learning approaches and does not engage in personal attacks or ad hominem arguments. [+2]
  5. Principle 5:
    I will acknowledge and correct my mistakes.
    The statement does not address any mistakes made by the author, so this principle is not applicable.
  6. Principle 6:
    I will use my influence for the betterment of society.
    The statement uses the author's influence to highlight important issues in AI, contributing to the betterment of society by fostering informed discussion. [+2]
  7. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds the principles of free speech and uses the platform responsibly to discuss a significant public issue. [+2]