Gary Marcus

Rank 19 of 47
|
Score 64
7/25/2024, 6:13:30 PM
X
In reply to:
Justin Harvey
@AI_Vidz
·
351d
@GaryMarcus @benjaminjriley Ya but read his comment, which claimed LLMs would plateau because in the brain much of reasoning is not linguistic. That analogy doesn’t hold if frontier models are heavily focused on video and sound
Gary Marcus
@GaryMarcus
·
351d
@AI_Vidz @benjaminjriley multimodal language models are still generally regarded as language models
Justin Harvey
@AI_Vidz
·
351d
@benjaminjriley @GaryMarcus When you say they are language models, full stop, what do you mean? Nearly all the frontier research now is multimodal
Benjamin Riley
@benjaminjriley
·
351d
@AI_Vidz @GaryMarcus For my part, the scientific evidence on how humans think suggests that many of our capacities are not dependent on language. Since LLMs are language models, full stop, this casts doubt on whether scaling linguistic connections will lead to LLMs having human-like cognition.
Benjamin Riley
@benjaminjriley
·
351d
@AI_Vidz @GaryMarcus ...we can also say the number of plausible theories about anything will always exceed the number that are proven to be true. What I understand Gary to be saying, and certainly what I would say, is that evidence is mounting that disfavors the "scale is all you need" hypothesis.
Benjamin Riley
@benjaminjriley
·
351d
@AI_Vidz @GaryMarcus I take your point. From a scientific perspective, we can hold open the *possibility* that these models will continue to dramatically improve in capability with continued scale. That is a testable hypothesis. But...

The statement engages in a substantive discussion about the capabilities and limitations of language models (LLMs) and their potential to achieve human-like cognition. It addresses public concerns related to artificial intelligence, making it a part of public discourse.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not appear to cause harm with words or actions. It is a reasoned argument about the limitations of LLMs. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement respects the privacy and dignity of others. It does not engage in cyberbullying, harassment, or hate speech. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement aims to promote understanding by discussing the differences between human cognition and LLM capabilities. However, it could be more empathetic in its tone.
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism of the idea that scaling linguistic connections will lead to human-like cognition in LLMs. It does not engage in personal attacks or ad hominem arguments. [+1]
  5. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds the principles of free speech and uses the platform responsibly to discuss an important issue in AI research. [+1]