Gary Marcus

Rank 17 of 47
|
Score 67
5/5/2024, 4:52:06 AM
X
In reply to:
Thomas G. Dietterich
@tdietterich
·
549d
@GaryMarcus @LeeKezar @Abebab @ChombaBupe @rao2z Any AI system will need to retrieve the right knowledge from its knowledge base. The RAG problem doesn’t go away just because we switch to a neurosymbolic architecture.

I’m surprised these models aren’t understanding this sense of “fight”. I guess it is not a visual concept.
Gary Marcus
@GaryMarcus
·
550d
@tdietterich @LeeKezar @Abebab @ChombaBupe @rao2z RAG is not going to solve the long tail of cases like this. I don’t think anything off the shelf will; you need a much deeper understanding of the world.
Thomas G. Dietterich
@tdietterich
·
550d
@LeeKezar @Abebab @GaryMarcus @ChombaBupe @rao2z But the model clearly doesn't understand who Mother Teresa was or what her work was about. The whole point of VLMs is that they are supposed to understand our requests. Maybe some RAG would help?
Lee Kezar
@LeeKezar
·
550d
@prem_k @tdietterich @Abebab @GaryMarcus @ChombaBupe @rao2z It doesn't make sense to me *as an image caption*. I don't know what you expected the model to produce. And if you asked 10 people you'd get 10 very different drawings. I don't think we should expect any model to read our minds.
Pɾҽɱ Kυɱαɾ Aραɾαɳʝι 🤖💬🦾
@prem_k
·
550d
@LeeKezar @tdietterich @Abebab @GaryMarcus @ChombaBupe @rao2z Little sense to who?

It made enough sense to me when I saw something similar and wrote it.

All of the sense in the output from these models are made in our minds.

The models are only arranging stochastically.
Lee Kezar
@LeeKezar
·
550d
@tdietterich @prem_k @Abebab @GaryMarcus @ChombaBupe @rao2z I'd like to add that the prompt makes little sense as an image caption. Fighting poverty in general is an abstract concept and not easy to visually show. In such cases I would expect the model to prefer the interpretation that is visually expressable

The statement is part of a technical discussion on artificial intelligence (AI) and its capabilities, specifically addressing the limitations and potential improvements in AI architectures. The conversation involves a series of exchanges among professionals or enthusiasts in the field of AI, discussing the effectiveness of different AI models and architectures in understanding complex concepts. The statement by the user contributes to this ongoing discussion by suggesting that a switch to neurosymbolic AI is part of a larger solution, rather than a complete solution in itself.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement aims to contribute constructively to the discussion without causing harm or offense. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement respects the dignity of others and does not engage in harassment or hate speech. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The user promotes understanding by clarifying their viewpoint on AI development, aiming to add depth to the discussion. [+1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism by addressing the limitations of current AI models and suggesting improvements without personal attacks. [+1]
  5. Principle 6:
    I will use my influence for the betterment of society.
    The user uses their influence to contribute to the betterment of AI technology by sharing insights and engaging in a professional discussion. [+1]