Gary Marcus

Rank 25 of 47
|
Score 60
7/14/2024, 11:36:25 PM
X
In reply to:
gurumurthy swaminath
@guru_swam
路
101d
@GaryMarcus This is not a fair comparison. Minsky and Papert demonstrated a fundamental limitation at that time. While now VLMs are not specifically trained to learn connectivity, it is not a fundamental limitation.
Gary Marcus
@GaryMarcus
路
101d
In 1969, Minsky & Papert showed that two-layered neural nets couldn鈥檛 learn to determine whether a figure was connected or not.

Fast forward to 2024, with vastly more data, layers & compute, and neural nets (as we now know how to make them) still fail at some really basic stuff:
Anh Nguyen (Totti)
@anh_ng8
路
105d
馃憢 Excited to share our BlindTest benchmark, a suite of 7 **ridiculously simple**, low-level visual tasks that 4 SOTA vision-language models

( GPT-4o, Claude 3/3.5 Sonnet, Gemini 1.5 Pro )

can't perform very well 鈥硷笍

Paper, code & data: https://vlmsareblind.github.io/

The statement by @guru_swam engages in a public discourse about the progress and limitations of neural networks and vision-language models (VLMs) in artificial intelligence. The tone is somewhat dismissive and critical, suggesting that the current state of AI is not meeting expectations despite significant advancements over the past 55 years.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not directly cause harm but uses a dismissive tone, which could be seen as unconstructive criticism.聽[-1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement does not respect the dignity of the researchers and developers working in the field, as it implies they are 'obviously doing something wrong' without constructive feedback.聽[-1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement does not promote understanding, empathy, or compassion. It is critical without offering solutions or deeper insights.聽[-1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement does not engage in constructive criticism or dialogue. It dismisses the efforts made in the field without providing a detailed argument or engaging in a meaningful discussion.聽[-1]