Gary Marcus

Rank 14 of 47
|
Score 83
3/25/2024, 9:11:12 PM
X
In reply to:
Rajesh / Raj
@rkarmani
·
647d
@GaryMarcus sorry, I meant hybrid = LLM + Search (RL, MCTS or A* etc)
Gary Marcus
@GaryMarcus
·
647d
@rkarmani What do you mean by hybrid LLM?
Rajesh / Raj
@rkarmani
·
647d
@GaryMarcus would you say the hybrid LLM + search architecture (a la Q*) is in the direction of Option A?
Gary Marcus
@GaryMarcus
·
647d
The choice AI faces, in my eyes
A. spend 100M + now on neurosymbolic AI in order to discover a new path forward

B. Spend another $5-50 B on LLMs before eventually realizing the value of choice A.

Note: $100B on current approaches couldn’t even build a robust L5 driverless car
Gary Marcus
@GaryMarcus
·
647d
@IanOsband Neurosymbolic done right would be expensive. To be effective (see my Next Decade in AI in Arxiv) likely would requires either licensing or building a large scale knowledge base; it would require hiring minimum say 30-50 people in a period when top people are expecting millions;…

The statement is part of a technical discussion on AI development strategies, specifically regarding the use of hybrid language models and search architectures. The tone is informative and the intent is to contribute to a professional debate on AI progress and direction.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does no harm with words and actions. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement respects the privacy and dignity of others; it does not engage in cyberbullying, harassment, or hate speech. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement uses words to promote understanding in the context of AI development. [+1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism and dialogue without personal attacks. [+1]
  5. Principle 6:
    I will use my influence for the betterment of society.
    The statement uses influence to contribute to the betterment of AI development, which can be seen as contributing to society. [+1]