Gary Marcus

Rank 14 of 47
|
Score 83
John
@jrysana
·
599d
@D_Rod_Tweets @altryne @GaryMarcus They recently got new hardware from NVIDIA that would make the same models ~2x faster. On top of that, Mira shouted out Jensen and NVIDIA for the new hardware on the stream today, they named it 4o (omni-model/multimodal) instead of 4.5 or 5, keeping the implications of GPT4 arch
5/13/2024, 10:53:01 PM
X
In reply to:
ΔI ₳ristotle
@AiAristotle
·
599d
@GaryMarcus Maybe the reason it's faster/cheaper and accessible on the free tier is it's a much smaller model.

GPT-5 could have a similar architecture with 10x the training data and parameter count.

Omni could also be creating the synthetic data for GPT-5.
Gary Marcus
@GaryMarcus
·
599d
GPT-4o hot take:
• The speech synthesis is terrific, reminds me of Google Duplex (which never took off).
but
• If OpenAI had GPT-5, they have would shown it.
• They don’t have GPT-5 after 14 months of trying.
• The most important figure in the blogpost is attached below. And…

The statement engages in a technical discussion about the potential reasons behind the performance and accessibility improvements in AI models, specifically referencing GPT-5 and its hypothetical architecture and data handling. The conversation involves speculation on the use of synthetic data and hardware advancements to enhance AI capabilities.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement aims to contribute constructively to the discourse on AI development, focusing on technical aspects without causing harm. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    It respects the dignity of others by maintaining a professional tone and focusing solely on the subject matter without personal attacks or derogatory comments. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by sharing insights and hypotheses about AI advancements, which could help demystify the technology for others. [+1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    It engages in a form of constructive criticism by analyzing potential reasons for the observed features of the AI models, fostering a deeper dialogue among interested parties. [+1]
  5. Principle 5:
    I will acknowledge and correct my mistakes.
    The statement acknowledges the complexity of AI development and the role of different factors (like data and hardware), which shows an effort to correct or expand upon simplistic explanations. [+1]
  6. Principle 6:
    I will use my influence for the betterment of society.
    By discussing the implications of AI advancements openly, the statement uses its influence to inform and educate, contributing positively to societal understanding of technology. [+1]
  7. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds the principles of free speech responsibly, using the platform to share knowledge and hypotheses without misinformation or harmful content. [+1]