Gary Marcus

Rank 13 of 47
|
Score 83
3/22/2024, 12:28:10 AM
X
In reply to:
jack morris
@jxmnop
·
662d
@GaryMarcus RLHF is number 3 Mr Gary
Gary Marcus
@GaryMarcus
·
662d
@jxmnop RLHF: OAI and DeepMind 2017: https://deepmind.google/discover…

Others have addresses diffusion in the thread

Transformers at Google 2017 presumably is the largest recent innovation

So don’t really accept your rundown or timing etc
jack morris
@jxmnop
·
662d
since i got into ML in 2017 or so there have been exactly three major advancements:

1. web-scale language model pretraining (OpenAI, 2020)
2. diffusion models (OpenAI, 2020)
3. language model refinement via human feedback (OpenAI, 2022)

what’s next? it’s been a while

The statement is part of a conversation about advancements in machine learning and artificial intelligence, specifically addressing the contributions of different organizations to these advancements. The tone is corrective, aiming to provide accurate information regarding the attribution of certain innovations in the field. The intent is to clarify and contribute to an accurate historical account of advancements in AI and ML. The content is factual and relates to the discussion of technological progress.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does no harm as it seeks to correct misinformation. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement respects the privacy and dignity of others, as it does not involve any personal information or attacks. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by clarifying the contributions of different entities to AI advancements. [+1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism by correcting a factual error without personal attacks. [+1]
  5. Principle 5:
    I will acknowledge and correct my mistakes.
    The statement itself does not acknowledge a mistake by the speaker, but it corrects a mistake made by another. [+1]
  6. Principle 6:
    I will use my influence for the betterment of society.
    The statement uses influence to better societal understanding of AI advancements. [+1]
  7. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds free speech principles by responsibly contributing to the public discourse on AI. [+1]