Gary Marcus

Rank 12 of 47
|
Score 83
4/12/2024, 1:52:07 PM
X
In reply to:
Ryan
@RyanMorey
·
657d
@GaryMarcus I don’t think this is quite fair, 3 to 4 spans an order of magnitude in model size, but 4 to 4-Turbo is either the same or smaller!
Gary Marcus
@GaryMarcus
·
658d
What happens when you plot GPT-2, 3, 4, and Turbo side-by-side?

Below I have plotted one common measure, MMLU, where there are easy to find data going back to GPT-2. (There may be others with data going back that far; this is just a first quick attempt.)

What I see is an…
Gary Marcus
@GaryMarcus
·
658d
Could we see GPT 3 and 3.5 and GPT 4 on the same plot? And Gemini Pro 1.5 and Claude Opus?

The statement is a part of a conversation about AI model transparency and seeks clarification on the availability of information regarding model size and data amount.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does no harm with words or actions. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement respects privacy and dignity and does not engage in cyberbullying or harassment. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement uses words to promote understanding by seeking information. [+1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism by questioning the availability of data. [+1]
  5. Principle 6:
    I will use my influence for the betterment of society.
    The statement does not explicitly use influence for societal betterment, but it contributes to a relevant discussion.
  6. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds the principles of free speech and uses the platform responsibly. [+1]