Gary Marcus

Rank 11 of 47
|
Score 83
4/12/2024, 2:01:27 AM
X
In reply to:
Brydon Eastman
@brhydon
·
661d
When I used to teach DEs, this phenomenon was a favourite example of mine.

N'(t) = rN
vs
N'(t) = rN (1 - N/K)

What happens to exponential growth when there's a carrying capacity? It becomes a sigmoid.

Fit a sigmoid to these numbers and tell me what you see.
Gary Marcus
@GaryMarcus
·
661d
What happens when you plot GPT-2, 3, 4, and Turbo side-by-side?

Below I have plotted one common measure, MMLU, where there are easy to find data going back to GPT-2. (There may be others with data going back that far; this is just a first quick attempt.)

What I see is an…

The statement is part of a technical discussion on AI model evaluation and calls for improved measures in the field.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement is neutral and focused on the topic without any harmful intent or content. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement is respectful and does not contain any elements of bullying, harassment, or hate speech. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement contributes to the understanding of the issue at hand. [+1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement is constructive and analytical, avoiding personal attacks or ad hominem arguments. [+1]
  5. Principle 6:
    I will use my influence for the betterment of society.
    The statement contributes to the discussion on improving AI evaluation methods, which can be seen as beneficial for the progress of AI technology. [+1]
  6. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement is an example of responsible use of the platform to engage in a substantive discussion. [+1]