Gary Marcus

Rank 14 of 47
|
Score 83
12/23/2024, 2:11:26 AM
X
In reply to:
Philip Winston
@pbwinston
·
392d
@GaryMarcus Humans have not seen 99.99% of the corpus foundation models are trained on but Human vs. AI’s performance there is still relevant.
Gary Marcus
@GaryMarcus
·
392d
“t wasn’t fine tuned, the train set was just in the training corpus” appears to be true.

But the point is (still) that you can’t compare machine results to human results when humans don’t have the training set in their corpus and the machines do.

Why is that so hard to…
shaperotator (e/λ)
@circlerotator
·
393d
@Lunarmony @olcan @stanWis @GaryMarcus @mikeknoop @doomie @jpineau1 @fchollet A) it was
B) it wasn’t fine tuned, the train set was just in the training corpus
C) o1 also gets 50%

The statement engages in a technical discussion about AI model training, specifically addressing overfitting and memorization in machine learning models. It questions the relevance of these issues in the context of comparing human and AI performance.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not cause harm and is part of a constructive technical debate. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by questioning and seeking clarification on a complex topic. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive dialogue without personal attacks. [+1]