Gary Marcus

Rank 14 of 47
|
Score 83
4/23/2025, 5:06:24 PM
X
In reply to:
Toby Ord
@tobyordoxford
·
272d
@GaryMarcus @littmath They definitely have a vapourware problem ('previewing' products that don't get released) and probably a false advertising problem too (strongly implying the released products are the 'previewed' ones).
Gary Marcus
@GaryMarcus
·
272d
@littmath it’s been four months, a bunch of models have been released with “o3” brandname but you can’t buy anything that does what they livestreamed at any price.

it’s also not the only problem with that announcement; there were many. Several I reported here: https://garymarcus.substack.com/…
Daniel Litt
@littmath
·
272d
@GaryMarcus Seems very premature to conclude this is a “major scandal” — why not wait a few days to see what went wrong with the eval?
Gary Marcus
@GaryMarcus
·
272d
MAJOR SCANDAL: OpenAI’s wildly hyped December o3 ARC demo can’t readily be replicated with the released model.

If that doesn’t give you Theranos vibes, I am not sure what will. Especially in conjunction with the fact that they had privileged access to FrontierMath that they
Toby Ord
@tobyordoxford
·
272d
@arcprize @OpenAI 2. The @arcprize team tried to test a high-compute version of o3, but it kept failing to answer. They spent >$50,000 trying to get it to work, but couldn't, so those December results can't realistically be replicated with the released model.

The statement addresses concerns about potential false advertising and unfulfilled product promises, which are significant issues in public discourse related to consumer rights and corporate responsibility.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement highlights potential harm caused by misleading advertising, aligning with the principle of striving to do no harm. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    It respects privacy and dignity by focusing on corporate actions rather than personal attacks. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism by pointing out specific issues without resorting to personal attacks. [+1]