Gary Marcus

Rank 14 of 47
|
Score 83
Gary Marcus
@GaryMarcus
·
376d
The replies in this thread shows that there are lots of people *within the ML community* raising the same concerns re how OpenAI discussed ARC that I was making. (And more concerns, e.g, in important comments about how the graph was labeled).

Importantly, this an issue about…
12/22/2024, 2:45:08 AM
X
In reply to:
Radhika Sharma
@radhika5kh
·
376d
@GaryMarcus What's your point? There's no cross contamination. The results have been verified by the arc foundation 🤔
Gary Marcus
@GaryMarcus
·
376d
@radhika5kh I am aware, thank you.
Radhika Sharma
@radhika5kh
·
376d
@GaryMarcus And they did eval on the private set..
Gary Marcus
@GaryMarcus
·
376d
Incredible video if you watch it a couple times and realize what they actually did, training on 75% of the public set.

Never trust Sam. Ever.
mfarles
@mfarles
·
376d
@GaryMarcus Working on new benchmark together too. What could possibly go wrong?

The statement is part of a broader conversation about the integrity and transparency of machine learning benchmarks and practices, specifically related to OpenAI and the ARC benchmark. It involves multiple participants discussing potential issues of trust and transparency in AI development, which are significant public concerns.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not appear to cause harm directly, but the broader conversation raises concerns about potential harm from lack of transparency in AI practices.
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement respects privacy and dignity, focusing on public figures and organizations rather than personal attacks. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement contributes to understanding by engaging in a discussion about AI practices, though it could be more explicit in promoting empathy and compassion. [+1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement is part of a dialogue that involves disagreement but does not engage in personal attacks, maintaining a focus on the issue at hand. [+1]
  5. Principle 5:
    I will acknowledge and correct my mistakes.
    There is no indication of acknowledgment or correction of mistakes in this specific statement, but the broader conversation may involve such elements.
  6. Principle 6:
    I will use my influence for the betterment of society.
    The statement uses influence to highlight concerns about AI practices, contributing to societal betterment by advocating for transparency. [+1]
  7. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement upholds free speech principles by engaging in a public discussion about important issues, using the platform responsibly. [+1]