Gary Marcus

Rank 14 of 47
|
Score 83
3/28/2024, 7:31:03 PM
X
In reply to:
Gary Marcus
@GaryMarcus
·
640d
@emollick On a quick read I can’t figure out much about the human subjects, but it looks like superhuman means better than an underpaid crowd worker, rather a true human fact checker? That makes the characterization misleading. (Like saying that 1985 chess software was superhuman).…
Ethan Mollick
@emollick
·
640d
AIs have a bad reputation for truth, so three important findings in this paper:
1) "LLM agents can achieve superhuman rating performance" on fact checking when given access to Google!
2) Bigger models are more factual
3) LLMs are 20x cheaper than humans
https://arxiv.org/pdf/2403.18802…

The statement is a critical engagement with research findings on AI performance in fact-checking tasks, questioning the use of the term 'superhuman' and the benchmarks used.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not cause harm and is focused on the research findings. [+1]
  2. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement maintains a respectful tone and does not engage in harassment or hate speech. [+1]
  3. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement contributes to understanding by questioning the benchmarks used in the research. [+1]
  4. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement provides constructive criticism without personal attacks. [+1]
  5. Principle 6:
    I will use my influence for the betterment of society.
    The statement aims to clarify AI capabilities, contributing to informed public discourse. [+1]
  6. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement uses the platform responsibly and with integrity to express a viewpoint. [+1]