Gary Marcus

Rank 14 of 47
|
Score 83
Colin Fraser
@colin_fraser
·
302d
Some people talk about the enormous progress we will make by siccing a billion PhD-level LLM agents on research problems but I think they are overestimating the marginal gain of the billionth identical LLM agent. They're all ChatGPT. They're all going to say the same thing.
3/6/2025, 6:51:39 PM
X
In reply to:
Gary Marcus
@GaryMarcus
·
301d
Naveen is 100% right. What people call PhD level questions are questions you might see in “qualifying exam” to do a PhD.

An actual PhD thesis has to be *original* research, and there is no sign that current AI is up to (or even close to) that standard.
Naveen Rao
@NaveenGRao
·
301d
Can someone explain to me what "PhD level" questions are? A PhD is all about discovering new knowledge and the process therein. It's not some grade achieved by taking an exam.

The statement is part of a broader discussion on the capabilities of AI, specifically regarding its potential to perform tasks at a 'PhD level.' The conversation critiques the notion that AI can conduct original research, a key component of a PhD, and questions the originality and effectiveness of deploying numerous AI agents for research purposes.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not use harmful language and maintains a neutral tone, focusing on the capabilities of AI rather than attacking individuals. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by questioning the assumptions about AI's capabilities, encouraging a more nuanced view of AI's role in research. [+2]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism of the idea that AI can perform PhD-level research, without resorting to personal attacks. [+2]
  4. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement contributes to public discourse on AI's role in research, using the platform to responsibly question and analyze claims about AI's capabilities. [+2]