Gary Marcus

Rank 18 of 47
|
Score 64
4/2/2024, 1:02:52 PM
X
In reply to:
Adrian Werner
@AdrianWerner
·
456d
@GaryMarcus Past exams are probably in training data. Most of all, the fact tha GPT4 passed the bar exam and at the same time we know it halucinates law cases when lawyers try to use it makes it obvious it passing the bar exam is in no way indicative of it's ability to perform as lawyer
Gary Marcus
@GaryMarcus
·
457d
Remember how everyone got all excited when OpenAI got 90th percentile on the bar exam?
Eric Martínez
@ericgrimani
·
457d
Can AI ace law exams?

Last year, OpenAI announced GPT-4 got 90th percentile on the bar.

Here we (a) refute 90th percentile claim; (b) replicate/extend recent work on GPT capabilities; (c) discuss implications for law profession.

Now open, AI&Law: https://link.springer.com/articl…
1/

The statement is part of a conversation about the capabilities of AI, specifically GPT-4, in the context of legal examinations. It addresses the public issue of AI's role and reliability in professional fields such as law. The tone is informative and contributes to the ongoing discussion about the implications of AI technology in the law profession.

  1. Principle 2:
    I will respect the privacy and dignity of others and will not engage in cyberbullying, harassment, or hate speech.
    The statement respects the privacy and dignity of others and does not engage in cyberbullying, harassment, or hate speech. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement uses words to promote understanding of AI's capabilities and limitations, contributing to a broader comprehension of the topic. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism about the AI's performance without personal attacks or ad hominem arguments. [+1]
  4. Principle 6:
    I will use my influence for the betterment of society.
    The statement uses influence to inform and potentially better society's understanding of AI in the law profession. [+1]