Gary Marcus

Rank 21 of 47
|
Score 48
10/1/2024, 12:53:13 AM
X
In reply to:
Simon Willison
@simonw
·
252d
@GaryMarcus I’d want a whole lot more information about what they actually measured, but from that document it sounds like they compared stats for 800 devs from Jan to April 2023 with stats from Jan to April 2024 and assumed that any differences were entirely caused by introducing Copilot
Gary Marcus
@GaryMarcus
·
252d
@simonw Specific objections? Alternative studies? 800 subjects and 41% increase in bugs is not nothing.
Simon Willison
@simonw
·
252d
@GaryMarcus that CTO magazine article was effectively a press release rewrite for a VERY thin survey - I gave up my email address to get a copy of the original report and wasn’t impressed with what they sent me https://gist.github.com/simonw/8…

The statement constitutes public discourse as it engages in a substantive discussion about the validity and reliability of a study related to software development and the use of Copilot, which is a public concern in the tech community.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not cause harm and maintains a neutral tone, focusing on the need for more reliable data. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by expressing a desire for more robust studies and data, which can lead to better-informed discussions. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive criticism by questioning the reliability of anecdotal data and expressing interest in more rigorous studies, without resorting to personal attacks. [+1]