Gary Marcus

Rank 13 of 47
|
Score 83
4/29/2025, 1:24:12 PM
X
In reply to:
Marcus Arvan
@marcusarvan
·
259d
@dylanmatt @tyler_m_john @GaryMarcus Right, the problem is that there are many different norms, along with a vast plurality of possible interpretations of each of them. So it’s unclear how to program them without reproducing human forms of “misalignment” (or worse) https://philpapers.org/rec/ARVMT…
dylan matthews 🔸
@dylanmatt
·
259d
@tyler_m_john @GaryMarcus Tyler as a moral philosopher knows this very well but hundreds if not thousands of people have tried to come up with rigorous definitions of things like “kindness” and “fairness” and it turns out to be extremely hard!
Tyler John
@tyler_m_john
·
259d
@GaryMarcus Try hand coding some values for GPT-2-tiny, I suspect you'll pretty quickly hit a wall but if not it would be the breakthrough of the century
Gary Marcus
@GaryMarcus
·
260d
@tyler_m_john it’s more than a trillion actions but its not a trillion norms. maybe it’s only 100 and we should hand-write some of them, rather than leaving everything entirely to the chance vicissitudes of what is in some training corpus.
Tyler John
@tyler_m_john
·
260d
@GaryMarcus Every decision or speech act bakes in a billion complex, subtle values, about efficiency, honesty, empathy, respect, social norms, empiricism, aesthetics, deference, humility, and on and on. How would you write a set of goals that leads to good norms across a trillion actions?
Gary Marcus
@GaryMarcus
·
260d
@tyler_m_john Why are the values so complicated?

Can’t be hand coded in a LLM but that’s an a LLM issue, not inherent to AI.

The statement is part of a broader discussion on the challenges of programming values and norms into AI systems, which is a significant public issue. The tone is agreeable and acknowledges the complexity of the topic.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does no harm and acknowledges the seriousness of the challenges, aligning with the principle of striving to do no harm. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    By agreeing with the challenges, the statement promotes understanding and empathy towards the complexity of programming AI with human values. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive dialogue by agreeing with the points made, without resorting to personal attacks. [+1]