Gary Marcus

Rank 13 of 47
|
Score 83
4/29/2025, 11:47:47 AM
X
In reply to:
Tyler John
@tyler_m_john
·
260d
@GaryMarcus Every decision or speech act bakes in a billion complex, subtle values, about efficiency, honesty, empathy, respect, social norms, empiricism, aesthetics, deference, humility, and on and on. How would you write a set of goals that leads to good norms across a trillion actions?
Gary Marcus
@GaryMarcus
·
260d
@tyler_m_john Why are the values so complicated?

Can’t be hand coded in a LLM but that’s an a LLM issue, not inherent to AI.
Tyler John
@tyler_m_john
·
260d
@GaryMarcus I think that is unfortunately not the case. If you have an AGI you have to decide its goals. It is (and values are) too complicated to hand code them. So you gotta give it something to optimize. Optimizing for human feedback is a natural target and leads straight to this.
Gary Marcus
@GaryMarcus
·
261d
If we actually knew how to build AGI this sort of stuff wouldn’t happen.
Sam Altman
@sama
·
262d
the last couple of GPT-4o updates have made the personality too sycophant-y and annoying (even though there are some very good parts of it), and we are working on fixes asap, some today and some this week.

at some point will share our learnings from this, it's been interesting.

The statement engages in a discussion about the complexity of encoding values and norms in artificial intelligence, particularly in the context of AGI (Artificial General Intelligence). It suggests that instead of relying solely on large datasets, some norms might need to be explicitly defined or 'hand-written.' This is a substantive engagement with public issues related to AI development and ethics.

  1. Principle 1:
    I will strive to do no harm with my words and actions.
    The statement does not use harmful language and focuses on a constructive suggestion, adhering to the principle of doing no harm. [+1]
  2. Principle 3:
    I will use my words and actions to promote understanding, empathy, and compassion.
    The statement promotes understanding by suggesting a thoughtful approach to encoding norms in AI, aligning with the principle of promoting understanding and empathy. [+1]
  3. Principle 4:
    I will engage in constructive criticism and dialogue with those in disagreement and will not engage in personal attacks or ad hominem arguments.
    The statement engages in constructive dialogue without personal attacks, adhering to the principle of engaging in constructive criticism and dialogue. [+1]
  4. Principle 7:
    I will uphold the principles of free speech and use my platform responsibly and with integrity.
    The statement responsibly uses the platform to discuss AI ethics, aligning with the principle of upholding free speech and using the platform responsibly. [+1]