Gary Marcus

Rank 14 of 47
|
Score 83
12/21/2024, 7:50:12 PM
X
In reply to:
Gary Marcus
@GaryMarcus
·
369d
OOF is very messy. Exactly what I have said since my article in Cognitive Paychology 1998; confirmed in the Apple reasoning study and confirmed yet again.

Important thread. And see my Substack re the Apple reasoning paper for a historical perspective.
Naomi Saphra 🧈🪰
@nsaphra
·
370d
Do all roads lead to hierarchical generalization OOD? While in-distribution behavior is stable during training, OOD behavior is very messy! When training data mixes examples with and without center embeddings, rules compete, causing training instability and inconsistent outcomes.

The statement 'Oof! this should have read OOD - out of domain.' is a lighthearted correction of a previous error in terminology. It acknowledges a mistake in the context of a technical discussion about language models and their behavior out-of-distribution (OOD). The tone is informal and self-corrective, aiming to clarify the intended meaning without engaging in deeper public discourse.

  1. Principle 5:
    I will acknowledge and correct my mistakes.
    The statement acknowledges and corrects a mistake, aligning with the principle of acknowledging and correcting errors. [+1]