#generalization

Two studies reveal mechanisms behind transformer grokking delays

New research identifies why neural networks suddenly generalize long after memorizing training data.