Unsupervised sentiment neuron
Demonstrates that neural networks can learn meaningful semantic representations (sentiment) as an emergent property of unsupervised next-character prediction. This foundational research on learned representations and interpretability became influential in understanding how language models develop internal structure.
Why it ranks · · Unsupervised learning approach (next-character prediction only) · April 2017
Read full story