Oriol Vinyals @OriolVinyalsML · 26 Jun 2026
I started doing language modeling research in Jan 2016, using the LSTM from the "RNN Regularization" model by @woj_zaremba @OriolVinyalsML and @ilyasut, trying to improve its perplexity on Penn Treebank (1M toks). This led to the weight tying method, sometimes still used today.
146 775Views
213Likes
9Reposts
16Replies
2Quotes
0Bookmarks
Is that a lot?
1.19×vs this author's median123 774 views is typical
50Percentile for this authorof 4 recent posts
6.70×vs 100K–1M median21 891 views is typical
66.26%Reachviews ÷ followers
0.16%Engagement rateof viewers reacted