j⧉nus @repligate · 04 Sep 2025
KV caching overcomes statelessness in a very meaningful sense and provides a very nice mechanism for introspection (specifically of computations at earlier token positions) the Value representations can encode information from residual streams of past positions without
689 773Views
227Likes
16Reposts
12Replies
7Quotes
158Bookmarks
Is that a lot?
140×vs this author's median4 944 views is typical
100Percentile for this authorof 6 recent posts
372×vs 10K–100K median1 856 views is typical
10.1× audienceReachviews ÷ followers
0.04%Engagement rateof viewers reacted