🔬 NLA v3 — read a language model's mind, one token at a time

A natural-language autoencoder for Qwen2.5-7B layer-20 activations: click a token and the actor verbalizes its activation into a salience-ordered list of lines, while the critic reconstructs the vector from each line-prefix — the bars show how much of the vector (FVE, fraction of variance explained) the first k lines recover. Truncation-RL trained the actor to front-load what matters. You can also steer the clicked activation along a trait direction (sycophancy / neuroticism / yellow) at adjustable strength before it's verbalized. AV/AR checkpoints · iter 200, KL 0.03, U[1,120]-token truncation.

Text

by G. Brown
The world loses one Queen named Franklin and divine providence crowns another. This Franklin though is not the Queen of Soul, but crowned Queen of the Country Sunday night in the 92nd annual Miss America Pageant.
It’s a coronation much of the country apparently missed thanks to Sunday night football or the fact that this was the first contest where the contenders didn’t have to parade on stage in swimsuits. Whatever the cause, viewership dipped to less than 5 million people who actually watched the live broadcast on ABC.
If you were one of the viewers who couldn’t tear yourself away from the Packers-Bears collision on the football field, here’s a short Lightning List of Four Facts You Should Know About Nia Franklin The New Miss America.
#4 Wrote Her First Song Before First Grade She has a Master’s Degree in Music and is not afraid to use it. As she demonstrated during her talent portion of the competition in which she performed a selection from the opera La Boheme, music is in her DNA. Not only can Nia sing like a dream, she also writes some of

Or try one of these

FVE view

marginal cumulative

👈 Click any token to read its activation.

clicked token index

settled strength