event
GPT-2 Visualization Event
-
Pruned language models are judged almost entirely by accuracy and perplexity, which assumes that preserved output behaviour implies preserved internal computation. We test this assumption with a factorial pruning study on GPT-2, crossing t…
-
Knowledge distillation compresses large language models into compact students that preserve aggregate metrics, yet the mechanistic consequences of depth-reduction distillation remain largely uncharacterized. This work applies linear CKA, l…
-
Show HN: Watch GPT-2 compute your sentence, one matrix at a time, in 3D (unfolded-gpt2.vercel.app via hn) 2w
An interactive 3D walk through GPT-2. Type a sentence and watch every matrix operation, with the real numbers, computed in your browser.