Llama 3.2

1. Fragile Knowledge, Robust Instruction-Following: The Width Pruning Dichotomy in Llama-3.2 (arxiv.org)

   11d llama

   Structured width pruning of GLU-MLP layers in Llama-3.2 models, guided by the Peak-to-Peak Magnitude (PPM) criterion, reveals a systematic dichotomy in how reducing the expansion ratio affects different model capabilities. While performanc…

← all threads