Quantization
-
PAPERSteerDistill lets a full-precision teacher correct a quantized agent while it works
SteerDistill is a quantization-aware distillation method in which a full-precision teacher steers a quantized student agent through its failed turns, and the authors report results within one point of BF16.
-
PAPERTree-Ising repairs a looping language model by flipping bits in its BF16 weights
Tree-Ising turns a gradient-free model repair into per-row QUBO problems, and the authors report it beats an LLM agent's edit on MATH-500 using four forward-pass requests.