Distillation
-
PAPERSteerDistill lets a full-precision teacher correct a quantized agent while it works
SteerDistill is a quantization-aware distillation method in which a full-precision teacher steers a quantized student agent through its failed turns, and the authors report results within one point of BF16.