skulldc

Distillation

  1. PAPER
    SteerDistill lets a full-precision teacher correct a quantized agent while it works

    SteerDistill is a quantization-aware distillation method in which a full-precision teacher steers a quantized student agent through its failed turns, and the authors report results within one point of BF16.