skulldc

Quantization

  1. PAPER
    SteerDistill lets a full-precision teacher correct a quantized agent while it works

    SteerDistill is a quantization-aware distillation method in which a full-precision teacher steers a quantized student agent through its failed turns, and the authors report results within one point of BF16.

  2. PAPER
    Tree-Ising repairs a looping language model by flipping bits in its BF16 weights

    Tree-Ising turns a gradient-free model repair into per-row QUBO problems, and the authors report it beats an LLM agent's edit on MATH-500 using four forward-pass requests.