Topic
distillation
2 posts tagged distillation.
video
16.8× faster video generation: distilling Wan 2.2 from 40 steps to 4
A public, no-training LoRA cuts Wan 2.2 A14B from 809 s to 48 s per clip on one A100 (16.8×), held across 13 scenes. The full path to that number: the evaluation-count budget that set the target, the distilled output that came back washed-out, the color grade that half-fixed it, and the checkpoint swap that fixed it for free.
video generationdistillationdiffusion
16.8×faster video generation on Wan 2.2809 s ▸ 48 s
image
6.1× smaller, 5.77× faster, same FID: compressing a coupled-oscillator image model
The full path to a 6.1× smaller and 5.77× faster Un-0 CIFAR-10 model at unchanged clean-FID: the byte budget that named two levers, a Monarch coupling that cuts 16.8M params to 0.52M, a tensor-core path worth 4.82×, the quality gate that rejected a bigger model, and the custom-kernel work that mostly failed. clean-FID held at 8.98.
image generationdistillationquantization
5.77×faster image generation at equal FID102 ms ▸ 17.7 ms