imageJul 4, 2026 · 19 min
6.1× smaller, 5.77× faster, same FID: compressing a coupled-oscillator image model
The full path to a 6.1× smaller and 5.77× faster Un-0 CIFAR-10 model at unchanged clean-FID: the byte budget that named two levers, a Monarch coupling that cuts 16.8M params to 0.52M, a tensor-core path worth 4.82×, the quality gate that rejected a bigger model, and the custom-kernel work that mostly failed. clean-FID held at 8.98.
image generationdistillationquantization
5.77×faster image generation at equal FID102 ms ▸ 17.7 ms
