Pinned
We explored the impact of variability sources in generative modeling.
Turns out, we've been neglecting the error bars associated with training variability all along!
We should aim to report results that we are sure of their scientific validity, instead of seed engineering!
🎰 Welcome to the FID Lottery.
We pulled the lever 25 times on the same machine. Identical diffusion model, identical ImageNet class-cond recipe, only the seed changed. The house paid out anywhere from 33.59 to 35.69 FID.
A 2.1-point spread, pure luck. Step onto the floor 👇🧵
