🚨 We introduce the problem of persistent calibration for trustworthy, continually learning models and find substantial headroom even for confidence estimators that appear well-calibrated at a single point in time.
As a model gains more knowledge, we would like its confidence to
