Add optional regressor predictor models and propagate their uncertainty - #2703
Conversation
Co-authored-by: tcuongd <29808430+tcuongd@users.noreply.github.com>
Co-authored-by: tcuongd <29808430+tcuongd@users.noreply.github.com>
Co-authored-by: tcuongd <29808430+tcuongd@users.noreply.github.com>
tcuongd
left a comment
There was a problem hiding this comment.
@copilot Nice, you've covered RMSE degredation and uncertainty widening, but not point accuracy from what I can see. Remember, you can generate a time series from an equation for the exogenous regressors if that makes it easier to assert that the predictions fall within some range.
Also, when I asked to check the cross_validate() outputs, I meant check the metrics returned by that function. The test should live in test_diagnostics.
It's clear from your test that we don't handle serializing exogenous regressor predictors that have already been fit. Is this intended, and if so, why? What would it take to serialize fitted models and load their parameters?
Co-authored-by: tcuongd <29808430+tcuongd@users.noreply.github.com>
Point accuracy now asserted via synthetic regressor/y series (predict MAE vs actual/clean bounded) and CV metrics compared in test_diagnostics; added to commit e0a0f0d. Serialization keeps predictors unset intentionally because submodels include backend-specific fit objects; serializing fitted predictors would require persisting their params/Stan fit and backend, which is currently out of scope for lightweight model JSON. |
Original prompt
💬 We'd love your input! Share your thoughts on Copilot coding agent in our 2 minute survey.