add versioning the HubEvaluationModuleFactory#314
Conversation
|
The documentation is not available anymore as the PR was closed or merged. |
|
Alternatively it can use (tbh I was thinking of something like that for This way we stay consistent with datasets and models: use |
|
The issue with that is that we'll never be able to have a breaking change between the hub modules and the github repository without breaking every older version of the library. this is what's happening with #188: since changed the module structure a bit all the older version of evaluate will try to load them. |
|
If we use release tags |
This PR couples the module repositories on the hub with the main repository in
evaluate, based on tags that are propagated fromevaluateto each space when they are pushed to the hub via actions (seeevaluate/.github/hub/push_evaluations_to_hub.py).The logic is:
revision, this is used.mainis usedv0.2.0)This addresses the massive issues when merging #188. This will not solve the issues for existing versions but at least for newer versions this should not be an issue anymore.