E File "/root/project/examples/pytorch/multiple-choice/run_swag_no_trainer.py", line 546, in main
E metric = evaluate.load("accuracy")
E File "/usr/local/lib/python3.10/site-packages/evaluate/loading.py", line 748, in load
E evaluation_module = evaluation_module_factory(
E File "/usr/local/lib/python3.10/site-packages/evaluate/loading.py", line 680, in evaluation_module_factory
E raise e1 from None
E File "/usr/local/lib/python3.10/site-packages/evaluate/loading.py", line 639, in evaluation_module_factory
E ).get_module()
E File "/usr/local/lib/python3.10/site-packages/evaluate/loading.py", line 479, in get_module
E local_path = self.download_loading_script(revision)
E File "/usr/local/lib/python3.10/site-packages/evaluate/loading.py", line 469, in download_loading_script
E return cached_path(file_path, download_config=download_config)
E File "/usr/local/lib/python3.10/site-packages/evaluate/utils/file_utils.py", line 185, in cached_path
E use_auth_token=download_config.use_auth_token,
E AttributeError: 'DownloadConfig' object has no attribute 'use_auth_token'
Evaluate uses deprecated
datasets.DownloadConfig.use_auth_tokenand will break with datasets 3.0 release.For the next
datasetsrelease, we have checked thetransformersCI and some example tests fail due toevaluate: https://github.com/huggingface/transformers/runs/29973850925The root cause is that
evaluateusesdatasets.DownloadConfig.use_auth_token, which was deprecated since datasets-2.14.0 last year:use_auth_tokenin favor oftokendatasets#5996