Skip to content

added MASE, sMAPE and MAPE metrics#330

Merged
lvwerra merged 29 commits into
huggingface:mainfrom
kashif:time-series
Nov 8, 2022
Merged

added MASE, sMAPE and MAPE metrics#330
lvwerra merged 29 commits into
huggingface:mainfrom
kashif:time-series

Conversation

@kashif

@kashif kashif commented Oct 24, 2022

Copy link
Copy Markdown
Contributor

Added 3 time series specific metrics...

@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

@lvwerra

lvwerra commented Oct 25, 2022

Copy link
Copy Markdown
Member

Hi @kashif, thanks for adding this - the implementation looks great! There seems to be an issue with the example in the docstring, maybe rounding the results would help.

Also, could you add a requirements.txt and README.md? You can for example look at metrics/accuracy for how to add those!

Let me know if you need any help!

@kashif

kashif commented Oct 25, 2022

Copy link
Copy Markdown
Contributor Author

thanks @lvwerra let me fix it!

@kashif kashif changed the title added MAPE metric added sMAPE and MAPE metrics Oct 28, 2022
@kashif

kashif commented Oct 28, 2022

Copy link
Copy Markdown
Contributor Author

@lvwerra would be happy for another review

@kashif kashif changed the title added sMAPE and MAPE metrics added MASE, sMAPE and MAPE metrics Oct 28, 2022
@kashif

kashif commented Oct 28, 2022

Copy link
Copy Markdown
Contributor Author

the tests seems to be failing due to something else I believe

Comment thread metrics/mape/README.md Outdated

@lvwerra lvwerra left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @kashif for this very clean PR! I left two comments on the PR other than that it looks good to go!

Comment thread metrics/mape/README.md Outdated
Comment thread metrics/smape/smape.py

@lvwerra lvwerra left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome, looks good to me!

@kashif

kashif commented Nov 8, 2022

Copy link
Copy Markdown
Contributor Author

Thank you!

@lvwerra
lvwerra merged commit 7e21410 into huggingface:main Nov 8, 2022
@kashif
kashif deleted the time-series branch November 8, 2022 17:10
NimaBoscarino pushed a commit to NimaBoscarino/evaluate that referenced this pull request Nov 9, 2022
* added mean_absolute_percentage_error

* fix output

* more decimal places

* added readme and requirements.txt

* added formula

* fix outputs

* grammer

* formatting

* fix tests

* added smape

* formatting

* fix tests

* whitespace

* fix formula

* added mase

* make style

* typo

* added reference_urls

* latest edition

* fix doc

* better Description

* Fix mape range

* cite sklearn api and helpers

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* fix markdown

* new line
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants