Skip to content

Issues: huggingface/evaluate

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
148 Open 134 Closed
148 Open 134 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Docs: Add README documentation Improvements or additions to documentation
#21 by lvwerra was closed May 11, 2022
@sashavor
Setup script action to push "canonical" metrics to hub enhancement New feature or request
#24 by lvwerra was closed May 20, 2022
1
add warning/error when metric name includes a hyphen
#171 by loubnabnl was closed Jul 7, 2022
1
Add gradio as a dependency? enhancement New feature or request
#215 by meg-huggingface was closed Aug 2, 2022
Issue with evaluator when the dataset is passed as a string.
#226 by lvwerra was closed Aug 26, 2022
1
@mathemakitten
Perplexity with torch.exp2 instead of torch.exp
#241 by malteos was closed Aug 15, 2022
1
Installation problem with [template]
#249 by BramVanroy was closed Aug 15, 2022
1
Migrate CircleCI to GitHub Actions
#274 by lvwerra was closed Jan 6, 2023
Add support for config field in evaluator data loading logic
#282 by mathemakitten was closed Sep 17, 2022
1
Bug in computing perplexity about max_length
#332 by JamesHujy was closed Nov 1, 2022
1
@mathemakitten
Update Gradio pinned versions in metrics for dark theme fix
#422 by BramVanroy was closed Mar 14, 2023
1
AttributeError: 'DownloadConfig' object has no attribute 'storage_options'
#440 by lhoestq was closed Apr 19, 2023
1
Problem about code_eval
#441 by rongaoli was closed Jun 1, 2023
Perplexity Space Broken
#502 by alyserecord was closed Oct 17, 2023
evaluate consuming Memory and slow down the process
#559 by Redix8 was closed Mar 9, 2024
How to customize my own evaluator and metrics?
#611 by Kami-chanw was closed Aug 15, 2024
Docs: add documentation page documentation Improvements or additions to documentation
#22 by lvwerra was closed May 27, 2022
3 tasks
@sashavor
1
Load metrics from Hub instead of GitHub repo enhancement New feature or request
#25 by lvwerra was closed May 11, 2022
1
BLEURT has no README.md documentation Improvements or additions to documentation
#43 by lvwerra was closed May 18, 2022
1
Fresh pip installation gives error
#60 by prabhakar267 was closed May 25, 2022
1
Add support for IR mertics
#93 by Muhtasham was closed May 31, 2022
1
Link to step-by-step guide is broken.
#95 by koaning was closed Jun 1, 2022
1
1
Broken Link - Step-by-Step Guide
#97 by amrrs was closed Jun 1, 2022
1
Bug: SCIPY_AVAILABLE not correct
#104 by philschmid was closed Jun 2, 2022
1
Only retain relevant statistics in certain metrics enhancement New feature or request
#116 by ZhaofengWu was closed Aug 3, 2022
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.