Skip to content

Issues: huggingface/evaluate

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
147 Open 133 Closed
147 Open 133 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Metrics for multilabel problems don't match the expected format.
#585 by adamamer20 was closed Apr 28, 2024
2
Module 'glue' doesn't exist on the Hugging Face Hub either.
#574 by enori was closed Apr 16, 2024
1
Shouldn't perplexity range from [1 to inf)?
#566 by ivanmkc was closed Apr 9, 2024
2
Does Rouge score support the multilingual language?
#564 by sanjeev-bhandari was closed Mar 22, 2024
1
ImportError: To be able to use evaluate-metric/rouge, you need to install the following dependencies['nltk'] using 'pip install # Here to have a nice missing dependency error message early on' for instance'
#562 by BAEK26 was closed Mar 21, 2024
2
evaluate consuming Memory and slow down the process
#559 by Redix8 was closed Mar 9, 2024
Try to import evaluate but get "Library not loaded: @rpath/libwebp.7.dylib" error
#548 by czxttkl was closed Feb 14, 2024
2
several breakages due to recent datasets
#542 by stas00 was closed Apr 18, 2024
1
13
Evaluate fails to acquire lock interrupting single-node multi-GPU training
#540 by iNeil77 was closed Apr 18, 2024
1
2
Cannot use evaluate.TextClassificationEvaluator for multi-label classification
#527 by lorenzobalzani was closed Jun 14, 2024
2 of 4 tasks
2
Perplexity Space Broken
#502 by alyserecord was closed Oct 17, 2023
Multi-label with f1
#497 by jingmingzhuo was closed Mar 7, 2024
2
Matthew's Correlation Coefficient (MCC) always zero
#492 by mirix was closed Sep 7, 2023
1
Metric returned instead of the actual COMET scores
#484 by LeonardoEmili was closed Jan 31, 2024
7
meteor don't works with latest datasets
#480 by leoleoasd was closed Nov 8, 2023
13
Trainer Custom_loss - Empty metrics in Evaluate
#478 by AkimfromParis was closed Aug 3, 2023
2
AttributeError: module 'sacrebleu' has no attribute '__version__'
#455 by dsj96 was closed May 11, 2023
4
unable to import evaluate
#452 by Ananthzeke was closed May 1, 2023
1
Adding new metrics locally without using the evaluate-cli command
#450 by sameeravithana was closed Apr 27, 2023
1
Metrics that use DownloadConfig not working any more
#449 by BramVanroy was closed Oct 13, 2023
5
Understanding metric compute in DDP setup
#445 by Natooz was closed Apr 20, 2023
1
Problem about code_eval
#441 by rongaoli was closed Jun 1, 2023
AttributeError: 'DownloadConfig' object has no attribute 'storage_options'
#440 by lhoestq was closed Apr 19, 2023
1
Unexpected Keyword when running evaluator on whisper-tiny
#437 by sorgfresser was closed Nov 10, 2023
3
Update Gradio pinned versions in metrics for dark theme fix
#422 by BramVanroy was closed Mar 14, 2023
1
ProTip! Mix and match filters to narrow down what you’re looking for.