-
Notifications
You must be signed in to change notification settings - Fork 239
Issues: huggingface/evaluate
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
METEOR has no option to return unaggregated results
#572
opened Apr 10, 2024 by
ashtonomy
updated Aug 12, 2024
Add note in repo and docs that library is no longer actively maintained
#612
opened Aug 12, 2024 by
MoritzLaurer
updated Aug 12, 2024
Evaluation not working with
microsoft/deberta-v3-large
#553
opened Feb 28, 2024 by
msinha251
updated Aug 7, 2024
AttributeError: module 'evaluate' has no attribute 'load'
#609
opened Jul 31, 2024 by
Adesoji1
updated Aug 3, 2024
How to customize my own evaluator and metrics?
#611
opened Aug 2, 2024 by
Kami-chanw
updated Aug 2, 2024
evaluate-cli create fails with subprocess.CalledProcessError
#519
opened Nov 23, 2023 by
Tai-Mai
updated Aug 2, 2024
Unable to compute f1 score - Throwing Value Error trying to convert a string in non english Language to integer
#610
opened Aug 1, 2024 by
alans3321
updated Aug 1, 2024
[BUG] Loading metrics is extremely slow
#472
opened Jul 16, 2023 by
NightMachinery
updated Jul 29, 2024
[Metrics] ValueError: Expected to find locked file from process x but it doesn't exist.
#607
opened Jul 11, 2024 by
raghavm1
updated Jul 11, 2024
[Metrics] Can't find / acquire lock files in distributed multi-node shared file system
#481
opened Aug 1, 2023 by
Natooz
updated Jul 9, 2024
Add COCO evaluation metrics
metric request
#111
opened May 3, 2021 by
NielsRogge
updated Jul 6, 2024
AttributeError: 'CombinedEvaluations' object has no attribute 'evaluation_modules'
#603
opened Jun 23, 2024 by
shunk031
updated Jun 28, 2024
Combined metrics ignore some arguments
#423
opened Feb 16, 2023 by
mattjeffryes
updated Jun 13, 2024
Evaluation of form feed symbol with BLEU results in error
#601
opened Jun 11, 2024 by
lowlypalace
updated Jun 11, 2024
LocalModuleTest.test_load_metric_code_eval fails with "The "code_eval" metric executes untrusted model-generated code in Python."
#597
opened Jun 8, 2024 by
jpodivin
updated Jun 8, 2024
Execution of example from the Using the evaluator docs fails due to unspecified tokenizer
#594
opened Jun 2, 2024 by
jpodivin
updated Jun 2, 2024
Evaluation of empty strings with MAUVE results in error
#593
opened May 24, 2024 by
lowlypalace
updated May 24, 2024
Previous Next
ProTip!
Type g i on any issue or pull request to go back to the issue listing page.