Skip to content

Issues: huggingface/evaluate

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

163 Open 143 Closed
163 Open 143 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Question: ROC_AUC metric compute signature with prediction_scores
#660 opened Jan 8, 2025 by axnsantana
Statistically nonsensical to use skewness in label_distribution
#659 opened Jan 8, 2025 by bauwenst
Calculating F1 fails due to error(AttributeError: 'float' object has no attribute 'size')
#658 opened Jan 8, 2025 by Gholamrezadar
2
Typo in README of confusion_matrix, and suggestion to specify valid values for normalize
#652 opened Dec 10, 2024 by dantp-ai
1
FileNotFoundError: Couldn't find a module script at /home/tooko/transformers-course/glue/glue.py.
#651 opened Dec 7, 2024 by AmanoTooko7
Evaluation took so much disk
#649 opened Nov 21, 2024 by uluumbch
evaluate.load() does not work while loading word_count
#648 opened Nov 15, 2024 by sindhu-pr
TypeError: 'NoneType' object is not callable
#647 opened Oct 30, 2024 by Yichangfa
1
FileNotFoundError: Couldn't find a module script at /mnt/data/dingtian/exact_match/exact_match.py. Module 'exact_match' doesn't exist on the Hugging Face Hub either.
#645 opened Oct 21, 2024 by Tiannn0703
[FR] Binoculars as a new metric
#644 opened Oct 20, 2024 by MayankChaturvedi
Perplexity for quantized models
#643 opened Oct 17, 2024 by Hongao0611
1
ImportError: To be able to use evaluate-metric/glue, you need to install the following dependencies['scipy', 'scikit-learn'] using 'pip install scipy sklearn' for instance'
#642 opened Sep 24, 2024 by JINO-ROHIT
3
Optionally stop data deletion after compute
#641 opened Sep 24, 2024 by sizhky
Typo in Types of Evaluations in 🤗 Evaluate documentation
#639 opened Sep 18, 2024 by sergiopaniego
1
Perplexity for Left Padded Models
#636 opened Sep 15, 2024 by Lawhy
CI parity test is broken due to FileNotFoundError
#632 opened Sep 12, 2024 by albertvillanova
1
@albertvillanova
list_evaluation_modules returns empty list
#616 opened Aug 23, 2024 by MohamedAliRashad
3
Benchmark evaluation for language models.
#615 opened Aug 19, 2024 by mina58
1
Unable to compute f1 score - Throwing Value Error trying to convert a string in non english Language to integer
#610 opened Aug 1, 2024 by alans3321
1
AttributeError: module 'evaluate' has no attribute 'load'
#609 opened Jul 31, 2024 by Adesoji1
7
[Metrics] ValueError: Expected to find locked file from process x but it doesn't exist.
#607 opened Jul 11, 2024 by raghavm1
1
AttributeError: 'CombinedEvaluations' object has no attribute 'evaluation_modules'
#603 opened Jun 23, 2024 by shunk031
1
2
Gradio dependency issue
#602 opened Jun 21, 2024 by bnaman50
2
Evaluation of form feed symbol with BLEU results in error
#601 opened Jun 11, 2024 by lowlypalace
LocalModuleTest.test_load_metric_code_eval fails with "The "code_eval" metric executes untrusted model-generated code in Python."
#597 opened Jun 8, 2024 by jpodivin
ProTip! Find all open issues with in progress development work with linked:pr.