-
Notifications
You must be signed in to change notification settings - Fork 121
Issues: huggingface/lighteval
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
Add Code-Centric Interface to LightEval for Enhanced Usability
#148
opened Apr 7, 2024 by
adithya-s-k
[New Task] Add AlpacaEval LC
feature request
New feature/request
new task
#139
opened Apr 2, 2024 by
YannDubs
Align GPQA zero-shot / few-shot prompts with paper?
feature request
New feature/request
#70
opened Feb 27, 2024 by
lewtun
Add single New feature/request
mmlu
config for lighteval
suite
feature request
#61
opened Feb 27, 2024 by
lewtun
Append revision to filepath in New feature/request
good first issue
Good for newcomers
--output_dir
?
feature request
#56
opened Feb 26, 2024 by
lewtun
--no_multichoice_continuations_start_space
should also cover startof word token
bug
#45
opened Feb 20, 2024 by
clefourrier
Allow passing a post normalisation function
feature request
New feature/request
#17
opened Feb 6, 2024 by
clefourrier
More variety in prompt support
feature request
New feature/request
#8
opened Jan 31, 2024 by
clefourrier
Previous Next
ProTip!
Updated in the last three days: updated:>2025-01-17.