Skip to content

Issues: HAE-RAE/haerae-evaluation-toolkit

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

QA: openai backend test
#69 opened Jan 25, 2025 by h-albert-lee
QA: litellm backend test
#68 opened Jan 25, 2025 by h-albert-lee
QA: huggingface backend
#67 opened Jan 25, 2025 by h-albert-lee
QA: click dataset class
#66 opened Jan 25, 2025 by h-albert-lee
QA: hrm8k dataset class
#65 opened Jan 25, 2025 by h-albert-lee
beam search
#63 opened Jan 24, 2025 by ksyint
QA: string match evaluation
#60 opened Jan 22, 2025 by h-albert-lee
QA: k2_eval dataset class
#59 opened Jan 22, 2025 by h-albert-lee
QA: kmmlu dataset class
#58 opened Jan 22, 2025 by h-albert-lee
QA: haerae dataset class
#57 opened Jan 22, 2025 by h-albert-lee
litellm batch inference
#56 opened Jan 22, 2025 by h-albert-lee
add kudge dataset
#54 opened Jan 21, 2025 by h-albert-lee
openai batch inference
#46 opened Jan 17, 2025 by h-albert-lee
add generate_until option
#40 opened Jan 17, 2025 by h-albert-lee
add few-shot evaluation
#36 opened Jan 13, 2025 by h-albert-lee
add language penalize
#35 opened Jan 13, 2025 by h-albert-lee
add evaluation method log_prob
#23 opened Jan 10, 2025 by h-albert-lee
add logger to all modules
#22 opened Jan 10, 2025 by h-albert-lee
Add Library Documentation
#18 opened Jan 6, 2025 by h-albert-lee
ProTip! no:milestone will show everything without a milestone.