Skip to content

Actions: huggingface/lighteval

Build Documentation

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
53 workflow runs
53 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Made judge response processing more robust. (#491)
Build Documentation #53: Commit 0140578 pushed by clefourrier
January 20, 2025 14:41 1m 31s main
January 20, 2025 14:41 1m 31s
feat: add asian language support to CorpusLevelTranslationMetric (#479)
Build Documentation #52: Commit be18ae5 pushed by clefourrier
January 20, 2025 09:03 1m 24s main
January 20, 2025 09:03 1m 24s
Hotfix for litellm judge (#490)
Build Documentation #51: Commit fee2ec3 pushed by clefourrier
January 20, 2025 09:02 1m 38s main
January 20, 2025 09:02 1m 38s
Fixed issue with o1 in litellm. (#493)
Build Documentation #50: Commit 3b89734 pushed by clefourrier
January 20, 2025 09:02 2m 6s main
January 20, 2025 09:02 2m 6s
Fix math extraction (#503)
Build Documentation #49: Commit 90d44c1 pushed by clefourrier
January 18, 2025 17:57 1m 24s main
January 18, 2025 17:57 1m 24s
Extractive Match metric (#495)
Build Documentation #48: Commit 59624c8 pushed by hynky1999
January 15, 2025 10:19 1m 19s main
January 15, 2025 10:19 1m 19s
fix README link (#500)
Build Documentation #47: Commit a7aa6ed pushed by clefourrier
January 14, 2025 17:15 1m 45s main
January 14, 2025 17:15 1m 45s
Build Documentation
Build Documentation #46: by clefourrier
January 7, 2025 15:20 1m 35s main
January 7, 2025 15:20 1m 35s
Made litellm judge backend more robust. (#485)
Build Documentation #45: Commit fdb12f4 pushed by clefourrier
January 7, 2025 08:24 1m 50s main
January 7, 2025 08:24 1m 50s
Fix issue with encodings for together models. (#483)
Build Documentation #44: Commit 2073a29 pushed by clefourrier
January 7, 2025 08:23 1m 22s main
January 7, 2025 08:23 1m 22s
Update README.md (#486)
Build Documentation #43: Commit f6fee3a pushed by clefourrier
January 6, 2025 12:45 1m 26s main
January 6, 2025 12:45 1m 26s
Tiny improvements to endpoint_model.py, base_model.py,... (#219)
Build Documentation #42: Commit 452e031 pushed by clefourrier
January 3, 2025 17:22 1m 24s main
January 3, 2025 17:22 1m 24s
Release: v0.7.0
Build Documentation #41: Commit 657978d pushed by NathanHB
January 3, 2025 14:02 1m 22s v0.7-release
January 3, 2025 14:02 1m 22s
Release: v0.7.0
Build Documentation #40: Commit e8a9058 pushed by NathanHB
January 2, 2025 16:12 1m 30s v0.7-release
January 2, 2025 16:12 1m 30s
Homogeneize generation params (#428)
Build Documentation #39: Commit 5a28b22 pushed by NathanHB
January 2, 2025 15:38 1m 28s v0.7-release
January 2, 2025 15:38 1m 28s
Homogeneize generation params (#428)
Build Documentation #38: Commit 5a28b22 pushed by clefourrier
January 2, 2025 14:40 1m 26s main
January 2, 2025 14:40 1m 26s
fix model parallel (#481)
Build Documentation #37: Commit 24afde2 pushed by NathanHB
January 2, 2025 11:20 1m 24s main
January 2, 2025 11:20 1m 24s
Add litellm inference (#385)
Build Documentation #36: Commit a2541b1 pushed by NathanHB
January 2, 2025 10:44 1m 29s main
January 2, 2025 10:44 1m 29s
fix: scorer attribute initialization in ROUGE (#471)
Build Documentation #35: Commit 2ef9740 pushed by clefourrier
December 26, 2024 12:07 1m 22s main
December 26, 2024 12:07 1m 22s
fix: LightevalTaskConfig.stop_sequence attribute (#463)
Build Documentation #34: Commit 9ff194d pushed by clefourrier
December 26, 2024 12:07 1m 28s main
December 26, 2024 12:07 1m 28s
Delete endpoint on InferenceEndpointTimeoutError (#475)
Build Documentation #33: Commit 801c21a pushed by clefourrier
December 26, 2024 12:07 1m 21s main
December 26, 2024 12:07 1m 21s
Checkout PR merge commit for CI tests (#468)
Build Documentation #32: Commit 8568e72 pushed by albertvillanova
December 21, 2024 05:47 1m 25s main
December 21, 2024 05:47 1m 25s
Fix warning about precedence of custom tasks over default ones in reg…
Build Documentation #31: Commit 264f3f8 pushed by NathanHB
December 20, 2024 18:14 1m 33s main
December 20, 2024 18:14 1m 33s
Update arabic_evals.py: Fix custom arabic tasks [2nd attempt] (#444)
Build Documentation #30: Commit fbca143 pushed by NathanHB
December 20, 2024 18:12 1m 22s main
December 20, 2024 18:12 1m 22s
Remove unnecessary deepcopy in evaluation_tracker (#459)
Build Documentation #29: Commit a1c610d pushed by albertvillanova
December 19, 2024 15:03 1m 27s main
December 19, 2024 15:03 1m 27s