Skip to content

Pull requests: huggingface/trl

New pull request New
46 Open 1,184 Closed
46 Open 1,184 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Liger] liger DPO support
#2568 opened Jan 14, 2025 by kashif Loading…
WIP: Base Online Trainer
#2567 opened Jan 13, 2025 by mnoukhov • Draft
4 tasks
2
👨‍👨‍👧‍👧 GRPO
#2565 opened Jan 13, 2025 by qgallouedec • Draft
5 tasks
1
Add _compute_score method to PPOTrainer
#2560 opened Jan 11, 2025 by oliveiraeliel • Draft
2 of 5 tasks
3
🏎️ vllm for Online DPO
#2558 opened Jan 10, 2025 by qgallouedec Loading…
5 tasks
6
PPO/RLOO/OnlineDPO sequence generation: make deepsped 3 weight gathering optional
#2557 opened Jan 10, 2025 by dawidm Loading…
4 tasks done
Add generation caching in TextEnvironment and fix bugs in TextEnvironment
#2556 opened Jan 10, 2025 by konrad-gerlach Loading…
10
Reintroduce truncation_mode in DPOTrainer
#2551 opened Jan 8, 2025 by anakin87 Loading…
4 of 5 tasks
1
8
[Judges] rlhflow pairwise judges
#2548 opened Jan 7, 2025 by kashif Loading…
7
MPO
#2544 opened Jan 6, 2025 by qgallouedec • Draft
5 tasks
1
🔖 Issues Auto-Labeller
#2542 opened Jan 4, 2025 by August-murr Loading…
@August-murr
16
custom reward function support for ppo trainer
#2540 opened Jan 3, 2025 by August-murr • Draft
1 of 5 tasks
1
9
add "_prepare_fsdp" for DPOTrainer
#2539 opened Jan 3, 2025 by faaany Loading…
13
PPOTrainer: fix progress bar for num_mini_batches > 1
#2531 opened Dec 29, 2024 by dawidm Loading…
4 tasks done
1
2
Include stop token in policy model's generation_config
#2528 opened Dec 28, 2024 by dawidm Loading…
2 of 5 tasks
1
check for model instantiation added
#2522 opened Dec 27, 2024 by shirinyamani Loading…
5 tasks
RLOO trainer: fix calculations of steps, episodes and epochs
#2516 opened Dec 23, 2024 by dawidm Loading…
2
KTO refactor
#2507 opened Dec 20, 2024 by qgallouedec • Draft
5 tasks
1
[Liger] Integrate Liger CPO & SimPO
#2506 opened Dec 20, 2024 by Mecoli1219 Loading…
1 of 6 tasks
3
[Liger] add native liger-kernel orpo loss
#2482 opened Dec 15, 2024 by kashif Loading…
18
Tool fine-tuning support DPO
#2479 opened Dec 14, 2024 by August-murr Loading…
4 of 5 tasks
@August-murr
6
Allow eval in Online DPO
#2476 opened Dec 13, 2024 by qgallouedec • Draft
5 tasks
2
1
Add length-normalized DPO
#2458 opened Dec 10, 2024 by hugoabonizio Loading…
1 of 5 tasks
1
[Reward] initial CLoud Reward trainer
#2432 opened Dec 3, 2024 by kashif Loading…
4
added eos token for ppotrainer
#2420 opened Nov 30, 2024 by dame-cell Loading…
3 of 5 tasks
1
2
ProTip! Type g i on any issue or pull request to go back to the issue listing page.