Skip to content

Pull requests: huggingface/trl

New pull request New
69 Open 1,898 Closed
69 Open 1,898 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix #3982: Fix DPO Trainer support for Gemma 3 vision models
#4022 opened Sep 6, 2025 by akshay-babbar Loading…
1
Fix passing model kwargs
#4019 opened Sep 5, 2025 by qgallouedec Loading…
1
Align docstring parameters with function definitions
#4017 opened Sep 5, 2025 by albertvillanova Loading…
2
Fix: undefined current_gradient_accumulation_steps
#4014 opened Sep 5, 2025 by ysjprojects Loading…
2 of 5 tasks
1
1
Fix: ignore precompute_ref_log_probs when use_liger_loss=True
#4008 opened Sep 4, 2025 by ginkyenglee Loading…
5 tasks
1
Improve typing of SFT trainer
#4007 opened Sep 4, 2025 by cyyever Loading…
⚖️ Align SFT and DPO for model creation and deprecate DPOConfig.padding_value in favour or pad_token_id
#4006 opened Sep 4, 2025 by qgallouedec Loading…
5 tasks
1
✨ Improve SFT doc
#4005 opened Sep 4, 2025 by qgallouedec Loading…
5 tasks
1
Remove attention mask when position ids is returned
#3997 opened Sep 2, 2025 by qgallouedec • Draft
Fix: Make sft script work when chat template is None
#3995 opened Sep 2, 2025 by rabinadk1 Loading…
1 of 5 tasks
6
[docs] add CP docs
#3994 opened Sep 2, 2025 by kashif Loading…
28
[GFPO]: implement GFPO in GRPOTrainer
#3989 opened Sep 1, 2025 by Peter-Chou Loading…
3 of 5 tasks
7
Enable saving and loading precomputed reference log probabilities in …
#3986 opened Sep 1, 2025 by ginkyenglee Loading…
3 tasks
1
1
Dft
#3960 opened Aug 27, 2025 by 1485840691 Loading…
5 tasks
1
3
fix bug when using dataset streaming by accelerate
#3950 opened Aug 25, 2025 by kaixuanliu Loading…
5
Docker update
#3931 opened Aug 20, 2025 by qgallouedec Loading…
5 tasks
1
[SFTTrainer]: Check for assistant mask up to max_length
#3930 opened Aug 20, 2025 by pramodith Loading…
3 of 5 tasks
@albertvillanova
17
[DRAFT] Refactor DPO
#3906 opened Aug 15, 2025 by qgallouedec • Draft
5 tasks
Test in distributed setting
#3902 opened Aug 15, 2025 by qgallouedec Loading…
5 tasks
1
BEMA for ref model
#3898 opened Aug 14, 2025 by qgallouedec Loading…
5 tasks
1
GRPOTrainer : fix prompt truncation for multimodal inputs with multiple image tokens
#3879 opened Aug 11, 2025 by artem-spector Loading…
4 tasks
8
Implement DPOP
#3864 opened Aug 7, 2025 by 1485840691 Loading…
5
[#3647] Fix: Assign default values in the GKDTrainer's constructor only when …
#3851 opened Aug 5, 2025 by seungduk-yanolja Loading…
2 of 5 tasks
1
2
Update profiling.py: fix scoping problems for wandb and mlflow
#3845 opened Aug 4, 2025 by markshinyounglee Loading…
5 tasks done
2
dynamic temperature
#3844 opened Aug 4, 2025 by shirinyamani • Draft
5 tasks
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.