Skip to content

Pull requests: huggingface/trl

New pull request New
69 Open 1,469 Closed
69 Open 1,469 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix unset tokenizer pad_token
#3290 opened Apr 14, 2025 by LeonEricsson Loading…
4 of 5 tasks
1
1
[GRPO] Add metrics for low and high clipped token probabilities
#3289 opened Apr 14, 2025 by lewtun Loading…
5 tasks
4
Modified GRPOTrainer to accumulate gradient within a single training batch
#3288 opened Apr 13, 2025 by jarrelscy Loading…
3 of 5 tasks
Add Ascend NPU support for vLLM server
#3286 opened Apr 12, 2025 by ji-huazhong Loading…
5 tasks
2
Add OpenAI-compatible vLLM server with weight synchronization
#3285 opened Apr 12, 2025 by BjarniHaukur • Draft
5 tasks
1
☝️ [GRPO] Generate once per effective batch
#3283 opened Apr 12, 2025 by qgallouedec Loading…
5 tasks
11
Fixes typo in SFTTrainer
#3282 opened Apr 11, 2025 by taras-sereda Loading…
1 of 5 tasks
vllm-dp-v1
#3281 opened Apr 11, 2025 by shirinyamani • Draft
5 tasks
3
add vllm support for token ids as input
#3280 opened Apr 11, 2025 by wybryan Loading…
1
Reward takes completion ids
#3272 opened Apr 9, 2025 by qgallouedec • Draft
5 tasks
🦙 Llama 4
#3267 opened Apr 9, 2025 by qgallouedec • Draft
5 tasks
[NOT MEANT TO BE MERGED] Log correct/incorrect lengths
#3263 opened Apr 8, 2025 by qgallouedec • Draft
[SFT] support for ring_attn in SFTTrainer
#3262 opened Apr 8, 2025 by kashif Loading…
5 tasks
2
[🐯+GRPO] Support FSDP + Fix bug when using LigerGRPO with DDP
#3260 opened Apr 8, 2025 by shivam15s Loading…
1 of 5 tasks
@kashif
3
Add a raw generate API to the vLLM server
#3227 opened Apr 3, 2025 by wilrop Loading…
5 tasks
3
Support iterable datasets in GRPO
#3226 opened Apr 3, 2025 by wilrop Loading…
5 tasks
1
7
feat(trainer): Support multi-role & consecutive turns in DataCollatorForCompletionOnlyLM (#3223)
#3224 opened Apr 3, 2025 by Kirili4ik Loading…
4 tasks done
1
Adding sampling parameters for vllm generation
#3210 opened Apr 2, 2025 by shaipranesh2 Loading…
6
Support for Models With Pre-Finetuned LoRA Adapters in GRPO: Add use_peft_as_reference Flag
#3196 opened Mar 31, 2025 by LoganVegnaSHOP Loading…
5 tasks done
1
7
GRPO: Scalable training with one LLM/node
#3186 opened Mar 31, 2025 by jglaser Loading…
3 of 5 tasks
3
🚀 Enhance GRPO VLLM server from sync to async and accelerate training
#3182 opened Mar 30, 2025 by binary-husky Loading…
3
Co-Locating vLLM w/ training to achieve higher throughput and GPU utilization
#3162 opened Mar 26, 2025 by toslali-ibm Loading…
2 of 5 tasks
1
20
Extend BCO Trainer dataset format support
#3134 opened Mar 22, 2025 by reihig-ut Loading…
1 of 5 tasks
Add GRPO/ Online DPO support for quantitative models when use vllm as infer backbone.
#3133 opened Mar 22, 2025 by maoulee Loading…
5
improvement(utils.py): simplify repeating completion string
#3122 opened Mar 20, 2025 by tpoisonooo Loading…
6
ProTip! Mix and match filters to narrow down what you’re looking for.