Skip to content

Pull requests: pytorch/torchtune

New pull request New
95 Open 1,690 Closed
95 Open 1,690 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add Intel Gaudi as a supported device.
#2888 opened Jul 22, 2025 by vivekgoe • Draft
2
add smollm to torchtune CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported
#2887 opened Jul 17, 2025 by zhangtemplar Loading…
9
Set expandable_segments explicitly via cuda memory API CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2881 opened Jul 14, 2025 by mirceamironenco Loading…
5 of 13 tasks
1
Reimplement batched_rewards to fix compatibility, broken in #2698 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2876 opened Jul 11, 2025 by krammnic Loading…
2 of 13 tasks
4
Switch remainder of recipe tests over to HF format checkpoints CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2871 opened Jul 8, 2025 by adheep04 • Draft
1 of 4 tasks
3
Qwen 2.5 VL CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2868 opened Jul 3, 2025 by albert-inflection • Draft
5 of 13 tasks
5
Fix qwen3 model implementation in torchtune, closes #2866
#2867 opened Jul 2, 2025 by HayrapetyanZhirayr Loading…
1 of 13 tasks
6
Add fine-grained checkpoint saving controls CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2854 opened Jun 27, 2025 by DonggyuBan Loading…
4 of 13 tasks
3
Iterable Dataset CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2852 opened Jun 26, 2025 by felipemello1 Loading…
1 of 4 tasks
62
Add support for distributed checkpointing of HF safetensors with DCP CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2851 opened Jun 25, 2025 by ankitageorge Loading…
1 of 8 tasks
1
[Gemma2] Use nn.SDPA via MultiHeadAttention CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2844 opened Jun 20, 2025 by Jack-Khuu • Draft
6 of 13 tasks
1
[DO NOT MERGE] fix main CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2832 opened Jun 16, 2025 by joecummings Loading…
1
[DONT MERGE] Debug branch for the Qwen3 + full model compile CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2831 opened Jun 16, 2025 by anijain2305 Loading…
1
skip compiling opt step instead of erroring if opt_in_bwd=True CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2827 opened Jun 13, 2025 by felipemello1 Loading…
1 of 4 tasks
3
raise error if fsdp_cpu_offload + opt_in_bwd CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2826 opened Jun 13, 2025 by felipemello1 Loading…
1 of 4 tasks
1
[WIP] Qwen3 MoE support CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2820 opened Jun 12, 2025 by intervitens • Draft
3 of 6 tasks
6
[RFC] on-the-fly packing CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2819 opened Jun 12, 2025 by felipemello1 Loading…
14
[WIP] Integrate OptimizerInBackward into SFT distributed recipe CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2818 opened Jun 11, 2025 by joecummings • Draft
1
Test alignment of shared methods in recipes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2807 opened Jun 9, 2025 by Andrei-Aksionov • Draft
1
Integrate Muon optimizer (2725) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2803 opened Jun 8, 2025 by Saurabh750 Loading…
1 of 13 tasks
13
Fix command in config CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2796 opened Jun 6, 2025 by krammnic Loading…
1 of 13 tasks
7
[WIP] Proper tool calling support in the torchtune CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2794 opened Jun 6, 2025 by krammnic Loading…
2 of 13 tasks
17
[RFC] Reward modeling CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2788 opened Jun 5, 2025 by krammnic Loading…
1
[RFC] Iterable Dataset CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2785 opened Jun 4, 2025 by felipemello1 Loading…
46
[NOT FOR REVIEW] Full knowledge distillation recipe TP + FP8 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2767 opened May 28, 2025 by krammnic • Draft
13 tasks
2
ProTip! no:milestone will show everything without a milestone.