Skip to content

Pull requests: pytorch/torchtitan

New pull request New
268 Open 1,999 Closed
268 Open 1,999 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[RL] Add gpu_direct_weight_sync flag to control whether we use GPU direct or not ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2942 opened Apr 13, 2026 by daniellepintz Contributor Loading…
Add Qwen3-14B GRPO config and 14B_varlen model registry entry ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot. fb-exported meta-exported
#2941 opened Apr 13, 2026 by daniellepintz Contributor Loading…
1
Add regional inductor ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2940 opened Apr 13, 2026 by tugsbayasgalan Contributor • Draft
Moe train module: rocm
#2939 opened Apr 12, 2026 by Acatsama0871 Loading…
1
[Don't review] ChunkedCELoss ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2937 opened Apr 10, 2026 by wwwjn Contributor • Draft
7
[GraphTrainer][AutoDev] Support transformer_block_bucketing in aot_fx_trace mode ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2934 opened Apr 10, 2026 by yiming0416 Contributor • Draft
2
[rl] Enable batch-invariant using FSDP to apply mixed precision ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2932 opened Apr 10, 2026 by wwwjn Contributor • Draft
Fused linear projection within MLP ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2931 opened Apr 10, 2026 by wwwjn Contributor • Draft
[DO NOT REVIEW] Restore maybe_enable_amp for graph trainer after PR #2900 ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2927 opened Apr 10, 2026 by weifengpy Contributor Loading…
add cudagraph annotation ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2926 opened Apr 10, 2026 by yushangdi • Draft
[LoRA]Add LoRA model converter with dynamic class inheritance ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2923 opened Apr 9, 2026 by mori360 Contributor • Draft
2
[graph_trainer] Fix CUDAGraph warmup to stay on current stream ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2922 opened Apr 9, 2026 by bobrenjc93 Contributor Loading…
4
[graph_trainer] Add CooR precompile support for DeepSeek V3 ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2916 opened Apr 9, 2026 by bobrenjc93 Contributor Loading…
[GraphTrainer][AutoDev] Add gradient accumulation integration test ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2914 opened Apr 9, 2026 by SherlockNoMad Contributor • Draft
2 tasks
2
[GraphTrainer][AutoDev] Add DeepSeek-v3 AOT pass parity integration tests ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2913 opened Apr 9, 2026 by SherlockNoMad Contributor • Draft
2 tasks
[GraphTrainer][AutoDev] Add integration test for fsdp_reshard_after_fwd joint pass ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2911 opened Apr 9, 2026 by SherlockNoMad Contributor • Draft
1 task
2
[GraphTrainer][AutoDev] Fix missing CP wiring in llama3 and deepseek_v3 parallelize ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2910 opened Apr 9, 2026 by SherlockNoMad Contributor • Draft
2 tasks
2
[GraphTrainer][AutoDev] Save CUDA-to-CPU copies in SAC pass to match core behavior ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2908 opened Apr 9, 2026 by SherlockNoMad Contributor • Draft
4 tasks
[graph_trainer] Add cudagraph support for AOT and CooR precompile paths ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2907 opened Apr 9, 2026 by bobrenjc93 Contributor Loading…
11
[rl] Add batched RL training with varlen sequence packing ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2906 opened Apr 9, 2026 by joecummings Member Loading…
41
Test for https://github.com/drisspg/pt_job_queue/pull/9 ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2904 opened Apr 9, 2026 by xmfan Member • Draft
1
1
Refactor checkpoint system with StateDictTransforms and converter protocol ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2898 opened Apr 8, 2026 by mori360 Contributor • Draft
2
Rewrite model state dict adapters with explicit RENAME/LAYER_RENAME pattern ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2897 opened Apr 8, 2026 by mori360 Contributor Loading…
2
Bump transformers from 4.57.1 to 5.0.0rc3 in /.ci/docker CLA Signed This label is managed by the Meta Open Source bot. dependencies Pull requests that update a dependency file python Pull requests that update python code
#2885 opened Apr 8, 2026 by dependabot bot Loading…
1
[GraphTrainer][AutoDev] Introduce CPU offload pass for activation memory savings ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#2879 opened Apr 7, 2026 by SherlockNoMad Contributor • Draft
5 tasks done
20
ProTip! Filter pull requests by the default branch with base:main.