[Graph Partition] Pass all OSS unit tests #154667
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/154667
Note: Links to docs will display an error until the docs builds have been completed. ✅ You can merge normally! (1 Unrelated Failure)As of commit df77c93 with merge base ee89cc7 ( FLAKY - The following job failed but was likely due to flakiness present on trunk:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
a47400d to
7586fd6
Compare
93ba9d5 to
7acb21e
Compare
7acb21e to
880a8ca
Compare
|
What is the next steps for this ? Would you file issues related to the cudagraph partition slowdowns in torchbench ? This was a good amount of work - would be great to get it rolled out automatically to users. |
|
yes we should turn on by default in oss. let me check more on torchbench perf. |
|
@pytorchbot merge |
Merge startedYour change will be merged once all checks pass (ETA 0-4 Hours). Learn more about merging in the wiki. Questions? Feedback? Please reach out to the PyTorch DevX Team |
Merge failedReason: 1 jobs have failed, first few of them are: Meta Internal-Only Changes Check Details for Dev Infra teamRaised by workflow job |
|
@BoyuanFeng has imported this pull request. If you are a Meta employee, you can view this in D79104472. |
|
@pytorchbot merge |
Merge startedYour change will be merged once all checks pass (ETA 0-4 Hours). Learn more about merging in the wiki. Questions? Feedback? Please reach out to the PyTorch DevX Team |
|
@pytorchbot revert -m "broke inductor/test_memory.py::TestOperatorReorderForPeakMemory::test_reorder_peak_memory_lpmf GH job link HUD commit link note to self: bad TD" -c nosignal |
|
@pytorchbot successfully started a revert job. Check the current status here. |
|
@BoyuanFeng your PR has been successfully reverted. |
This reverts commit ca7315c. Reverted #154667 on behalf of https://github.com/clee2000 due to broke inductor/test_memory.py::TestOperatorReorderForPeakMemory::test_reorder_peak_memory_lpmf [GH job link](https://github.com/pytorch/pytorch/actions/runs/16885961204/job/47836769279) [HUD commit link](https://hud.pytorch.org/pytorch/pytorch/commit/ca7315c17162ea21b1ca5ba23f4bf6168766c7b9) note to self: bad TD ([comment](#154667 (comment)))
|
@pytorchbot merge |
Merge startedYour change will be merged once all checks pass (ETA 0-4 Hours). Learn more about merging in the wiki. Questions? Feedback? Please reach out to the PyTorch DevX Team |
Graph partition leads to 6.2% speedup on vision_maskrcnn, 5.8% speedup on yolov3. P1819700563, 39.5% speedup on speech_transformer inference P1830602200, 85% speedup on speech_transformer training P1831115315.
Run the same diff on two days and both show speedup on average.
first TorchInductor Benchmark ci run
second TorchInductorBenchmark ci run
cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @ipiszy @chenyang78 @kadeng @muchulee8 @amjames @chauhang @aakhundov @coconutruben @Lucaskabela