Skip to content

[inductor] Improve GEMM loggings #155427

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

[inductor] Improve GEMM loggings #155427

wants to merge 1 commit into from

Conversation

hlky
Copy link

@hlky hlky commented Jun 8, 2025 •
edited by pytorch-bot bot
Loading

Fixes #155307

import os

os.environ["TORCH_LOGS"] = "inductor"

import torch

M, N, K = 1024, 1024, 1024
dtype = torch.bfloat16
A = torch.randn(10, M, K, device="cuda", dtype=dtype)
B = torch.randn(10, K, N, device="cuda", dtype=dtype)

compiled_model = torch.compile(torch.bmm, fullgraph=True)
_ = compiled_model(A, B)

print("done")
I0608 18:42:58.225000 107971 pytorch/torch/_inductor/compile_fx.py:1006] [0/0] Overview info of inductor aten mms: 
I0608 18:42:58.225000 107971 pytorch/torch/_inductor/compile_fx.py:1007] [0/0] Name                 | B                    | M                    | N                    | K                    | Count               
I0608 18:42:58.226000 107971 pytorch/torch/_inductor/compile_fx.py:1012] [0/0] ------------------------------------------------------------------------------------------------------------------------
I0608 18:42:58.226000 107971 pytorch/torch/_inductor/compile_fx.py:1014] [0/0] aten.bmm             | 10                   | 1024                 | 1024                 | 1024                 | 1                   
I0608 18:42:58.226000 107971 pytorch/torch/_inductor/compile_fx.py:1015] [0/0] ------------------------------------------------------------------------------------------------------------------------

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @ipiszy @chenyang78 @kadeng @muchulee8 @amjames @chauhang @aakhundov @coconutruben

@pytorch-bot PyTorch Bot
Copy link

pytorch-bot bot commented Jun 8, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/155427

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 7cfa9b3 with merge base 09328eb (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@linux-foundation-easycla Linux Foundation: EasyCLA
Copy link

linux-foundation-easycla bot commented Jun 8, 2025 •
edited
Loading

CLA Signed


The committers listed above are authorized under a signed CLA.

@hlky
Copy link
Author

hlky commented Jun 9, 2025

@pytorchbot label "topic: not user facing"

@pytorch-bot pytorch-bot bot added the topic: not user facing topic category label Jun 9, 2025
@albanD albanD requested a review from eellison June 10, 2025 13:40
@albanD albanD added the triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module label Jun 10, 2025
@henrylhtsang
Copy link
Contributor

opted for #155544

@henrylhtsang henrylhtsang requested review from henrylhtsang and removed request for eellison June 11, 2025 16:47
henrylhtsang
henrylhtsang requested changes Jun 11, 2025
View reviewed changes
Copy link
Contributor

@henrylhtsang henrylhtsang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

opted for the other PR

@github-actions GitHub Actions
Copy link
Contributor

Looks like this PR hasn't been updated in a while so we're going to go ahead and mark this as Stale.
Feel free to remove the Stale label if you feel this was a mistake.
If you are unable to remove the Stale label please contact a maintainer in order to do so.
If you want the bot to never mark this PR stale again, add the no-stale label.
Stale pull requests will automatically be closed after 30 days of inactivity.

@github-actions github-actions bot added the Stale label Aug 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@henrylhtsang henrylhtsang henrylhtsang requested changes

Assignees
No one assigned
Labels
module: inductor open source Stale topic: not user facing topic category triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[inductor] Improve GEMM loggings for torch.bmm
4 participants
@hlky @henrylhtsang @albanD @pytorchbot