[build] pin `setuptools>=77` to enable PEP 639 #158104

XuehaiPan · 2025-07-11T05:53:37Z

setuptools v77 adds PEP 639 support for SPDX expression as package.license in pyproject.toml and also deprecated TOML-table-based package.license. That depression will be converted to an error in the future.

Note that setuptools<77 does not support SPDX-based package.license while setuptools>=77 will error for non-SPDX-based package.license in the future. We need an explicit version pin for setuptools>=77 (or pin setuptools<77).

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/158104

📄 Preview Python docs built from this PR
📄 Preview C++ docs built from this PR
❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 New Failures, 1 Unrelated Failure

As of commit 0516a50 with merge base ff0d56d ():

NEW FAILURES - The following jobs have failed:

linux-binary-manywheel / manywheel-py3_11-cuda12_8-full-test / test (gh)
ImportError: libnvshmem_host.so.3: cannot open shared object file: No such file or directory
linux-binary-manywheel / manywheel-py3_14-xpu-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_14t-xpu-test (gh)
Process completed with exit code 1.

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / linux-jammy-py3.13-clang12 / test (crossref, 2, 2, lf.linux.2xlarge) (gh) (similar failure)
cpp/test_jit 1/1 failed!

This comment was automatically generated by Dr. CI and updates every 15 minutes.

ghstack-source-id: 0de80b7 Pull-Request: #158104

[ghstack-poisoned]

ghstack-source-id: a0d315a Pull-Request: #158104

[ghstack-poisoned]

ghstack-source-id: 0f0a345 Pull-Request: #158104

[ghstack-poisoned]

ghstack-source-id: a9749e0 Pull-Request: #158104

[ghstack-poisoned]

ghstack-source-id: 2d2f7fc Pull-Request: #158104

[ghstack-poisoned]

ghstack-source-id: caa071f Pull-Request: #158104

This reverts commit a78fb63. Reverted pytorch#158104 on behalf of https://github.com/malfet due to It still breaks inductor-perf-nightly, see https://github.com/pytorch/pytorch/actions/runs/16425364208/job/46417088208, I'm going to dismiss all previous reviews ([comment](pytorch#158104 (comment)))

rgommers · 2025-07-23T04:52:17Z

Why do we want to enable PEP 639 here?

I'm guessing because the pre-PEP 639 way is deprecated and setuptools has started emitting deprecation warnings that this PR will fix.

That said, the version bumps can be decoupled from the licensing expression change. That will be good, because there's more to PEP 639 than just using an SPDX expression - it has to actually be the correct expression for the distribution (rather than the project's license), which given the many things PyTorch vendors will be something like:

BSD-3-Clause AND MIT AND Apache-2.0 AND (custom stuff here)

This PR in its current state is an improvement, but not actually improving the license metadata just yet.

XuehaiPan · 2025-07-23T05:29:34Z

Why do we want to enable PEP 639 here?

@albanD, I have updated the PR description for more context #158104 (comment).

[ghstack-poisoned]

ghstack-source-id: e817a12 Pull-Request: #158104

[ghstack-poisoned]

ghstack-source-id: d8f9f75 Pull-Request: pytorch#158104

[ghstack-poisoned]

ghstack-source-id: e5138b4 Pull-Request: pytorch#158104

[ghstack-poisoned]

ghstack-source-id: 32a4865 Pull-Request: pytorch#158104

[ghstack-poisoned]

ghstack-source-id: 9a3c1e9 Pull-Request: pytorch#158104

[ghstack-poisoned]

ghstack-source-id: b1f18b3 Pull-Request: pytorch#158104

iremyux · 2025-08-06T11:30:07Z

Adding ciflow/win-arm64 label to trigger Windows Arm64 CI and its test purposes - nothing about this PR specifically. (It should not effect the acceptance of the PR even if it fails.)

[ghstack-poisoned]

ghstack-source-id: 8ffb2cf Pull-Request: pytorch#158104

[ghstack-poisoned]

ghstack-source-id: 79378ae Pull-Request: pytorch#158104

[ghstack-poisoned]

ghstack-source-id: 443804a Pull-Request: pytorch#158104

XuehaiPan · 2025-08-11T13:31:54Z

Since PyTorch 2.8.0 has been released, I wonder if there are any blockers or unresolved concerns about this PR? cc @albanD

albanD · 2025-08-11T18:33:00Z

To me there are two main concers:

I don't understand what we need from pep 639 that justifies all of this.
A lot of version updates and pinning that I'm not sure how to check clearly.

XuehaiPan · 2025-08-12T04:41:02Z

To me there are two main concers:

I don't understand what we need from pep 639 that justifies all of this.

See the PR description #158104 (comment), we will need to pin either <77.0 or >=77.0 shortly. Otherwise, setuptools will complain and fail.

A lot of version updates and pinning that I'm not sure how to check clearly.

I will try to remove the pins as much as I can in this PR, and then get back to you.

Update

ed7683d

[ghstack-poisoned]

XuehaiPan requested review from a team and jeffdaily as code owners July 11, 2025 05:53

pytorch-bot bot added the release notes: releng release notes category label Jul 11, 2025

XuehaiPan added a commit that referenced this pull request Jul 11, 2025

[build] pin setuptools>=77 to enable PEP 639

7d3f9c2

ghstack-source-id: 0de80b7 Pull-Request: #158104

pytorchbot added the open source label Jul 11, 2025

XuehaiPan marked this pull request as draft July 11, 2025 06:27

XuehaiPan added ciflow/binaries Trigger all binary build and upload jobs on the PR ciflow/trunk Trigger trunk jobs on your pull request ciflow/inductor labels Jul 11, 2025

Update

9684ee0

[ghstack-poisoned]

XuehaiPan added a commit that referenced this pull request Jul 11, 2025

[build] pin setuptools>=77 to enable PEP 639

6cd9ce1

ghstack-source-id: a0d315a Pull-Request: #158104

XuehaiPan mentioned this pull request Jul 11, 2025

[BE][Easy] split build system requirements.txt to a separate file #158111

Closed

Update

3902856

[ghstack-poisoned]

XuehaiPan added a commit that referenced this pull request Jul 11, 2025

[build] pin setuptools>=77 to enable PEP 639

d4b29f3

ghstack-source-id: 0f0a345 Pull-Request: #158104

Update

e51f1b8

[ghstack-poisoned]

XuehaiPan added a commit that referenced this pull request Jul 11, 2025

[build] pin setuptools>=77 to enable PEP 639

3ed78aa

ghstack-source-id: a9749e0 Pull-Request: #158104

Update

e097bfa

[ghstack-poisoned]

XuehaiPan added a commit that referenced this pull request Jul 11, 2025

[build] pin setuptools>=77 to enable PEP 639

d70f7bc

ghstack-source-id: 2d2f7fc Pull-Request: #158104

Update

e060ff5

[ghstack-poisoned]

XuehaiPan added module: build Build system issues release notes: build release notes category topic: build labels Jul 11, 2025

XuehaiPan added a commit that referenced this pull request Jul 11, 2025

[build] pin setuptools>=77 to enable PEP 639

2054bfb

ghstack-source-id: caa071f Pull-Request: #158104

XuehaiPan marked this pull request as ready for review July 11, 2025 10:17

Update

cfef0b8

[ghstack-poisoned]

XuehaiPan added a commit that referenced this pull request Jul 23, 2025

[build] pin setuptools>=77 to enable PEP 639

d0adb56

ghstack-source-id: e817a12 Pull-Request: #158104

This was referenced Jul 23, 2025

[BE][Easy] add missing Python 3.14 PyPI classifier #158904

Closed

[BE] bump test dependency z3-solver to drop using deprecated pkg_resources #158905

Closed

Update

9e3ae73

[ghstack-poisoned]

XuehaiPan added a commit to XuehaiPan/pytorch that referenced this pull request Jul 26, 2025

[build] pin setuptools>=77 to enable PEP 639

c391d1c

ghstack-source-id: d8f9f75 Pull-Request: pytorch#158104

Update

94a2754

[ghstack-poisoned]

XuehaiPan added a commit to XuehaiPan/pytorch that referenced this pull request Jul 28, 2025

[build] pin setuptools>=77 to enable PEP 639

b1c09a9

ghstack-source-id: e5138b4 Pull-Request: pytorch#158104

Update

77e8efc

[ghstack-poisoned]

XuehaiPan added a commit to XuehaiPan/pytorch that referenced this pull request Jul 28, 2025

[build] pin setuptools>=77 to enable PEP 639

d25b85f

ghstack-source-id: 32a4865 Pull-Request: pytorch#158104

XuehaiPan requested review from albanD and atalman July 28, 2025 10:26

Update

b978039

[ghstack-poisoned]

XuehaiPan added a commit to XuehaiPan/pytorch that referenced this pull request Jul 31, 2025

[build] pin setuptools>=77 to enable PEP 639

325d383

ghstack-source-id: 9a3c1e9 Pull-Request: pytorch#158104

Update

26f0c1a

[ghstack-poisoned]

XuehaiPan added a commit to XuehaiPan/pytorch that referenced this pull request Aug 5, 2025

[build] pin setuptools>=77 to enable PEP 639

5f7d6fb

ghstack-source-id: b1f18b3 Pull-Request: pytorch#158104

iremyux added the ciflow/win-arm64 Trigger Windows Arm64 CI Workflows label Aug 6, 2025

Update

a3b8ea2

[ghstack-poisoned]

XuehaiPan added a commit to XuehaiPan/pytorch that referenced this pull request Aug 6, 2025

[build] pin setuptools>=77 to enable PEP 639

cb220af

ghstack-source-id: 8ffb2cf Pull-Request: pytorch#158104

Update

5bfce27

[ghstack-poisoned]

XuehaiPan added a commit to XuehaiPan/pytorch that referenced this pull request Aug 10, 2025

[build] pin setuptools>=77 to enable PEP 639

279170e

ghstack-source-id: 79378ae Pull-Request: pytorch#158104

Update

0516a50

[ghstack-poisoned]

XuehaiPan added a commit to XuehaiPan/pytorch that referenced this pull request Aug 11, 2025

[build] pin setuptools>=77 to enable PEP 639

04ed5fe

ghstack-source-id: 443804a Pull-Request: pytorch#158104

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[build] pin `setuptools>=77` to enable PEP 639 #158104

[build] pin `setuptools>=77` to enable PEP 639 #158104

XuehaiPan commented Jul 11, 2025 •

edited

Loading

Uh oh!

pytorch-bot bot commented Jul 11, 2025 •

edited

Loading

Uh oh!

rgommers commented Jul 23, 2025

Uh oh!

XuehaiPan commented Jul 23, 2025

Uh oh!

iremyux commented Aug 6, 2025

Uh oh!

XuehaiPan commented Aug 11, 2025

Uh oh!

albanD commented Aug 11, 2025

Uh oh!

XuehaiPan commented Aug 12, 2025

Uh oh!

Uh oh!

[build] pin setuptools>=77 to enable PEP 639 #158104

Are you sure you want to change the base?

[build] pin setuptools>=77 to enable PEP 639 #158104

Conversation

XuehaiPan commented Jul 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pytorch-bot bot commented Jul 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/158104

❌ 3 New Failures, 1 Unrelated Failure

Uh oh!

rgommers commented Jul 23, 2025

Uh oh!

XuehaiPan commented Jul 23, 2025

Uh oh!

iremyux commented Aug 6, 2025

Uh oh!

XuehaiPan commented Aug 11, 2025

Uh oh!

albanD commented Aug 11, 2025

Uh oh!

XuehaiPan commented Aug 12, 2025

Uh oh!

Uh oh!

[build] pin `setuptools>=77` to enable PEP 639 #158104

[build] pin `setuptools>=77` to enable PEP 639 #158104

XuehaiPan commented Jul 11, 2025 •

edited

Loading

pytorch-bot bot commented Jul 11, 2025 •

edited

Loading