-
-
Notifications
You must be signed in to change notification settings - Fork 7.9k
issue #26031 - [MNT]: decrease timeout on interactive tests locally #26035
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Decreased timeout to 20 for most, 120 is set if CI environment.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for opening your first PR into Matplotlib!
If you have not heard from us in a while, please feel free to ping @matplotlib/developers
or anyone who has commented on the PR. Most of our reviewers are volunteers and sometimes things fall through the cracks.
You can also join us on gitter for real-time discussion.
For details on testing, writing docs, and our review process, please see the developer guide
We strive to be a welcoming and open project. Please follow our Code of Conduct.
In my comment in #26031 I was imagining something like
and then setting |
Please update the PR title/commit message to be more descriptive; we won't know what Issue #26031 means looking through git logs. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Seems to pass all the CI tests, so I guess the slow ones where this matters at least define it.
or we got lucky on these runs. |
Yes, indeed it could be lucky. CI is set on most of the runners it looks like (maybe not Azure Pipelines?): But, perhaps we don't only care about CI systems, but also downstream packagers... Which would mean the MPL-specific environment variable may be the better way to go. Tracing through blame, we have gone from 1s up to 120s now! Increased from both downstream packagers and our CI systems, so both use-cases seem relevant. |
would changing the code to this: _test_timeout = int(os.environ.get('MPLTESTTIMEOUT', 120)) be sufficient? |
It seem axiomatic that timeouts are always "wrong" no matter what value you pick :-p
partially. We would also need to set that env in all of our CI configs and if downstream packagers are relying on this we need to document the change for them so they can set the ENV in their build systems. |
I'm going to close this as a slightly more broad solution was merged in #26235 Thank you for looking in to this, sorry this one didn't end up getting merged, hope to hear from you again! |
Decreased timeout to 20 for most, 120 is set if CI environment.
PR summary
PR checklist