Skip to content

issue #26031 - [MNT]: decrease timeout on interactive tests locally #26035

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

edxlang
Copy link

@edxlang edxlang commented Jun 1, 2023

Decreased timeout to 20 for most, 120 is set if CI environment.

PR summary

PR checklist

Decreased timeout to 20 for most, 120 is set if CI environment.
Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for opening your first PR into Matplotlib!

If you have not heard from us in a while, please feel free to ping @matplotlib/developers or anyone who has commented on the PR. Most of our reviewers are volunteers and sometimes things fall through the cracks.

You can also join us on gitter for real-time discussion.

For details on testing, writing docs, and our review process, please see the developer guide

We strive to be a welcoming and open project. Please follow our Code of Conduct.

@melissawm melissawm added Maintenance CI: testing CI configuration and testing labels Jun 1, 2023
@tacaswell
Copy link
Member

In my comment in #26031 I was imagining something like

_timeeut = os.envrion.get('MPLTESTTIMEOUT', 20)

and then setting MPLTESTTIMEOUT in all of the CI setups, however if CI is always defined this is way simpler!

@QuLogic
Copy link
Member

QuLogic commented Jun 1, 2023

Please update the PR title/commit message to be more descriptive; we won't know what Issue #26031 means looking through git logs.

@edxlang edxlang changed the title Issue #26031 issue #26031 - [MNT]: decrease timeout on interactive tests locally Jun 1, 2023
Copy link
Contributor

@greglucas greglucas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems to pass all the CI tests, so I guess the slow ones where this matters at least define it.

@tacaswell tacaswell added this to the v3.8.0 milestone Jun 2, 2023
@tacaswell
Copy link
Member

Seems to pass all the CI tests, so I guess the slow ones where this matters at least define it.

or we got lucky on these runs.

@greglucas
Copy link
Contributor

Yes, indeed it could be lucky. CI is set on most of the runners it looks like (maybe not Azure Pipelines?):
https://docs.github.com/en/actions/learn-github-actions/variables#default-environment-variables
https://github.com/orgs/community/discussions/26628#discussioncomment-3252605

But, perhaps we don't only care about CI systems, but also downstream packagers... Which would mean the MPL-specific environment variable may be the better way to go.

Tracing through blame, we have gone from 1s up to 120s now! Increased from both downstream packagers and our CI systems, so both use-cases seem relevant.
65426e7
602e9f9

@edxlang
Copy link
Author

edxlang commented Jun 2, 2023

would changing the code to this: _test_timeout = int(os.environ.get('MPLTESTTIMEOUT', 120)) be sufficient?

@tacaswell
Copy link
Member

It seem axiomatic that timeouts are always "wrong" no matter what value you pick :-p

would changing the code to this: _test_timeout = int(os.environ.get('MPLTESTTIMEOUT', 120)) be sufficient?

partially. We would also need to set that env in all of our CI configs and if downstream packagers are relying on this we need to document the change for them so they can set the ENV in their build systems.

@ksunden
Copy link
Member

ksunden commented Jul 6, 2023

I'm going to close this as a slightly more broad solution was merged in #26235

Thank you for looking in to this, sorry this one didn't end up getting merged, hope to hear from you again!

@ksunden ksunden closed this Jul 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
Development

Successfully merging this pull request may close these issues.

6 participants