Skip to content

TST: verify warnings fail the test suite #15169

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Sep 3, 2019

Conversation

tacaswell
Copy link
Member

PR Summary

I expected the tests on azure on preview python to be failing without #15168 so adding a test the will fail if it does not fail on warnings 🤕

The other explanation for it passing is I am confused about if b4 should have the upstream changes that are causing the warnings.

PR Checklist

  • Has Pytest style unit tests
  • Code is Flake 8 compliant

@tacaswell tacaswell added this to the v3.3.0 milestone Sep 1, 2019
@NelleV
Copy link
Member

NelleV commented Sep 3, 2019

That doesn't seem to be working :p

@tacaswell tacaswell marked this pull request as ready for review September 3, 2019 11:26
@tacaswell
Copy link
Member Author

I think it is working, the @pytest.xfail passes even if the wrapped test fails, and the stirict=True flag makes @pytest.xfail fail if the wrapped tests passes.

The reason that the pre-release is currently passing is that while we were installing the beta, we were actually testing with the system python (which was py36), #15168 has a fix for that, but it is failing during installation of dependencies now.

@NelleV
Copy link
Member

NelleV commented Sep 3, 2019

Ok, I finally understood it. On the other hand, I'm confused on why we are testing this in our test suite. It doesn't have much to do with Matplotlib.

@tacaswell
Copy link
Member Author

We set pytest to fail on warnings in our test setup:

("filterwarnings", "error"),
This is making sure that we don't accidental lose that line but think we were still failing on warnings.

@NelleV
Copy link
Member

NelleV commented Sep 3, 2019

I'm not convinced it's useful, but ok. 👍

@NelleV NelleV merged commit 55ff0d3 into matplotlib:master Sep 3, 2019
@tacaswell tacaswell deleted the test_fail_on_warning branch September 3, 2019 14:48
@tacaswell tacaswell modified the milestones: v3.3.0, v3.2.0 Sep 3, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants