Skip to content

Enable --no-silence-site-packages in eval tests #5370

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

Michael0x2a
Copy link
Collaborator

An unintended side-effect of silencing errors in site packages and typeshed by default is that our tests no longer flag changes to mypy that end up breaking typeshed in some way.

(For example, see https://github.com/python/mypy/pulls/5280 which really should not be passing, at least as of time of writing.)

This pull request will add the --no-silence-site-packages flag to any tests suites that directly or indirectly test typeshed.

Specifically, I believe this ought to add the flag to any tests triggered by testsamples.py, testselfcheck.py, and testpythoneval.py.

An unintended side-effect of silencing errors in site packages
and typeshed by default is that our tests no longer flag
changes to mypy that end up breaking typeshed in some way.

(For example, see https://github.com/python/mypy/pulls/5280 which
*really* should not be passing, at least as of time of writing.)

This pull request will add the `--no-silence-site-packages` flag
to any tests suites that directly or indirectly test typeshed.

Specifically, I believe this ought to add the flag to any tests
triggered by testsamples.py, testselfcheck.py, and
testpythoneval.py.
Copy link
Member

@emmatyping emmatyping left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Thank you for doing this. I think is a good idea!

@JelleZijlstra
Copy link
Member

Looks like this is exposing an actual typeshed problem already: C:\Python36-x64\Lib\mypy\typeshed\stdlib\2and3\shutil.pyi:135: error: Name 'os.terminal_size' is not defined.

JelleZijlstra added a commit to python/typeshed that referenced this pull request Jul 17, 2018
JelleZijlstra added a commit to python/typeshed that referenced this pull request Jul 18, 2018
Michael0x2a added a commit to Michael0x2a/mypy that referenced this pull request Jul 18, 2018
This is mostly so we can get
python/typeshed#2338, which unblocks
python#5370.
@Michael0x2a Michael0x2a mentioned this pull request Jul 18, 2018
Michael0x2a added a commit that referenced this pull request Jul 18, 2018
This is mostly so we can get
python/typeshed#2338, which unblocks
#5370.
@Michael0x2a Michael0x2a merged commit 27c8886 into python:master Jul 18, 2018
@Michael0x2a Michael0x2a deleted the always-enable-no-silence-site-packages-in-eval-tests branch July 18, 2018 20:24
Michael0x2a added a commit to Michael0x2a/mypy that referenced this pull request Jul 20, 2018
This is mostly so we can get
python/typeshed#2338, which unblocks
python#5370.
Michael0x2a added a commit to Michael0x2a/mypy that referenced this pull request Jul 20, 2018
An unintended side-effect of silencing errors in site packages
and typeshed by default is that our tests no longer flag
changes to mypy that end up breaking typeshed in some way.

(For example, see https://github.com/python/mypy/pulls/5280 which
*really* should not be passing, at least as of time of writing.)

This pull request will add the `--no-silence-site-packages` flag
to any test suites that directly or indirectly test typeshed.

Specifically, I believe this PR ought to add the flag to any tests
triggered by `testsamples.py`, `testselfcheck.py`, and
`testpythoneval.py`.
yedpodtrzitko pushed a commit to yedpodtrzitko/typeshed that referenced this pull request Jan 23, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants