The mother of all pull requests: add --incremental#1292

Merged

gvanrossum merged 125 commits intopython:masterfrom

gvanrossum:incremental

Apr 8, 2016

Commits on Mar 13, 2016

Dump/load infrastructure set up (data [de]serialization is bogus).
Guido van Rossum
committed
Major redo; dependency processing now uses build manager states.
Guido van Rossum
committed
Start on serialization.
Guido van Rossum
committed
Totally different approach to serialization.
Guido van Rossum
committed
Improved log()/trace() API. Improved handling cached dependencies.
Guido van Rossum
committed
Serialize more types. We can now serialize (but not yet deserialize!) every type occurring in mypy.
Guido van Rossum
committed
Start fixing up nodes after deserialization().
Guido van Rossum
committed
Another big step towards correct [de]serialization. Added fairly thorough check on what we wrote.
Guido van Rossum
committed
Progress towards fixing up more cross references. But also more debugging.
Guido van Rossum
committed
Do not serialize mro -- recompute it.
Guido van Rossum
committed
Instance.serialize() always writes the TypeInfo's fullname. Different tack for fixup.
Guido van Rossum
committed
Fixing the fixup code. Too much debugging prints though.
Guido van Rossum
committed
Less debug output. The type fixer should now be (mostly) complete.
Guido van Rossum
committed
Lots more debugging around MRO calculation. Fixed a bug in serialization of OverloadedFuncDef (type was missing).
Guido van Rossum
committed
Fix a tricky issue where MRO linearization failed for the builtins/typing/abc cluster.
Guido van Rossum
committed
Improved (de)serialization of TypeInfo. Multi-pass fixup algorithm.
Guido van Rossum
committed
Remove redundant final_passes(); it was a no-op.
Guido van Rossum
committed
Refactor build states, on our way to cycle resilience.
Guido van Rossum
committed
Various small cleanups.
Guido van Rossum
committed
Rewrite fixit.lookup_qualified(). Rewrite is_ready() for cache states to use transitive closure.
Guido van Rossum
committed
Be less shy about the type of variables and bound_vars -- they are always lists.
Guido van Rossum
committed
Serialize decorators (at least simple ones). Explicitly ignore UNBOUND_IMPORTED.
Guido van Rossum
committed
Fix up ct.bound_vars. Missing arg types are okay.
Guido van Rossum
committed
Use log() instead of print() for "FIXING MODULE PASS N".
Guido van Rossum
committed
Add visit decorator and overloaded.
Guido van Rossum
committed
Serialize UnboundType.
Guido van Rossum
committed
Prototype approach to class C(NamedTuple("C", ...)): ...
Guido van Rossum
committed
Make the type fixer/cleaner recurse into Instance.args.
Guido van Rossum
committed
Serialize TypeList and EllipsisType.
Guido van Rossum
committed
Serialize Argument.type_annotation.
Guido van Rossum
committed
Fix up SymbolNode.type.
Guido van Rossum
committed
Serialize implicit flag. Reformat CallableType a bit.
Guido van Rossum
committed
Must visit OverloadedFuncDef.type. Clean up visit_callable_types().
Guido van Rossum
committed
Visit contents of CallableType.variables.
Guido van Rossum
committed
Serialize complete Var.
Guido van Rossum
committed
Serialize all of NameExpr.
Guido van Rossum
committed
Serialize TupleType.implicit.
Guido van Rossum
committed
Serialize (mostly) complete ClassDef.
Guido van Rossum
committed
Serialize FuncDef._fullname.
Guido van Rossum
committed
Serialize FuncDef.is_class.
Guido van Rossum
committed
Avoid crash in TypeCleaner.visit_instance() if inst.type is None.
Guido van Rossum
committed
Better approach to cross-references, to avoid copying imported definitions.
Guido van Rossum
committed
Assign namedtuple a unique name from the start. Get rid of cleanup pass.
Guido van Rossum
committed
Fix the post-serialization checking code.
Guido van Rossum
committed
Fix flake8 errors.
Guido van Rossum
committed
Only give a NamedTuple a unique name if not in an assignment. Also fix tests.
Guido van Rossum
committed
A cross_ref must have a dotted name.
Guido van Rossum
committed
Do not serialize Decorator.decorators.
Guido van Rossum
committed
Give nested classes their full name. Also updated tests.
Guido van Rossum
committed
Fix reading source code when falling back to UnprocessedFile in ProbablyCachedFile.process().
Guido van Rossum
committed
Serialize SymbolTableNode.module_public.
Guido van Rossum
committed
Use pyversion as part of cache name.
Guido van Rossum
committed
Add --incremental flag (off by default).
Guido van Rossum
committed
TypeVarDef.values is actually Optional.
Guido van Rossum
committed
Do not serialize ClassDef.decorators.
Guido van Rossum
committed
Store a reference to the modules dict on the BuildManager.
Guido van Rossum
committed
Refactor dump_to_json().
Guido van Rossum
committed
New dependency manager. For now, only used when --incremental given.
Guido van Rossum
committed
Clarify/fix big comment block, add some comments, minor cleanup.
Guido van Rossum
committed
Honor --incremental in depmgr.
Guido van Rossum
committed
Tweak some log/trace calls. Add relative time to log/trace output.
Guido van Rossum
committed
Process nodes in an SCC in a deterministic order.
Guido van Rossum
committed
Satisfy flake8. Warn instead of die on missing module ref.
Guido van Rossum
committed
Check for errors at various points.
Guido van Rossum
committed
Add -i as shortcut for --incremental. Pass -i -i to use new depmgr.
Guido van Rossum
committed
Don't write cache if we have errors. Improve fresh/stale logging.
Guido van Rossum
committed
Deal with __builtin__/builtins in Python 2 mode.
Guido van Rossum
committed
Improve fresh/stale logging. Switch to absolute imports.
Guido van Rossum
committed
Honor manager.target field.
Guido van Rossum
committed
Some updates to module docstring.
Guido van Rossum
committed
Move module_not_found() into BuildManager.
Guido van Rossum
committed
Improve error handling around module loading.
Guido van Rossum
committed
Reworked dependency collection and import context management.
Guido van Rossum
committed
Fix errors about overreaching relative imports.
Guido van Rossum
committed
Patch submodule into its parent in a later stage so it's more likely to work.
Guido van Rossum
committed
Support --[infer]stats and file reports.
Guido van Rossum
committed
Call patch_parent() for fresh as well as stale modules. Minor cleanups.
Guido van Rossum
committed
Killed the old state machine. Yeah!
Guido van Rossum
committed
Merged depmgr into build, to avoid a nasty import cycle.
Guido van Rossum
committed
Make parse_file() a BuildManager method.
Guido van Rossum
committed
Roots are dependencies after all. But they're still special.
Guido van Rossum
committed
Implement --silent-imports.
Guido van Rossum
committed
Compare cache file mtimes.
Guido van Rossum
committed
Well... roots are *not* dependencies after all. It broke typeshed testing.
Guido van Rossum
committed

Commits on Mar 14, 2016

remove_cwd_prefix_from_path() should check for __init__.pyi.
Guido van Rossum
committed
Rename roots to ancestors. Fix --silent for them.
Guido van Rossum
committed
Improve SCC logging. Fix indentation.
Guido van Rossum
committed
Make sorted_components() work for subgraphs too.
Guido van Rossum
committed
Horrible hack to deal with a nasty cycle in sqlalchemy.sql.
Guido van Rossum
committed
Sync typeshed
Guido van Rossum
committed

Commits on Mar 15, 2016

Sync typeshed
Guido van Rossum
committed

Commits on Mar 16, 2016

Stabilize return order of topsort and avoid depending on p for "from p import m".
Guido van Rossum
committed

Commits on Mar 17, 2016

Merge commit 'aa5efb0' into incremental (switch to argparse)
Guido van Rossum
committed
Merge branch 'master' into incremental (up to the rename of --implicit-any to --check-untyped-defs).
Guido van Rossum
committed
Sync typeshed (pickle).
Guido van Rossum
committed

Commits on Mar 18, 2016

Merge branch 'master' into incremental
Guido van Rossum
committed

Commits on Mar 23, 2016

WIP: attempt to give classmethod first arg a reasonable type. Fixes #292
Guido van Rossum
committed
Fix TypeAnalyser.visit_callable_type() to preserve fallback if present (found by Jukka).
Guido van Rossum
committed
Make tests pass.
Guido van Rossum
committed
Properly type-check C().some_class_method.
Guido van Rossum
committed
Rewrite long line.
Guido van Rossum
committed
Rename class_subtype to class_type.
Guido van Rossum
committed
Add unit tests.
Guido van Rossum
committed
Add a comment to the cls argument check.
Guido van Rossum
committed
It should not be an error to call an abstract method from a class method!
Guido van Rossum
committed
Propagate implicit and is_classmethod_class in CallableType.copy_modified().
Guido van Rossum
committed
Merge branch 'master' into incremental (esp. Greg's reports PR).
Guido van Rossum
committed
Merge branch 'classmethod' into incremental (PR #1313, classmethod first arg).
Guido van Rossum
committed
[De]serialize is_classmethod_class.
Guido van Rossum
committed
Clear trailing whitespace.
Guido van Rossum
committed

Commits on Apr 5, 2016

Merge branch 'master' into incremental
Guido van Rossum
committed
Merge branch 'master' into incremental
Guido van Rossum
committed

Commits on Apr 6, 2016

Remove all print statements and pdb calls from fixup.py. Add asserts for error conditions instead.
Guido van Rossum
committed
Respond to code review for nodes.py.
Guido van Rossum
committed
Respond to code review for types.py.
Guido van Rossum
committed
Respond to code review for build.py.
Guido van Rossum
committed
Add a few unit tests for the graph processing in build.py.
Guido van Rossum
committed

Commits on Apr 7, 2016

Add manager and error messages to BuildResult; don't raise for non-blockers.
Guido van Rossum
committed
Fix docstrings for AssertionFailure and SkipTestCaseException.
Guido van Rossum
committed
Added support for checking incremental mode.
Guido van Rossum
committed
Fully annotate testcheck.py
Guido van Rossum
committed
Fully annotate testgraph.py.
Guido van Rossum
committed
Merge remote-tracking branch 'origin/master' into incremental
Guido van Rossum
committed
Add missing annotations to helpers.py.
Guido van Rossum
committed

Commits on Apr 8, 2016

Fix typo in comment.
Guido van Rossum
committed