It seems that since caching was enabled in Travis, in between commits if a python file is completely removed, it can still try to import from that. For instance in https://github.com/scikit-learn/scikit-learn/pull/5372/ `mutual_info.py` is renamed to `mutual_info_.py` but still it tries to import from the compiled `mutual_info.pyc` files