-
-
Notifications
You must be signed in to change notification settings - Fork 25.8k
[MRG] Workaround limitation of cloudpickle under PyPy #12566
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[MRG] Workaround limitation of cloudpickle under PyPy #12566
Conversation
looks ok. Where's the failure in the tests? |
"""Helper for the Parallel calls in KNeighborsMixin.kneighbors | ||
|
||
The Cython method tree.query is not directly picklable by cloudpickle | ||
under PyPy. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Interesting that this works while pickling directly fails. I don't really have a good understanding of cloudpickle (or pickling in general) to have much to say about this. LGTM since it fixes the original failure.
Not sure if this deserves a what's new. I'm going with no. |
…ybutton * upstream/master: Fix max_depth overshoot in BFS expansion of trees (scikit-learn#12344) TST don't test utils.fixes docstrings (scikit-learn#12576) DOC Fix typo (scikit-learn#12563) FIX Workaround limitation of cloudpickle under PyPy (scikit-learn#12566) MNT bare asserts (scikit-learn#12571) FIX incorrect error when OneHotEncoder.transform called prior to fit (scikit-learn#12443)
…ikit-learn into add_codeblock_copybutton * 'add_codeblock_copybutton' of https://github.com/thoo/scikit-learn: Move an extension under sphinx_copybutton/ Move css/js file under sphinxext/ Fix max_depth overshoot in BFS expansion of trees (scikit-learn#12344) TST don't test utils.fixes docstrings (scikit-learn#12576) DOC Fix typo (scikit-learn#12563) FIX Workaround limitation of cloudpickle under PyPy (scikit-learn#12566) MNT bare asserts (scikit-learn#12571) FIX incorrect error when OneHotEncoder.transform called prior to fit (scikit-learn#12443) Retrigger travis:max time limit error DOC: Clarify `cv` parameter description in `GridSearchCV` (scikit-learn#12495) FIX remove FutureWarning in _object_dtype_isnan and add test (scikit-learn#12567) DOC Add 's' to "correspond" in docs for Hamming Loss. (scikit-learn#12565) EXA Fix comment in plot-iris-logistic example (scikit-learn#12564) FIX stop words validation in text vectorizers with custom preprocessors / tokenizers (scikit-learn#12393) DOC Add skorch to related projects (scikit-learn#12561) MNT Don't change self.n_values in OneHotEncoder.fit (scikit-learn#12286) MNT Remove unused assert_true imports (scikit-learn#12560) TST autoreplace assert_true(...==...) with plain assert (scikit-learn#12547) DOC: add a testimonial from JP Morgan (scikit-learn#12555)
…earn#12566)" This reverts commit 4b97841.
…earn#12566)" This reverts commit 4b97841.
This is a fix for #12554.
I have tried to have a look as at the dissembled pickle payload of the example in #12554 (comment) to try to understand what is the cause of the problem and how it differs from the case where we we use pickle with PyPy or cloudpickle with CPython (which both work) but I don't know where to start. But I am lost in PyPy internals
So instead here is a simple workaround.