http://scikit-learn.org/dev/modules/generated/sklearn.model_selection.permutation_test_score.html#sklearn.model_selection.permutation_test_score

And the documentation is so sparse that it's impossible to tell what it does without looking at the paper :-/

It also has no whats_new entry but seems to have been present in 0.9?