Related to @ogrisel comment.

An input check has been added in _binary_tree.pxi

Some other were already there

The context manager should be used to wrap the calls to BallTree from other classes in scikit-learn that have already validated there input data to avoid duplicating this check (see #18727 for a similar procedure).