Multiclass and multilabel metrics should be invariant to labeling the columns.
That should be tested in metrics/test_common.py.
I haven't checked if there's a test for standard multiclass, but there's none for thresholded metrics.