We should add a get_feature_names to the new CategoricalEncoder, as discussed here. I think it would be good to be consistent with the PolynomialFeature which allows passing in original feature names to map them to new feature names. Also see #6425.