Skip to content

HistGradientBoosting* interaction constraints  #19148

Closed
@lorentzenchr

Description

@lorentzenchr

Describe the workflow you want to enable

I'd like to use HistGradientBoostingClassifier and HistGradientBoostingRegressor with the possibility to set interaction constraints for certain features. As said in microsoft/LightGBM#2884 (comment), it is one way to make those black boxes more intuitive and interpretable. In addition, it makes it much more easy to marginalize over those features.

Additional context

LightGBM has interaction_constraints, see their docs. XGBoost has them, see their docs.
Have also a look at the XGBoost tutorial on interaction constraints for a nice visualization and for potential benefits:

  • Better predictive performance from focusing on interactions that work – whether through domain specific knowledge or algorithms that rank interactions
  • Less noise in predictions; better generalization
  • More control to the user on what the model can fit. For example, the user may want to exclude some interactions even if they perform well due to regulatory constraints

Metadata

Metadata

Assignees

Labels

ModerateAnything that requires some knowledge of conventions and best practicesNew Featuremodule:ensemble

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions