@@ -97,6 +97,24 @@ R² gives the same ranking as squared loss.
97
97
Furthermore, the Brier score is just a different name for the squared error
98
98
in case of classification.
99
99
100
+ **Ficticious Example: **
101
+ Let's make the above arguments more tangible. Consider a setting of reliability
102
+ engineering of network connections, e.g. internet or wifi. As provider of the network,
103
+ you have access to the dataset of log entries of network connection containing network
104
+ load over time and many interesting features. Your goal is to improve the raliability
105
+ of the connections. In fact, you promise your customors that at least on 99% of all
106
+ days there are no connection discontinuities larger 1 minute.
107
+ Therefore, you are interested in a prediction of the 99% quantile (of connections per
108
+ day free of interruptions larger than 1 minute) in order to know in advance when to add
109
+ more bandwidth and thereby satisfy your customers. So the *target functional * is the
110
+ 99% quantile. From the table above, you choose the pinball loss as scoring function
111
+ (fair enough, not much choice given), for model training (e.g.
112
+ `HistGradientBoostingRegressor(loss="quantile", quantile=0.99) ` as well as model
113
+ evaluation (`mean_pinball_loss(..., alpha=0.9) ` - we apoligize for the different
114
+ argument names, `quantile ` and `alpha `) be it in grid search for finding
115
+ hyperparameters or in comparing to other models like
116
+ `QuantileRegressor(quantile=0.99) `.
117
+
100
118
.. topic :: References:
101
119
102
120
.. [Gneiting2007 ] T. Gneiting and A. E. Raftery. :doi: `Strictly Proper
0 commit comments