-
-
Notifications
You must be signed in to change notification settings - Fork 1.8k
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
I think that the ignore_index option in the metrics calculation isn't working right.
Suppose I have 4 indexes - 0,1,2,3 and I wan't to ignore index 0 at metric calculation, then true positive output of smp.metrics.get_stats function with ignore_index=0 gives me [0, tp_for_index_1, tp_for_index_2, tp_for_index_3], so than futher calculation of dice score with "macro" averaging will account for that zero:
dice = (0 + dice_for_index_1 + dice_for_index_2 + dice_for_index_3)/4 - that isn't right assesment of dice, since I want to ignore the contribution of index=0
The right way to calculate "macro" dice will be
dice = (dice_for_index_1 + dice_for_index_2 + dice_for_index_3)/3
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working