Code

[MRG] Adds multiclass ROC AUC#12789

Code

Merged

amueller merged 123 commits intoscikit-learn:masterscikit-learn/scikit-learn:masterfrom

thomasjpfan:multiclass_roc_auc_3thomasjpfan/scikit-learn:multiclass_roc_auc_3Copy head branch name to clipboard

Jul 17, 2019

Commits

Commits on Jan 16, 2018

• Add Hand & Till (OvO) and Provost & Domingos (OvR) implementations

  maskani-moh

  committed
  a666180

  Copy full SHA for a666180

• Add multi-class implementation in roc_auc_score method

  maskani-moh

  committed
  118a700

  Copy full SHA for 118a700

• Add tests for multi-class settings OvO and OvR

  maskani-moh

  committed
  3371b1d

  Copy full SHA for 3371b1d

Commits on Jan 17, 2018

• Fix binary case roc computation

  maskani-moh

  committed
  d74ce16

  Copy full SHA for d74ce16

• Make scores add up to 1.0

  maskani-moh

  committed
  805d804

  Copy full SHA for 805d804

• Fix typo

  maskani-moh

  committed
  2bd693e

  Copy full SHA for 2bd693e

• Differenciate binary case explicitly to avoid error when multilabel-indicator format

  maskani-moh

  committed
  fc54dde

  Copy full SHA for fc54dde

Commits on Jan 19, 2018

• Fix prediciton scores

  maskani-moh

  committed
  133a09a

  Copy full SHA for 133a09a

Commits on Feb 8, 2018

• Merge remote-tracking branch 'upstream/master' into multiclass-roc-auc-new

  maskani-moh

  committed
  bc40110

  Copy full SHA for bc40110

Commits on Mar 26, 2018

• Merge remote-tracking branch 'upstream/master' into multiclass-roc-auc-new

  maskani-moh

  committed
  0d035e3

  Copy full SHA for 0d035e3

• Fix test error by setting param dtype=None

  maskani-moh

  committed
  d08f084

  Copy full SHA for d08f084

• Quick fix

  maskani-moh

  committed
  4c7a656

  Copy full SHA for 4c7a656

• Raise error for partial computation in multiclass

  maskani-moh

  committed
  4723b00

  Copy full SHA for 4723b00

• Fix pep8

  maskani-moh

  committed
  aa6dd49

  Copy full SHA for aa6dd49

Commits on Oct 5, 2018

• Merge branch 'master' into multiclass_roc_auc

  amueller

  committed
  5af924b

  Copy full SHA for 5af924b

• try adding ovo multiclass scores

  amueller

  committed
  5c094cd

  Copy full SHA for 5c094cd

• allow roc_auc and macro_roc_auc for multiclass in test_common

  amueller

  committed
  d0393d7

  Copy full SHA for d0393d7

• add multiclass roc_auc metrics to scores, more common tests

  amueller

  committed
  4a0ded6

  Copy full SHA for 4a0ded6

• ovr is same as multilabel

  amueller

  committed
  d599552

  Copy full SHA for d599552

• remove non-existant import

  amueller

  committed
  2cc343a

  Copy full SHA for 2cc343a

Commits on Dec 13, 2018

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_2

  thomasjpfan

  committed
  74bef0d

  Copy full SHA for 74bef0d

• RFC: Removes unrelated diffs

  thomasjpfan

  committed
  c91a9bd

  Copy full SHA for c91a9bd

• ENH: Optimizes ovo

  thomasjpfan

  committed
  e4d2443

  Copy full SHA for e4d2443

• WIP: Adds tests back

  thomasjpfan

  committed
  0f5a088

  Copy full SHA for 0f5a088

• WIP: ovr supports sample_weigth

  thomasjpfan

  committed
  1de4333

  Copy full SHA for 1de4333

• RFC: Rename with weighted prefix

  thomasjpfan

  committed
  e169e0d

  Copy full SHA for e169e0d

• RFC: Moves permutation test to common

  thomasjpfan

  committed
  95a117c

  Copy full SHA for 95a117c

• RFC: Uses pytest parameters

  thomasjpfan

  committed
  01ba344

  Copy full SHA for 01ba344

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  0517eae

  Copy full SHA for 0517eae

• RFC: Minimizes diffs

  thomasjpfan

  committed
  67f2376

  Copy full SHA for 67f2376

• DOC: Adds narative

  thomasjpfan

  committed
  a4ea7a6

  Copy full SHA for a4ea7a6

• RFC: Lowers line count

  thomasjpfan

  committed
  96f2c2d

  Copy full SHA for 96f2c2d

Commits on Dec 14, 2018

• DOC: Fixes latex errors

  thomasjpfan

  committed
  236504d

  Copy full SHA for 236504d

• DOC: Update plot_roc for multiclass

  thomasjpfan

  committed
  8fbcd35

  Copy full SHA for 8fbcd35

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  e98ee89

  Copy full SHA for e98ee89

• DOC: Adds whats new

  thomasjpfan

  committed
  5a89add

  Copy full SHA for 5a89add

Commits on Dec 15, 2018

• RFC: Clears up test

  thomasjpfan

  committed
  6ea7aa3

  Copy full SHA for 6ea7aa3

Commits on Dec 17, 2018

• RFC: Small

  thomasjpfan

  committed
  c7e1aa8

  Copy full SHA for c7e1aa8

• RFC: Clears up test

  thomasjpfan

  committed
  75a0d7e

  Copy full SHA for 75a0d7e

• RFC: Clears up test

  thomasjpfan

  committed
  e5290f5

  Copy full SHA for e5290f5

• RFC: Simplifies test

  thomasjpfan

  committed
  d68c3f0

  Copy full SHA for d68c3f0

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  a5f1845

  Copy full SHA for a5f1845

Commits on Dec 18, 2018

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  031ed06

  Copy full SHA for 031ed06

Commits on Dec 20, 2018

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  0b38e38

  Copy full SHA for 0b38e38

• TST: Adds ValueError test

  thomasjpfan

  committed
  3fb95d6

  Copy full SHA for 3fb95d6

Commits on Dec 21, 2018

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  b049962

  Copy full SHA for b049962

• DOC: Show plots

  thomasjpfan

  committed
  9f34776

  Copy full SHA for 9f34776

• DOC: Adds names

  thomasjpfan

  committed
  0044f41

  Copy full SHA for 0044f41

Commits on Jan 3, 2019

• ENH: Adds support for strings and labels

  thomasjpfan

  committed
  a93f06b

  Copy full SHA for a93f06b

• RFC: Encodes y_true before passing to auc score

  thomasjpfan

  committed
  07a6f8a

  Copy full SHA for 07a6f8a

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  f80f584

  Copy full SHA for f80f584

• RFC: Adds ovr scorer

  thomasjpfan

  committed
  d006581

  Copy full SHA for d006581

• DOC: Adds roc_auc_score to multiclass docs

  thomasjpfan

  committed
  3a0961e

  Copy full SHA for 3a0961e

Commits on Jan 15, 2019

• RFC: Rename variable

  thomasjpfan

  committed
  6e6d998

  Copy full SHA for 6e6d998

• RFC: Rewords error msg

  thomasjpfan

  committed
  9058b24

  Copy full SHA for 9058b24

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  be75778

  Copy full SHA for be75778

Commits on Jan 19, 2019

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  1699604

  Copy full SHA for 1699604

• RFC: Increases efficiency

  thomasjpfan

  committed
  d26d528

  Copy full SHA for d26d528

• STY: Flake8

  thomasjpfan

  committed
  6978943

  Copy full SHA for 6978943

• RFC

  thomasjpfan

  committed
  acedbaa

  Copy full SHA for acedbaa

Commits on Jan 30, 2019

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  8c038d9

  Copy full SHA for 8c038d9

• ENH: Uses object form of plt

  thomasjpfan

  committed
  f39a067

  Copy full SHA for f39a067

• STY: Flake8

  thomasjpfan

  committed
  765c71b

  Copy full SHA for 765c71b

Commits on Feb 5, 2019

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  f2c0c2b

  Copy full SHA for f2c0c2b

• DOC Address comments

  thomasjpfan

  committed
  139f3af

  Copy full SHA for 139f3af

• RFC: Uses pytest.rases(match=...)

  thomasjpfan

  committed
  99f5498

  Copy full SHA for 99f5498

• RFC Address comments

  thomasjpfan

  committed
  8b4dd6e

  Copy full SHA for 8b4dd6e

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  f3c1f0f

  Copy full SHA for f3c1f0f

• REV Add tests back

  thomasjpfan

  committed
  bd032f9

  Copy full SHA for bd032f9

• RFC Uses better name

  thomasjpfan

  committed
  36fe583

  Copy full SHA for 36fe583

• DOC

  thomasjpfan

  committed
  21203e4

  Copy full SHA for 21203e4

• DOC

  thomasjpfan

  committed
  43bd6bb

  Copy full SHA for 43bd6bb

• RFC Uses average

  thomasjpfan

  committed
  941d810

  Copy full SHA for 941d810

• DOC Adds multiclass macro and weighted curves

  thomasjpfan

  committed
  fa11e2d

  Copy full SHA for fa11e2d

• STY Flake8

  thomasjpfan

  committed
  1ec9b3f

  Copy full SHA for 1ec9b3f

Commits on Feb 6, 2019

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  5da21f0

  Copy full SHA for 5da21f0

• ENH Adds support for integer y_true

  thomasjpfan

  committed
  e40218e

  Copy full SHA for e40218e

Commits on Feb 7, 2019

• Trigger CI

  thomasjpfan

  committed
  5a4eaf5

  Copy full SHA for 5a4eaf5

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  a6f1984

  Copy full SHA for a6f1984

Commits on Feb 18, 2019

• RF Address comments

  thomasjpfan

  committed
  8c00a1f

  Copy full SHA for 8c00a1f

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  9864378

  Copy full SHA for 9864378

• RF Address comments

  thomasjpfan

  committed
  2da0866

  Copy full SHA for 2da0866

• RF Uses _encode_python

  thomasjpfan

  committed
  66b6690

  Copy full SHA for 66b6690

• RF Adds comments

  thomasjpfan

  committed
  870941e

  Copy full SHA for 870941e

• STY flake8

  thomasjpfan

  committed
  9b8a843

  Copy full SHA for 9b8a843

Commits on Feb 19, 2019

• RFC Address comments

  thomasjpfan

  committed
  8c8f1de

  Copy full SHA for 8c8f1de

Commits on Mar 8, 2019

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  5ff4f4c

  Copy full SHA for 5ff4f4c

Commits on Apr 4, 2019

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  49d6ea3

  Copy full SHA for 49d6ea3

• CLN Address comments

  thomasjpfan

  committed
  c7d686d

  Copy full SHA for c7d686d

• CLN Style

  thomasjpfan

  committed
  d96a7d9

  Copy full SHA for d96a7d9

• DOC Adds new example for mutliclass roc

  thomasjpfan

  committed
  40cc0a1

  Copy full SHA for 40cc0a1

• DOC Updates example

  thomasjpfan

  committed
  551c32a

  Copy full SHA for 551c32a

• CLN Uses softmax

  thomasjpfan

  committed
  3536851

  Copy full SHA for 3536851

• BUG Fix

  thomasjpfan

  committed
  e3c9e79

  Copy full SHA for e3c9e79

Commits on Apr 18, 2019

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  994e949

  Copy full SHA for 994e949

• ENH Forces order for labels

  thomasjpfan

  committed
  8628672

  Copy full SHA for 8628672

• CLN Uses the word processing

  thomasjpfan

  committed
  24f7c98

  Copy full SHA for 24f7c98

Commits on May 31, 2019

• CLN Address comments

  thomasjpfan

  committed
  3304b66

  Copy full SHA for 3304b66

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  29908e1

  Copy full SHA for 29908e1

• REV Removes test

  thomasjpfan

  committed
  566f313

  Copy full SHA for 566f313

• DOC Adds reference

  thomasjpfan

  committed
  9acd61b

  Copy full SHA for 9acd61b

• BLD Trigger CI

  thomasjpfan

  committed
  8f7c4ef

  Copy full SHA for 8f7c4ef

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  71c1d78

  Copy full SHA for 71c1d78

• DOC Removes whats_new

  thomasjpfan

  committed
  3fcf96f

  Copy full SHA for 3fcf96f

Commits on Jun 15, 2019

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  ceed5ee

  Copy full SHA for ceed5ee

Commits on Jun 16, 2019

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  38466ff

  Copy full SHA for 38466ff

• DOC Adds more references

  thomasjpfan

  committed
  1095d7f

  Copy full SHA for 1095d7f

• CLN Address comments

  thomasjpfan

  committed
  95e25e9

  Copy full SHA for 95e25e9

• CLN Change order

  thomasjpfan

  committed
  76036a7

  Copy full SHA for 76036a7

• CLN Removes multiclass example

  thomasjpfan

  committed
  146491d

  Copy full SHA for 146491d

Commits on Jun 17, 2019

• TST Pytest-dist ordering

  thomasjpfan

  committed
  f01b435

  Copy full SHA for f01b435

Commits on Jun 24, 2019

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  3b2b436

  Copy full SHA for 3b2b436

• DOC Spacing

  thomasjpfan

  committed
  89de04f

  Copy full SHA for 89de04f

Commits on Jul 2, 2019

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  7999125

  Copy full SHA for 7999125

• ENH Raises when multi_class is not specified

  thomasjpfan

  committed
  11e87bb

  Copy full SHA for 11e87bb

• REV Defaults to ovr

  thomasjpfan

  committed
  df7efe0

  Copy full SHA for df7efe0

• STY Minor

  thomasjpfan

  committed
  0646612

  Copy full SHA for 0646612

• TST roc_auc_score defaults to not support multiclass

  thomasjpfan

  committed
  bfc73c9

  Copy full SHA for bfc73c9

Commits on Jul 3, 2019

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  eaf979b

  Copy full SHA for eaf979b

Commits on Jul 4, 2019

• ENH Adds weighted scorers

  thomasjpfan

  committed
  65fea8e

  Copy full SHA for 65fea8e

Commits on Jul 17, 2019

• Merge remote-tracking branch 'upstream/master' into multiclass_roc_auc_3

  thomasjpfan

  committed
  2085b4d

  Copy full SHA for 2085b4d

• CLN Address comments

  thomasjpfan

  committed
  c5101e2

  Copy full SHA for c5101e2

• CLN Uses partial

  thomasjpfan

  committed
  1399ddd

  Copy full SHA for 1399ddd