Scribd Logo
Upload

Welcome to Scribd!

  • 38 views

    Welcome To The Course!: Michael (Mike) Gelbart

    Uploaded by

    NourheneMbarek
    This document introduces a course on linear classifiers in Python. It discusses assumed knowledge including Python, scikit-learn, and supervised learning. It demonstrates fitting and predicting with a k-nearest neighbors classifier on the 20 newsgroups dataset. It also covers model evaluation, logistic regression and support vector machines (SVM). Finally, it defines key concepts like classification, decision boundaries, linear classifiers, and linearly separable data, giving examples of linear decision boundaries.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd

    Welcome To The Course!: Michael (Mike) Gelbart

    Uploaded by

    NourheneMbarek
    38 views17 pages
    This document introduces a course on linear classifiers in Python. It discusses assumed knowledge including Python, scikit-learn, and supervised learning. It demonstrates fitting and predicting with a k-nearest neighbors classifier on the 20 newsgroups dataset. It also covers model evaluation, logistic regression and support vector machines (SVM). Finally, it defines key concepts like classification, decision boundaries, linear classifiers, and linearly separable data, giving examples of linear decision boundaries.

    Original Title

    chapter1

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    This document introduces a course on linear classifiers in Python. It discusses assumed knowledge including Python, scikit-learn, and supervised learning. It demonstrates fitting and predicting with a k-nearest neighbors classifier on the 20 newsgroups dataset. It also covers model evaluation, logistic regression and support vector machines (SVM). Finally, it defines key concepts like classification, decision boundaries, linear classifiers, and linearly separable data, giving examples of linear decision boundaries.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    38 views17 pages

    Welcome To The Course!: Michael (Mike) Gelbart

    Uploaded by

    NourheneMbarek
    This document introduces a course on linear classifiers in Python. It discusses assumed knowledge including Python, scikit-learn, and supervised learning. It demonstrates fitting and predicting with a k-nearest neighbors classifier on the 20 newsgroups dataset. It also covers model evaluation, logistic regression and support vector machines (SVM). Finally, it defines key concepts like classification, decision boundaries, linear classifiers, and linearly separable data, giving examples of linear decision boundaries.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Download as pdf or txt
    You are on page 1of 17

    Welcome to the

    course!
    LIN EAR CLAS S IF IERS IN P YTH ON

    Michael (Mike) Gelbart


    Instructor, The University of British
    Columbia
    Assumed knowledge
    In this course we'll assume you have some prior exposure to:

    Python, at the level of Intermediate Python for Data Science

    scikit-learn, at the level of Supervised Learning with scikit-learn

    supervised learning, at the level of Supervised Learning with


    scikit-learn

    LINEAR CLASSIFIERS IN PYTHON


    Fitting and predicting
    import sklearn.datasets

    newsgroups = sklearn.datasets.fetch_20newsgroups_vectorized()

    X, y = newsgroups.data, newsgroups.target

    X.shape

    (11314, 130107)

    y.shape

    (11314,)

    LINEAR CLASSIFIERS IN PYTHON


    Fitting and predicting (cont.)
    from sklearn.neighbors import KNeighborsClassifier

    knn = KNeighborsClassifier(n_neighbors=1)

    knn.fit(X,y)

    y_pred = knn.predict(X)

    LINEAR CLASSIFIERS IN PYTHON


    Model evaluation
    knn.score(X,y)

    0.99991

    from sklearn.model_selection import train_test_split

    X_train, X_test, y_train, y_test = train_test_split(X, y)

    knn.fit(X_train, y_train)

    knn.score(X_test, y_test)

    0.66242

    LINEAR CLASSIFIERS IN PYTHON


    Let's practice!
    LIN EAR CLAS S IF IERS IN P YTH ON
    Applying logistic
    regression and SVM
    LIN EAR CLAS S IF IERS IN P YTH ON

    Michael (Mike) Gelbart


    Instructor, The University of British
    Columbia
    Using LogisticRegression
    from sklearn.linear_model import LogisticRegression

    lr = LogisticRegression()
    lr.fit(X_train, y_train)
    lr.predict(X_test)
    lr.score(X_test, y_test)

    LINEAR CLASSIFIERS IN PYTHON


    LogisticRegression example
    import sklearn.datasets
    wine = sklearn.datasets.load_wine()

    from sklearn.linear_model import LogisticRegression


    lr = LogisticRegression()
    lr.fit(wine.data, wine.target)

    lr.score(wine.data, wine.target)

    0.972

    lr.predict_proba(wine.data[:1])

    array([[ 9.951e-01, 4.357e-03, 5.339e-04]])

    LINEAR CLASSIFIERS IN PYTHON


    Using LinearSVC
    LinearSVC works the same way:

    import sklearn.datasets

    wine = sklearn.datasets.load_wine()

    from sklearn.svm import LinearSVC

    svm = LinearSVC()

    svm.fit(wine.data, wine.target)
    svm.score(wine.data, wine.target)

    0.893

    LINEAR CLASSIFIERS IN PYTHON


    Using SVC
    import sklearn.datasets
    wine = sklearn.datasets.load_wine()

    from sklearn.svm import SVC


    svm = SVC() # default hyperparameters
    svm.fit(wine.data, wine.target);

    svm.score(wine.data, wine.target)

    1.

    Model complexity review:

    Under tting: model is too simple, low training accuracy

    Over tting: model is too complex, low test accuracy

    LINEAR CLASSIFIERS IN PYTHON


    Let's practice!
    LIN EAR CLAS S IF IERS IN P YTH ON
    Linear decision
    boundaries
    LIN EAR CLAS S IF IERS IN P YTH ON

    Michael (Mike) Gelbart


    Instructor, The University of British
    Columbia
    Linear decision boundaries

    LINEAR CLASSIFIERS IN PYTHON


    De nitions
    Vocabulary:

    classi cation: learning to predict categories

    decision boundary: the surface separating different predicted


    classes

    linear classi er: a classi er that learns linear decision


    boundaries
    e.g., logistic regression, linear SVM

    linearly separable: a data set can be perfectly explained by a


    linear classi er

    LINEAR CLASSIFIERS IN PYTHON


    Linearly separable data

    LINEAR CLASSIFIERS IN PYTHON


    Let's practice!
    LIN EAR CLAS S IF IERS IN P YTH ON

    You might also like