Scribd Logo
Upload

Welcome to Scribd!

  • 27 views

    cs236 Livenotes Lecture4 PDF

    Uploaded by

    d anchor
    This document discusses several machine learning topics including perceptron, exponential family, generalized linear models, softmax regression, logistic regression, and multiclass classification. It provides examples of exponential families like Bernoulli and Gaussian distributions. It also describes generalized linear models, their assumptions, design matrices, and learning update rules. Finally, it covers softmax regression for multiclass classification and minimizing cross entropy.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content

    You might also like

    cs236 Livenotes Lecture4 PDF

    Uploaded by

    d anchor
    27 views7 pages
    This document discusses several machine learning topics including perceptron, exponential family, generalized linear models, softmax regression, logistic regression, and multiclass classification. It provides examples of exponential families like Bernoulli and Gaussian distributions. It also describes generalized linear models, their assumptions, design matrices, and learning update rules. Finally, it covers softmax regression for multiclass classification and minimizing cross entropy.

    Original Description:

    Original Title

    cs236-livenotes-lecture4.pdf

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    This document discusses several machine learning topics including perceptron, exponential family, generalized linear models, softmax regression, logistic regression, and multiclass classification. It provides examples of exponential families like Bernoulli and Gaussian distributions. It also describes generalized linear models, their assumptions, design matrices, and learning update rules. Finally, it covers softmax regression for multiclass classification and minimizing cross entropy.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    27 views7 pages

    cs236 Livenotes Lecture4 PDF

    Uploaded by

    d anchor
    This document discusses several machine learning topics including perceptron, exponential family, generalized linear models, softmax regression, logistic regression, and multiclass classification. It provides examples of exponential families like Bernoulli and Gaussian distributions. It also describes generalized linear models, their assumptions, design matrices, and learning update rules. Finally, it covers softmax regression for multiclass classification and minimizing cross entropy.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    of 7

    Topics

    Perceptron
    Exponential Family
    Generalized Linear Models

    Softmax Regression
    Multiclass Classification

    Logistic Regression
    a
    It

    g2 z GG L 230
    O Z CO
    hope 1
    It Ota home g E'a
    0 i O T x
    y how ng
    different

    y how
    0 algo got it rightL
    L if wrong y EEE
    y wrong y 0
    Enzo
    Q
    El
    O

    i
    O O

    O
    want 0 70 but 0Th LO
    O OtLn tLu5 n On th Nu

    Exponential Families
    PDF
    plugin blog
    exp Thy acne

    y data beg exp 2T TG


    n natural parameter
    Tcg sufficient statistic
    in class
    y
    blog Base measure
    acq log partition function

    scalar
    y
    vector scalar
    q
    TG vector scalar I match

    bg scalar

    Example
    Bernoulli Binary Data
    probability of event
    t y
    p g lo 494
    9 exp y tog lo ta g logo a
    exp log 994 0
    exp log 9 t logo 0

    Tks Fat
    bly I
    Tcg g
    n log to Csigmoid
    q
    acq logCto log l teen
    log Iten

    Gaussian w
    fixed variance or L

    ply a
    En exp HII
    e 5k expCpu y Zai

    Tk Tk Tan
    bcg
    fan expC E
    TG y
    q µ
    acne of Iz
    Properties natural params
    ML E wr t
    2 is concave

    negative lag likelihood NLL is convex

    EEg n
    a
    Iqacn
    Varly y
    zigzag
    GLM
    Assumptions Design Clonolces
    c
    yl K O Exponential family
    Real Gaussian
    Binary Bernoulli
    count Poisson
    RT Gamma Exponential
    Dist peta Dirichlet Bayesian Mystats
    Il 0Th O E IRD
    if k E Rd
    cu Test tune output ECy In o

    how IE
    yl x o

    log ply OTH


    hoax
    Fram
    xi I
    p Rest
    ho Ca
    Learning Update Rule
    Oji o t x
    y hoax aj
    plug in appropriate holu
    Terminology
    q natural parameter
    µ EE y R g y canonical response for
    A canonical link f
    n
    2 g
    god znach
    3 paramatrizations
    Modelparameters Natural param CanonicalParam
    Bernoulli
    0 Y Gaussian
    µ ot
    Ent X
    pi g
    Poisson
    Design t
    learning choice g

    Logistic Regression
    holn Elgin o
    9 n teen
    Assumption'Legression

    ammo A Fundo
    Classification

    xx xxxx x x

    FEEI.eefzxxxxaxc
    0.5
    xx
    a
    1
    He 2
    sigmoidLota n of

    o
    Softmax Regression
    Multiclass Classification
    Cross Entropy minimization

    U2 g 00
    O
    O
    00 Lie

    K E IRD
    y E 0,13 one hot vector 0 0,40
    d
    IRD
    Glass C
    f o
    Oz
    class c o o D 3 kg
    i
    n i e oooo
    I
    O l Enno
    OO t.ee
    I
    I h

    l l
    l l

    Goal a

    oin

    normalize
    PG

    t 4

    i mm distance between 2 dumb a


    goal
    man Cross Entropy pp I ply tog pacy
    YC 0,0 03
    log fly
    00Th
    log e
    OE n
    E e
    CEE Qa o y
    Ng
    Fund Oo Oo 8D Gradient Descent

    You might also like