Scribd Logo
Upload

Welcome to Scribd!

  • Lecture 4 - 2 - Supervised Learning - Multiple Linear Regression

    Uploaded by

    Tenzin Sonam
    11 views13 pages
    This document discusses multiple linear regression, which is an extension of simple linear regression to model relationships between multiple features and a target variable. Multiple linear regression models the target as a linear combination of the features, represented as a dot product between a weight vector W and a feature vector X plus a bias term b. Vectorization allows representing the model compactly as the dot product of W and X plus b, rather than summing the individual feature weight multiplications. The normal equation can be used to learn the optimal W and b parameters from training data.

    Original Description:

    Original Title

    Lecture 4_2 - Supervised Learning - Multiple Linear Regression (1)

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    This document discusses multiple linear regression, which is an extension of simple linear regression to model relationships between multiple features and a target variable. Multiple linear regression models the target as a linear combination of the features, represented as a dot product between a weight vector W and a feature vector X plus a bias term b. Vectorization allows representing the model compactly as the dot product of W and X plus b, rather than summing the individual feature weight multiplications. The normal equation can be used to learn the optimal W and b parameters from training data.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    11 views13 pages

    Lecture 4 - 2 - Supervised Learning - Multiple Linear Regression

    Uploaded by

    Tenzin Sonam
    This document discusses multiple linear regression, which is an extension of simple linear regression to model relationships between multiple features and a target variable. Multiple linear regression models the target as a linear combination of the features, represented as a dot product between a weight vector W and a feature vector X plus a bias term b. Vectorization allows representing the model compactly as the dot product of W and X plus b, rather than summing the individual feature weight multiplications. The normal equation can be used to learn the optimal W and b parameters from training data.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    of 13

    1

    Supervised Learning
    TOPIC 4:
    Understand Regression and Classification

    Prepared by Nima Dema


    CSA203:Artificial Intelligence and Machine Learning
    2
    Regression
    Multiple Linear Regression

    3
    Multiple Linear Regression

    Previously- Simple Linear Regression

    Single
    Target
    Feature

    4
    Multiple Linear Regression
    j = 1…4
    n=4

    X3(2) = 2

    i th
    X = features of i training example
    Xj = jth feature

    n= number of features Xj(i) = value of feature j in ith training


    example
    5
    Multiple Linear Regression
    Model
    Previously:

    fw,b(x)= w1x1+w2x2+w3x3+w4x4+b

    Example:
    fw,b(x)= 0.1 x1 + 4x2 + 10x3 + -2x4 + 80
    size # bedrooms # floors years
    6
    Multiple Linear Regression

    fw,b(x)= w1x1+w2x2+w3x3+w4x4+b
    W= [w1,w2,w3,…wn] Parameters of the model
    b is a number
    Vector

    dot product Multiple Linear Regression


    7
    Regression
    Vectorization

    8
    Multiple Linear Regression
    Without Vectorization
    Parameters and features
    W= [w1 w2 w3] where n = 3
    W= [w1 w2 w3] where n = 3
    b is a number
    b is a number

    f = w[0] * x[0] +
    w[1] * x[1] +
    w[2] * x[2] + b

    9
    Multiple Linear Regression
    Without Vectorization With Vectorization

    f = 0 f = np.dot(w,x) + b
    for j in range(0,n)
    f = f + w[j] * x[j]
    f = f + b

    10
    Multiple Linear Regression
    Without Vectorization With Vectorization

    11
    Normal Equation to learn parameters

    12
    THANK YOU ☺

    13

    You might also like