Scribd Logo
Upload

Welcome to Scribd!

  • 2-Linear Regression Training and Polynomial Regression

    Uploaded by

    Monis Khan
    3 views25 pages
    The document discusses why the square error cost function is used for regression problems instead of other options like absolute value. It is easier to solve regression problems using square error because the derivative is a linear function of the error and model parameters, allowing the problem to be solved using linear equations. For linear models and square error cost, finding the regression coefficients reduces to solving a linear system, which is relatively easy compared to other cost functions.

    Original Description:

    Original Title

    2-Linear Regression Training and polynomial Regression

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document discusses why the square error cost function is used for regression problems instead of other options like absolute value. It is easier to solve regression problems using square error because the derivative is a linear function of the error and model parameters, allowing the problem to be solved using linear equations. For linear models and square error cost, finding the regression coefficients reduces to solving a linear system, which is relatively easy compared to other cost functions.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    3 views25 pages

    2-Linear Regression Training and Polynomial Regression

    Uploaded by

    Monis Khan
    The document discusses why the square error cost function is used for regression problems instead of other options like absolute value. It is easier to solve regression problems using square error because the derivative is a linear function of the error and model parameters, allowing the problem to be solved using linear equations. For linear models and square error cost, finding the regression coefficients reduces to solving a linear system, which is relatively easy compared to other cost functions.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    of 25

    why we so squaring not absolute value? -->> it is easier to solve than other cost-functions.

    In order to find the solution to a regression problem, one needs to minimize the cost-function. An efficient way to do it is by
    differentiating the cost-function and comparing the derivative to zero.

    When the cost-function is the square error, the derivative is a linear function of the error, and if the model is linear in its
    parameters, a linear function of the parameters. So, finding the regression coefficients, when using square error (and the model
    is linear) becomes solving a linear set of equations. And that is relatively easy to do.

    why normal distribution? --->> because prediction of model does not deviate large
    means least error and because most of the data are in center means SD is less

    You might also like