Classification

●
Classification is a process of finding a function which helps in dividing the dataset into classes
based on different parameters. In Classification, a computer program is trained on the training
dataset and based on that training, it categorizes the data into different classes.

●
The task of the classification algorithm is to find the mapping function to map the input(x) to the
discrete output(y).
 Regression

Regression is a process of finding the correlations between dependent and

independent variables. It helps in predicting the continuous variables such as
prediction of Market Trends, prediction of House prices, etc.

The task of the Regression algorithm is to find the mapping function to map the
input variable(x) to the continuous output variable(y).
 Regression
Predicts continuous values, such as prices or weights.
It uses squared error loss or means absolute error loss.
The goal is to minimize the difference between the
predicted and actual values.
The model output is a continuous function.
Examples include predicting housing prices, stock
prices, etc.
Regression algorithms include linear regression,
polynomial regression, etc.
Evaluation metrics include R-squared, mean squared
error, mean absolute error, etc.
A line or curve represents the relationship between the
independent and dependent variables.
Multiple input variables can be used to predict a single
output.
Classification
Predicts discrete values, such as labels or categories.
Uses cross-entropy loss or multiclass log loss.
The goal is to classify each data point into its respective
class accurately.
The model output is a probability distribution over classes.
Examples include image classification, spam detection, etc.
Classification algorithms include logistic regression,
decision trees, random forests, etc.
Evaluation metrics include accuracy, precision, recall, F1-
score, etc.
Decision boundaries the relationship between the
independent and dependent variables.
Multiple input variables can be used to predict a single class
label.
 Types of Regression Algorithm
●
Simple Linear Regression
●
Multiple Linear Regression
●
Polynomial Regression
●
Support Vector Regression
●
Decision Tree Regression
●
Random Forest Regression
 Linear Regression
●
Linear regression is a statistical regression method which is used for
predictive analysis.
●
It is one of the very simple and easy algorithms which works on regression
and shows the relationship between the continuous variables.
●
It is used for solving the regression problem in machine learning.
●
Linear regression shows the linear relationship between the independent
variable (X-axis) and the dependent variable (Y-axis), hence called linear
regression.
●
If there is only one input variable (x), then such linear regression is called
simple linear regression. And if there is more than one input variable, then
such linear regression is called multiple linear regression.
The relationship between variables in
the linear regression model can be
explained using the below image. Here
we are predicting the salary of an
employee on the basis of the year of
experience.
➢
Mathematical equation for Linear regression
Y= aX+b
Here, Y = dependent variables (target variables),

X= Independent variables (predictor variables),

a and b are the linear coefficients