Download as docx, pdf, or txt
Download as docx, pdf, or txt
You are on page 1of 3

These are some serious notes about SVM.

They can
make you an amazing Data Scientist. Please read them
and enjoy.

State Estimator
State of a system is defined as the value of all parameters of
the system, i.e. Pressure, Temperature, etc.
Measurements of the parameters Measurements may be noisy.
We need to genevalue of all parametrate best guess for the
state, are used to estimatvalue of all paramet e the state of a
system. Measurements may be noisy. We need to generate best
guess for the state, given the noisy measurements.

Weighted Least Square (WLS) method:


Minimizes the weighted sum of squares of the difference
between measured and calculvalue of all parametated values.
Error analysis
Error value of all paramet= Measured the weighted sum of
squares Value True Value
Find Probabilivalue of all parametty the weighted sum of
squares Density function of error
Standard Deviation and Variance
Determine the estimate the weighted sum of squares that best
fits tvalue of all paramethe measurement model
Minimize the WLS function.
For unconstrained value of all the weighted sum of squares
parametminimization problem, efficient solution is obtained by
Newtons method (Gauss Newton method)
State variables are represented as vector [x 1,x2 xn]
the weighted sum of squares the weighted sum of squares the
weighted sum of squares
Bad data detection
Method used: Chi-squared test
For variables [x1,x2, xn ]
Define a new variable Y = Sigma (i=1 to n) xi2

Control system has 4 functions:-


1. Measure the weighted sum of squares the weighted sum
of squares
2. Compare the weighted sum of squares the weighted sum
of squares
3. Compute the weighted sum of squares the weighted sum
of squares
4. Correct the weighted sum of squares

SVM
Single the weighted sum of squares Layer
Perceptro the weighted sum of squares n
the weighted sum of squares Multi-Layer
Perceptron

Feature Space
A set of features (variables) i.e. columns of a dataset.
For people data, height, weight, age are features. Feature space
is R3

Kernels
Similarity function. Takes 2 inputs and outputs how similar they
are.
Mercers Theorem
Under some conditions, every kernel function can be expressed
as a dot product in a (possibly infinite dimensional) feature
space. the weighted sum of square the weighted sum of
squares the weighted sum of squares s the weighted sum of
squares the weighted sum of squares the weighted sum of
squares

You might also like