MATHEMATICAL FOUNDATION

1. Optimization
2. Linear Algebra
3. Matrix Operation

1. Optimization – (i)Rate of change (ii) Step to determine minima or

maxima
Rate of change – If we change X axis value then what is the amount of change in Y axis value
It’s also called as (a) Derivative (b) Gradient (c) Slope

Derivative – Derivative of a single value (constant) is undefined (can be assumed zero)

Derivative Rules – 1) Power Rule 2) Constant Multiple Rule 3) Sum Rule 4) Difference Rule 5)
Product rule 6) Quotient Rule

Step to determine Minima or Maxima – Procedure for optimizing a single argument function
(a) Given y-f(x), find 1st derivative
(b) Set 1st derivative of f(x) to zero to identify the critical value
(c) Find the second derivative of f(x)
1) If the second derivative value > 0 then critical value is Minima
2) If the second derivative value < 0 then critical value is Maxima

Derivatives in optimization - Relative Max Min

What do we observe from these two graphs?

(i) the peaks and troughs occur near the slope of
the function is zero (i.e., where critical points
occur)

(ii) the slopes are positive and negative to the

left and right of the critical points
By using derivatives, we can solve for critical values and determine if these critical values are maxima or minima.

First derivative test - substitute a value which is less and more than the critical value (-1,1).

What is the function doing around the critical value?

* When derivative changes from positive to negative it is maxima.

*When derivative changes from negative to positive it is minima.

Second derivative test - another test to determine whether critical values are maximum (s) / minimum (s)

(i) maximum: second derivative is negative or concave down.

(ii) minimum: second derivative is positive or concave up.

Procedure for optimising a single argument function.

1. Given y = f(x), find f'(x)

2. Set f'(x) = 0 and solve for critical value(s).

3. Either use the first derivative test or second derivative test to verify whether the critical value is Max or relative min
or neither.

E.g., y = g(x) = x^2 – 3x +2

g’(x) = 2x – 3 = 0 2x = 3 x = 3/2

Using the second derivative test -

g’’(x) = 2 > 0
therefore, x = 3/2 is a minima

2. Linear Algebra
3. Matrix Operations
Eigenvectors & Eigenvalues