Professional Documents
Culture Documents
Averaging Techniques PDF
Averaging Techniques PDF
Decision Analysis
Raghu Nandan Sengupta
Industrial & Management Department
Indian Institute of Technology Kanpur
Regression and
Forecasting
Topics to be covered
Linear regression, Multiple linear
regression, Curve fitting, Variability in
data due to time
dependence/independence, etc.,
Concept of forecasting, etc.
IME634:MDA R.N.Sengupta, IME Dept., IIT Kanpur 3
Regression and Forecasting
1) Forecasting
2) Prediction
3) Different types of Regression
4) Curve Fitting
Yi X i i
Assumptions
E i X i E X 0 i=1,2,…..,n
E[ i ] 0 i=1,2,…..,n
ij, i,j=1,2,…..,n
E[ i j ] 0
i=1,2,…..,n
V [ i ] 2i
X ~ N X , X2
Results
1) E Y E X i=1,2,…..,n
2) Y2 2 X2 2(i ) i=1,2,…..,n
Finally:
E (Y ) ˆ ˆE ( X )
cov(X , Y ) E ( X ) E (Y ) ˆE ( X ) ˆ{V ( X ) E ( X ) 2 }
Hence the errors are: +1, -1, +2, -1, -1 which adds up to 0 as the
case should be
0.8
0.6
Y, Y-hat, error
0.4
0.2
0.0
-6.69 -6.39 -6.07 -6.68 -6.38 -6.07 -5.75 -5.13 -4.81 -4.10 -3.66 -3.26
-0.2
X
Y Y-hat error
j = 1, 2,….., n
2
Y 1
2 2
X (1) 2
2
2
X ( 2) ..... 2
K
2
X (K ) 2
(i )
i, j i j X2 (i ) X2 ( j ) .......
Note:
Error term: Et = Yt - Ft
Forecast value: Ft
Actual value: Yt
Weight: (0,1)
is such that sum of square of errors is minimized
350
300
250
Values
200
150
100
50
0
Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
Month
Qty([Y(t)] F(t,0.1) F(t,0.5) F(t,0.9)
Note:
Error term: Et = Yt – Ft
Forecast value: Ft
Actual value: Yt
Smoothed Error: At = Et + (1 - )At-1
Absolute Smoothed Error: Mt = |Et| + (1 - )Mt-1
Weight: t+1 = |At/Mt|
and are such that sum of square of errors is
minimized
IME634:MDA R.N.Sengupta, IME Dept., IIT Kanpur 27
Adaptive Exponential Smoothing
Starting values:
F2 = Y1
2 = = 0.2
A1 = M 1 = 0
300
250
Values
200
150
100
50
0
Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
300.00
250.00
200.00
Values
150.00
100.00
50.00
0.00
Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec
-50.00
-100.00
Time
A(t) M(t) E(t) F(t) Y(t)
Note:
Error term: Et = Yt – Ft
Forecast value: Ft
Actual value: Yt
Weights: i (0,1) i = 1, 2 and 3
1 + 2 + 3 = 1
is are such that sum of square of errors is minimized
IME634:MDA R.N.Sengupta, IME Dept., IIT Kanpur 32
Extension of Exponential Smoothing
Extension of Exponential Smoothing
450
400
350
300
250
Values
200
150
100
50
0
Jan Jul Jan Jul Jan Jul Jan Jul Jan Jul Jan Jul Jan Jul Jan Jul
Y(t) F(t) Month
Note:
Error: Yt - Ft
Forecast value: Ft
Actual value: Yt
Smoothing value: Lt
Weight: (0,1)
Smoothing constant: (0, 1)
Trend/Estimate of the slope of the time series: bt
Number of periods ahead to be forecasted: m
and are such that sum of square of errors is minimized
Starting values:
L1 = Y1
b1 = Y2 - Y1
= 0.501
= 0.072
m=1
250
200
Values
150
100
50
0
b
b
ar
ar
l
n
n
v
c
v
c
p
p
ay
ay
ct
ct
r
r
Ju
Ju
g
g
Fe
Ap
Fe
Ap
No
De
No
De
Ja
Ju
Ja
Ju
Se
Se
Au
Au
M
M
O
O
M
M
Y(t) F(t) Month
Note:
Forecast value: Ft
Actual value: Yt
Trend: bt
Seasonal component: St
Length of seasonality: s
, and are chosen such that sum of square of errors is minimized
Starting values:
L1 = Y1
b1 = Y2 - Y1
= 0.822
= 0.055
=0
m=1
450
400
350
300
250
Data
200
150
100
50
0
-2.5 -1.6 -1.2 -1.0 -0.8 -0.6 -0.5 -0.3 -0.2 -0.1 0.1 0.2 0.3 0.5 0.6 0.8 1.0 1.2 1.6 3.0
Normal Score