EE 621 Markov systems

crying gigging

1271 consider a machine that can run continuously for

units of time Consider a
strategy of performing

maintainance when machine finishes T units ofoperation

need
of the machine tails before maintainance then it
to be replaced Let Cm and CR denote down time for

maintainance and replacement respectively Machine

becomes new after maintainance Find T that
machine down time when
minimizes avg KanII
20 units
reapell I
renenewal process with
10.21 Let met to
be a

2nF and usual assumptions Let Xe be any

random variable having distribution given by

Fx Cal find I P Yiu a du

Uniform 0,100
a Find ETXe for F fiII
find du t Zment Zmet
b Also
x
first
x x
a
x x

M t and Malt 20 be
two independent
1011 Let e o
renewal processes Prove or disprove M 1 7 592A 9720

is a renewal prosen 15 March

x x x x
 at msn.si IIftntiae lifetime of
nth machine a replacement or after maintainan

Define Yn T Cta if Xn7T

Xnt CR if NET
Note that since is
Xn n iid Yn n is
also iid seq Consider a renewal process
with life timer 948m21

Define reward Rn Crn if not I

CR if Xn ET

By RRT avg mle down time

EE w.p 1
Let us calculate the expectations
E Rn Cm P not CRP NET
Cm e CR i e T

CR CR m e T
Now ETYN PCYn y
dy
Note that
P P Xn 4 P Yny
Ynsy Yay not
e
 consider
P item y not 0 if y team

P not e if ycIfCm
Consider
P ns 9 CR Xn T

P y CR Xn ET
Plo Xn
t
if 9 CRCO year
G e

P y CRCXn e if 9 CR 30 Y CRET
9 s CRC CR
e E e
0 if 9 RST Teer
Thus ETYN
call e t
Hcm
tI
e
from from

t
Rti CR I m e

decreases monotonically as 7 d Take

avg down time decreases with 7

optimal T too
10.27 As shown in the class

Feisal 1 9 Fcu
x
du

EExe Fire da
EX of Coelda dufxklds
T.fm
f F9udI
2 Itinded
x fdseFeeu a
24Find

TUFTE Equina
Also as proved in the assignment
fins Exude
observed
Thus spread by random observer
equals twice the waiting time of random observer

192