• Example

– Consider a simple three-state Markov model of the weather

– Any given day, the weather can be described as being
• State 1: precipitation (rain or snow)
• State 2: cloudy
• State 3: sunny
– Transitions between states are described by the transition matrix
0.4 0.3 0.3 0 .4 0 .6

𝐴 = 𝑎𝑖𝑗 = 0.2 0.6 0.2

0.1 0.1 0.8 0 .3

0 .2
S1
S2
0 .3 0 .1

0 .1 0 .2

S3

0 .8

Introduction to Speech Processing | Ricardo Gutierrez-Osuna | CSE@TAMU 4

 – Question
• Given that the weather on day t=1 is sunny, what is the probability that
the weather for the next 7 days will be “sun, sun, rain, rain, sun, clouds,
sun” ?
• Answer:

𝑃 𝑆3 , 𝑆3 , 𝑆3 , 𝑆1 , 𝑆1 , 𝑆3 , 𝑆2 , 𝑆3 |𝑚𝑜𝑑𝑒𝑙
= 𝑃 𝑆3 𝑃 𝑆3 |𝑆3 𝑃 𝑆3 |𝑆3 𝑃 𝑆1 |𝑆3 𝑃 𝑆1 |𝑆1 𝑃 𝑆3 |𝑆1 𝑃 𝑆2 |𝑆3 𝑃 𝑆3 |𝑆2
= 𝜋3 𝑎33 𝑎33 𝑎13 𝑎11 𝑎31 𝑎23 𝑎32
= 1 × 0.8 × 0.8 × 0.1 × 0.4 × 0.3 × 0.1 × 0.2

– Question
• What is the probability that the weather stays in the same known state Si
for exactly T consecutive days?
• Answer:

𝑃 𝑞𝑡 = 𝑆𝑖 , 𝑞𝑡+1 = 𝑆𝑖 … 𝑞𝑡+𝑇 = 𝑆𝑗≠𝑖 = 𝑎𝑖𝑖𝑇−1 1 − 𝑎𝑖𝑖

Introduction to Speech Processing | Ricardo Gutierrez-Osuna | CSE@TAMU 5