Download as docx, pdf, or txt
Download as docx, pdf, or txt
You are on page 1of 2

As part of your discussion assignment, IN YOUR OWN WORDS, describe what

Hidden Markov Models are and how they are used to reason under uncertainty.
Your response should discussion the role of probability distributions and smoothing.
According to Wikipedia, Hidden Markov model (HMM) is a statistical Markov model
in which the system being modeled is assumed to be a Markov process with
unobserved (hidden) states. An HMM can be presented as the simplest dynamic
Bayesian network. (Wikipedia, 2014). Hidden Markov Models are a ubiquitous tool
for modelling time series data or to model sequence behavior. They are used in
almost all current speech recognition systems. The state of the process in HMMs
model is described by a Single Discrete Random Variable. Possible States of the
World is the possible values of the variable in HMMs. While staying within the HMM
network, the additional state variables can be added to a temporal model. To solve
temporal probabilistic reasoning, HMM is used, independent of transition and
sensor model.
A Hidden Markov Model (HMM) is a belief network according to (Poole &
Mackworth, 2010): Consider the figure below:

Where
P(S0) specifies initial conditions
P(St+1|St) specifies the dynamics
P(Ot|St) specifies the sensor model
Now,
Suppose a robot wants to determine its location based on its actions and its
sensor readings. Called Localization
This can be represented by the augmented HMM as shown below:

Applications

Hidden Markov models have many applications area in temporal pattern


recognition such as speech, handwriting, gesture recognition, part-of-speech tagging,
musical score following, partial discharges and bioinformatics.
Role of probability distributions and smoothing
The role of smoothing is to determine a state based on past and future observations
from the probability distributions.
Reference
Poole, D. L., & Mackworth, A. K. (2010). Artificial Intelligence: foundations of
computational agents. Cambridge: Cambridge University Press.
Wikipedia. (2014, October 14). Artificial intelligence. Retrieved from Wikipedia:
http://en.wikipedia.org/wiki/Artificial_intelligence
Wikipedia. (2014, September 28). Hidden Markov model. Retrieved from Wikipedia:
http://en.wikipedia.org/wiki/Hidden_Markov_model

You might also like