Belief propagation Algorithm

Shuang Wang
 Basic Probability Knowledge

 Conditional probability
 Joint probability

 Bayes' theorem:
 Marginal probability:
(if thre are two possible outcomes, )
 Conditionally independent: P(AB|C) = P(A|C)P(B|C)
 Graphical model
 A graphical model is a probabilistic model, where a graph
denotes the conditional independence structure between
random variables.

 Conditial independet:
 is observation, are unknown that we need to figure out
 Joint probability


 Simple Factor graph


 Factor Graph
 A factor graph is a particular type of graphical model with
applications in Bayesian inference, where they enable efficient
computation of marginal distributions, through the sum-
product algorithm.