Professional Documents
Culture Documents
Probabilistic Neural Network (PNN)
Probabilistic Neural Network (PNN)
x1 ,1
x1 ,n1−1
+
x
x1 ,n1
ArgMAX
x2 ,1
x x2 ,n2−1
+
x2 ,n2
2
Lecture 3
3
Lecture 3
0.4
0.35
0.3
0.25
y (x)
2
y (x)
0.2 1
0.15
0.1
0.05
0
−15 −10 −5 0 5 10 15
y1(x) = y2(x).
So
$ " # " #
1 (6 − x)2 (6.5 − x)2
√ exp − + exp −
3 2π 2 2
" #%
(7 − x)2
+ exp −
2
$ " " ##
1 (2 − x)2 (2.5 − x)2
= √ exp − + exp −
5 2π 2 2
" # " #
(3 − x)2 (1 − x)2
+ exp − + exp −
2 2
" #%
(6 − x)2
+ exp −
2
The solution of x can be found numerically.
e.g. a grid search. This is an optimal solution,
minimizing misclassification rate.
5
Lecture 3
6
Lecture 3
j = 1, ..., M
where nj denotes the number of data points
in class j. The PNN assigns x into class k
if yk (x) > yj (x), j ∈ [1, ..., M ]. ∥xj,i − x∥2 is
calculated as the sum of squares. e.g. if xj,i =
[2, 4]T , x = [3, 1]T , then
∥xj,i − x∥2 = (2 − 3)2 + (4 − 1)2 = 10
7
Lecture 3
x1,1 1 0
x2,1 -1 0
x1,2 0 1
x2,2 0 -1
x1,3 1 1
class 1 class 2
Solution:
" #
1 (1 − 0.5)2 + (0 − 0.5)2
y1(x) = {exp −
3 2
" #
(0 − 0.5)2 + (1 − 0.5)2
+ exp −
2
" #
(1 − 0.5)2 + (1 − 0.5)2
+ exp − }
2
= 0.7788
8
Lecture 3
" #
1 (−1 − 0.5)2 + (0 − 0.5)2
y2(x) = {exp −
2 2
" #
(0 − 0.5)2 + (−1 − 0.5)2
+ exp −
2
= 0.4724
Because y2(x) < y1(x), so x = [0.5, 0.5]T is
classified as Class 1.
2
Class 1
Class 2
1.5 Class ?
0.5
−0.5
−1
−1.5
−2
−2 −1.5 −1 −0.5 0 0.5 1 1.5 2