YANGON TECHNOLOGICAL UNIVERSITY

DEPARTMENT OF COMPUTER ENGINEERING AND INFORMATION TECHNOLOGY

Automatic Parameter Generating System for Urinary Calculi

Diagnosis and Treatment Planning based on 3D CT images

Defense Seminar
15-5-2023

Supervised by Presented by
Dr. Khine Thin Zar Ma Lai Yee Myint
Ph.D-CEIT-5, 13th Batch
 Outlines of Presentation

 Introduction to Indoor Localization System

 RSS-based Wireless Indoor Localization

 Problem Statements of the Research

 Objectives of the Research

 Proposed System Design and ANN Architecture

 Implementation of the Proposed System

 Experimental Results
2
 Introduction
 Indoor localization system is used to estimate the location of people or objects where
Global positioning system (GPS) gives lack precision or accuracy .

 Application Areas:

 Multistory buildings, Campus, Shopping malls

 Airports, Alleys, Parking Garages, and Underground Locations

Localization Techniques Pros Cons

Receive Signal Strength (RSS) Low cost Low accuracy

Angle of Arrival (AOA)
Time Difference of Arrival
(TDoA)
Time of Flight (TOA)
High accuracy Need extra hardware, High cost
Acceptable accuracy Need time synchronize, High
complexity
Acceptable accuracy Need time synchronize, High
complexity 3
 RSS based Wireless Indoor Localization

RSS based Indoor

Localization

Radio Propagation Model RSS figurprinting

⁎ Low accuracy due to RSS variability √ Improve accuracy

√ Not require training Database ⁎ Need offline training data

√ Reduced computational complexity ⁎ High computational cost

4
 Problem Statements of the Research

• High RSS variability due to obstacles in indoor area.

• A very few research about RSS fingerprinting based

localization for multifloored indoor environment.

• Necessity to improve online RSS fingerprint matching

algorithm to achieve better localization performance.

5
 Objectives of the Research

 To improve RSS-based indoor localization accuracy.

 To analyze the variability of RSS in the indoor environment for
different frequency bands.
 To consider indoor localization for a multifloored environment.
 To analyze and improve the accuracy of indoor localization
using different machine learning algorithms and neural
networks.

6
 Contributions

 Implement the fingerprint database with additional features

RSS values of both 2.4 GHz and 5GHz frequency bands

 Consider indoor localization for multifloored environment

 Analyze and improve accuracy of indoor localization using

different machine learning algorithms and neural networks

7
 System Requirements
 Hardware
 Four access points (AC750 Dual Band Wireless Cable Router )
 Supports 802.11ac standard
 Simultaneous 2.4GHz 300Mbps and 5GHz 433Mbps connections for
733Mbps of total available bandwidth
Hardware Features of AC750 Dual Band Wireless Router
 Interface: 4 10/100Mbps LAN ports and 1 10/100Mbps WAN port
 Buttons: WPS/Reset Button, Wireless On/Off Switch, Power On/Off
Button
 Antennas: 2 × 2.4GHz Antennas, 1 × 5GHz Antenna
 External Power Supply: 12VDC /1A
 Dimensions ( W x D x H ): 9.1 x 5.7 x 1.4 in. (230 x 144 x 35mm)
8
 Antenna Type: Two dual-band fixed antennas
 Con’t
Wireless Features of AC750 Dual Band Wireless Router
 Wireless Standards:

IEEE 802.11ac/n/a 5GHz

IEEE 802.11b/g/n 2.4GHz

Frequency: 2.4GHz and 5GHz

 Signal Rate:

5GHz: Up to 433Mbps

2.4GHz: Up to 300Mbps
 Software
 Wi-Fi analyzer
9
 Python 3.7 (64 bits)
 Overview of RSS based localization system
Offline phase: Fingerprinting

AP1 AP2 Sample RSS Fingerprinting Map

y5
Position AP1 AP2 AP3 AP4

y4
y3
y2 2.4 5 2.4 5 2.4 5 2.4 5

x1,y1 -62 -64 -83 -86 -79 -80 -72 -74

y1

x2,y4 -54 -55 -45 -47 -70 -72 -65 -66

y0

x0 x1 x2 x3 x4 x5 AP3
AP4 x4,y2 -84 -86 -81 -85 -50 -52 -55 -54

Online phase: Real-time location estimating

AP1=-84,-86,,AP2=-81,-85
AP3=-50,-52,,AP4=-55,-54,

AP1
Estimated
y5

AP2
y4

Location
y3
y2

Estimation Algorithm x4,y2

y1
y0

AP4
x0 x1 x2 x3 x4 x5 AP3 Frequency= 2.4 GHz, 5 GHz
10
Working flow of RSS-Fingerprinting based
localization system
Offline Training Phase Online Positioning Phase

Define the reference Measure target

points (RPs) point’s RSS values

Collect the RSS values Location estimation based

form each RPs on fingerprint database
(Using machine learning
& neural networks)

Store the
collected RSS Estimated location
values
in fingerprint
database
11
 Database Building Phase
AP3 AP1
(1) Define Reference Points (RP) 0.5m
Second floor
 130 points per floor -----

 total 260 points for 2 floors

4.27meters
(2) Data Collection
 Use 4 APs -----
First floor(65meters) AP2
AP4
 At each RP
 1 Orientation - 4 RSS (2.4 GHz), 4 RSS (5 GHz)
 Total 4 Orientations – 32samples

(3) Build fingerprinting databases using collected data

i. Fingerprinting database with RSS samples from 2.4 GHz band
ii. Fingerprinting database with RSS samples from 5 GHz band
iii. Fingerprinting database with RSS samples from 2.4 and 5 GHz band 12
 Real Time Estimating Phase
Data
AP1=-84,-86,AP2=-81,-85 base
AP3=-50,-52,AP4=-55,-54
Estimation Algorithm Estimated location

 Calculating RSS value (real time) with the existing fingerprinting

database (offline) by using machine learning algorithms and neural
network to get estimated location.
 Estimation algorithms are:
 Random Forest (RF)
 Weighted 𝑘-Nearest Neighbor (WKNN)
 Multi-Layer Neural Network (MLNN) 13
 Random Forest (RF) Algorithm
 Builds multiple decision trees and merge them together to get a more
accurate and stable prediction.

 Consists of many decision trees.

 Creates decision trees on data samples and then gets the prediction.

 Produces a highly accurate prediction and runs efficiently on large

databases for many datasets.

 Can handle thousands of input variables without reduction.

14
 Random Forest Algorithm (cont.)
X Y AP1 AP2 AP3 AP4 AP1 AP2 AP3 AP4

Offline fingerprinting dataset as input training 1 1 -28 -47 -50 -52 -27 -60 -69 -59

data set 4 8 -25 -59 -48 -51 -34 -45 -69 -61

5 7 -25 -49 -50 -45 -33 -65 -58 -47

8 3 -30 -49 -50 -53 -38 -57 -62 -53

Select a bootstrap sample from the training set ……

AP AP AP AP AP AP AP AP AP AP AP AP AP AP
X Y X Y X Y
1 3 4 2 3 1 3 4 3 4 1 2 3 4

4 8 -48 -51 -34 -45 -69 -61

...
1 1 -28 -50 -52 -60 -69 1 1 -28 -69 -59

4 8 -25 -48 -51 -45 -69 4 8 -25 -69 -61 5 7 -50 -45 -33 -65 -58 -47

8 3 -30 -50 -53 -57 -62 5 7 -25 -58 -47 8 3 -50 -53 -38 -57 -62 -53

Output ensembles of trees T

……

Majority Voting

X, Y
Real Time Estimating Phase

16
 Experimental Results Using RF

 Use Root Mean Square Error (RMSE) function as a

positioning performance evaluation function which
calculates the positioning error (unit of a meter)

n is the total number of test points

 is the actual point,
 is the predicted point

 Less the RMSE, better the accuracy

17
Experimental Results of Random Forest using 2.4
GHz and 5 GHz Frequency Band

2.4GHz 5GHz
4
3.8
3.6
RMSE (m)

3.4
3.2
3
2.8
2.6
2.4
2.2
25
45
65
85
5

105
125
145
165
185
205
225
245
265
285
305
325
345
365
385
405
425
445
465
485
Number of Tree
18
Experimental Results of Random Forest using 2.4
GHz and Combined Frequency Band

2.4GHz 2.4 and 5GHz

3.1

2.9

2.8
RMSE (m)

2.7

2.6

2.5

2.4

2.3
20
35
50
65
80
95
5

110
125
140
155
170
185
200
215
230
245
260
275
290
305
320
335
350
365
380
395
410
425
440
455
470
485
Number of Tree

19
 Weighted 𝑘-Nearest Neighbor (WKNN)
 Modified version of k nearest neighbors.

The working flow of Weighted KNN

 Euclidean distance between the forecasted data point (sj )
and the known data point (yj )

 The weight for each forecasted data point by the distance

 Estimated Location:

20
Experimental Results of WKNN using 2.4 GHz and
5 GHz Frequency Band

RMSE(m)

Numbers of K

21
Experimental Result of WKNN using 2.4 GHz and
Combined Frequency Bands

RMSE(m)

Numbers of K

22
2.4 GHz and 5 GHz Frequency Band (5-50-5)

2.4 Ghz 5 Ghz

2.8

2.6

2.4

2.2
RMSE(m)

1.8

1.6

1.4
1 2 3 4 5 6 7 8 9

Numbers of K
23
2.4 GHz and Combined Frequency Bands (5-50-5)

2.4Ghz 2.4 Ghz and 5Ghz

1.72

1.715
RMSE(m)

1.71

1.705

1.7

1.695

1.69

1.685

1.68
1 2 3 4 5 6 7 8 9

Numbers of K

24
 Multi-layer Neural Network (MLNN)

 Consists of a huge number of interconnected processing elements

called neurons.
 Has ability to learn, recall and generalize from the given data by
suitable assignment and adjustment of weights.
 Performs as a function approximator.
 Can be used to solve non-linear problem.

25
 Architecture of a multi-layer neural network

 Input Layer, Hidden Layer, Output Layer

 Activation function: Relu, Tanh, Sigmoid
 Parameters: Weights and Bias
 Hyper-parameter: Batch size, Epoch, Learning rate
 Loss Function : MSE, RMSE, Binary Cross-Entropy
 Training Algorithms: Stochastic Gradient Descent, Batch Gradient
Descent, Mini Batch Gradient Descent, RMSprop, Adam.
26
 Performance Comparison of 2.4 GHz, 5 GHz, and
Combined Frequency Bands
Frequency ANN architecture Activation function of RMSE
Band hidden neuron
4-8-2 Relu, Tanh, Sigmoid 1.67, 1.12, 1.39
4-10-2 Relu, Tanh, Sigmoid 1.16, 1.13, 1.39
2.4 GHz 4-12-2 Relu, Tanh, Sigmoid 1.36, 1.11, 1.8
4-20-2 Relu, Tanh, Sigmoid 1.56,1.14, 1.66
4-30-2 Relu, Tanh, Sigmoid 1.58, 1.12, 1.82
4-50-2 Relu, Tanh, Sigmoid 1.35, 1.34, 1.82

4-8-2 Relu, Tanh, Sigmoid 1.35, 1.19, 1.37

5 GHz 4-10-2 Relu, Tanh, Sigmoid 1.36, 1.19, 1.38
4-12-2 Relu, Tanh, Sigmoid 1.35, 1.19, 1.8
4-20-2 Relu, Tanh, Sigmoid 1.63, 1.19, 1.82
4-30-2 Relu, Tanh, Sigmoid 1.82, 1.22, 1.81
4-50-2 Relu, Tanh, Sigmoid 1.35, 1.35, 1.39

8-8-2 Relu, Tanh, Sigmoid 1.13, 1.09, 1.38

Combined 8-10-2 Relu, Tanh, Sigmoid 1.18, 1.17, 1.29
8-12-2 Relu, Tanh, Sigmoid 1.36, 1.0, 1.4
8-20-2 Relu, Tanh, Sigmoid 1.09, 1.08,1.82
8-30-2 Relu, Tanh, Sigmoid 1.08,1.07, 1.37
8-50-2 Relu, Tanh, Sigmoid 1.08, 1.08, 1.41

27
Experimental Results using Multi- Layered ANN trained
by Gradient Descent
0.75

0.7

0.65
RMSE

0.6

0.55

0.5
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40

2.4GHz, Hidden neuron = 12, Activation function = tanh

5GHz,Hidden neuron = 12, Activation function= tanh
combined,Hidden neuron = 12, Activation function = tanh 28
Comparison Of Positioning Error For All Frequency
Bands of hidden 12 neurons

21

20.5

20

19.5
RMSE (m)

19

18.5

18

17.5

17
2.4GHz 5Ghz combined

29
 Genetic Algorithms (GA)

 A type of stochastic global search optimization algorithm.

 Use to solve both constrained and unconstrained problems.
 Generate high-quality solutions to optimization and search
problems by relying on biologically inspired operators such as
mutation, crossover, and selection.
 Has excellent parallel capabilities.

30
Flowchart of ANN parameter optimization using
Genetic Algorithm

31
Experimental Results using Multi-Layered ANN
trained by GA
0.8

0.75

0.7

0.65
RMSE (m)

0.6

0.55

0.5

0.45

0.4
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40

2.4GHz, Hidden neuron = 12, Activation function = tanh

5GHz, Hidden neuron = 12, Activation function = tanh
combined, Hidden neuron = 12, Activation function = tanh

32
Comparison Of Positioning Error For All Frequency
Bands of Multi-Layered ANN trained by GA
21

20.5

20

19.5
RMSE (m)

19

18.5

18

17.5

17
2.4GHz 5Ghz combined

33
Comparison of positioning error using Gradient
Descent and GA for Combined Frequency Bands
25

20

RMSE(m) 15

10

0
Gradient Descent GA

Positioning Error

34
Comparison of positioning error using Machine Learning
and Neural Network of Combined Frequency Bands

120

100

80

60

40

20

0
RF WKNN Gradient Descent GA

RF( tree=3-120-3) GD(Hidden neuron =12,Tanh)

WKNN (k=3-120-3) GA(population= 500,gen=40)

35
Thank You For Your Attention!

36