Hafez Ahmad Florida Gulf Coast University

ArcGIS tutorial No. : 30

Image classification and Accuracy Assessment using ArcGIS10.5

𝑡𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑐𝑜𝑟𝑟𝑒𝑐𝑡𝑙𝑦 𝑐𝑙𝑎𝑠𝑠𝑖𝑓𝑖𝑒𝑑 𝑝𝑖𝑥𝑒𝑙𝑠 (𝑑𝑖𝑎𝑔𝑜𝑛𝑎𝑙)

1: Overall accuracy = 𝑡𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑟𝑒𝑓𝑒𝑟𝑒𝑛𝑐𝑒 𝑝𝑖𝑥𝑒𝑙𝑠
∗ 100

𝑡𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑐𝑜𝑟𝑟𝑒𝑐𝑡𝑙𝑦 𝑐𝑙𝑎𝑠𝑠𝑖𝑓𝑖𝑒𝑑 𝑝𝑖𝑥𝑒𝑙𝑠 𝑖𝑛 𝑒𝑎𝑐ℎ 𝑐𝑎𝑡𝑒𝑔𝑜𝑟𝑖𝑒𝑠

2: Users accuracy = 𝑡𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑐𝑙𝑎𝑠𝑠𝑖𝑓𝑖𝑒𝑑 𝑝𝑖𝑥𝑒𝑙𝑠 𝑖𝑛 𝑡ℎ𝑎𝑡 𝑐𝑎𝑡𝑒𝑔𝑜𝑟𝑖𝑒𝑠 (𝑡ℎ𝑒 𝑟𝑜𝑤 𝑡𝑜𝑡𝑎𝑙) ∗ 100

𝑡𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓𝑐𝑜𝑟𝑟𝑒𝑐𝑡𝑙𝑦 𝑐𝑙𝑎𝑠𝑠𝑖𝑓𝑖𝑒𝑑 𝑖𝑛 𝑒𝑎𝑐ℎ 𝑐𝑎𝑡𝑒𝑔𝑜𝑟𝑖𝑒𝑠

3: Producer accuracy = 𝑡𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑟𝑒𝑓𝑒𝑟𝑒𝑛𝑐𝑒 𝑝𝑖𝑥𝑒𝑙𝑠 𝑖𝑛 𝑡ℎ𝑎𝑡 𝑐𝑎𝑡𝑒𝑔𝑜𝑟𝑖𝑒𝑠 (𝑡ℎ𝑒 𝑐𝑜𝑙𝑢𝑚𝑛 𝑡𝑜𝑡𝑎𝑙) ∗ 100

(𝑇𝑆∗𝑇𝐶𝑆)−∑(𝐶𝑂𝐿.𝑡𝑜𝑙∗𝑟𝑜𝑤.𝑡𝑜𝑡)
4: Kappa coefficient = 𝑇𝑆 2 −∑(𝑐𝑜𝑙.𝑡𝑜𝑡𝑎𝑙∗𝑟𝑜𝑤.𝑡𝑜𝑡𝑎𝑙
∗ 100

Output Data derived from supervised image classification

Water building Vegetation Total (user)

water 6 1 0 7
building 1 5 0 6
Vegetation 0 1 6 7
Total(producer) 7 7 6 20

𝑡𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑐𝑜𝑟𝑟𝑒𝑐𝑡𝑙𝑦 𝑐𝑙𝑎𝑠𝑠𝑖𝑓𝑖𝑒𝑑 𝑝𝑖𝑥𝑒𝑙𝑠 (𝑑𝑖𝑎𝑔𝑜𝑛𝑎𝑙)

Overall accuracy = ∗ 100
𝑡𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑟𝑒𝑓𝑒𝑟𝑒𝑛𝑐𝑒 𝑝𝑖𝑥𝑒𝑙𝑠

(6+5+6)=17
Overall accuracy = ∗ 100= 85%
20
𝑡𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑐𝑜𝑟𝑟𝑒𝑐𝑡𝑙𝑦 𝑐𝑙𝑎𝑠𝑠𝑖𝑓𝑖𝑒𝑑 𝑝𝑖𝑥𝑒𝑙𝑠 𝑖𝑛 𝑒𝑎𝑐ℎ 𝑐𝑎𝑡𝑒𝑔𝑜𝑟𝑖𝑒𝑠
Users accuracy = ∗ 100
𝑡𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑐𝑙𝑎𝑠𝑠𝑖𝑓𝑖𝑒𝑑 𝑝𝑖𝑥𝑒𝑙𝑠 𝑖𝑛 𝑡ℎ𝑎𝑡 𝑐𝑎𝑡𝑒𝑔𝑜𝑟𝑖𝑒𝑠 (𝑡ℎ𝑒 𝑟𝑜𝑤 𝑡𝑜𝑡𝑎𝑙)

Water= 6/7*100=86%
Building =5/6*100=86%
Vegetation =6/7*100=86%
Producer accuracy =
𝑡𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓𝑐𝑜𝑟𝑟𝑒𝑐𝑡𝑙𝑦 𝑐𝑙𝑎𝑠𝑠𝑖𝑓𝑖𝑒𝑑 𝑖𝑛 𝑒𝑎𝑐ℎ 𝑐𝑎𝑡𝑒𝑔𝑜𝑟𝑖𝑒𝑠
∗ 100
𝑡𝑜𝑡𝑎𝑙 𝑛𝑢𝑚𝑏𝑒𝑟 𝑜𝑓 𝑟𝑒𝑓𝑒𝑟𝑒𝑛𝑐𝑒 𝑝𝑖𝑥𝑒𝑙𝑠 𝑖𝑛 𝑡ℎ𝑎𝑡 𝑐𝑎𝑡𝑒𝑔𝑜𝑟𝑖𝑒𝑠 (𝑡ℎ𝑒 𝑐𝑜𝑙𝑢𝑚𝑛 𝑡𝑜𝑡𝑎𝑙)

Water= 6/7*100=86%
Building =5/7*100=71%
Vegetation =6/6*100=100%

1
Hafez Ahmad Florida Gulf Coast University
ArcGIS tutorial No. : 30

(𝑇𝑆∗𝑇𝐶𝑆)−∑(𝐶𝑂𝐿.𝑡𝑜𝑙∗𝑟𝑜𝑤.𝑡𝑜𝑡)
Kappa coefficient = ∗ 100
𝑇𝑆 2 −∑(𝑐𝑜𝑙.𝑡𝑜𝑡𝑎𝑙∗𝑟𝑜𝑤.𝑡𝑜𝑡𝑎𝑙

TS= total number of sample =20

TCS=total corrected sample=17

TS^2=200

COL.total=6 , raw.total=7
(20∗17)−((7∗7)+(6∗7)+(6∗7))
Kappa coefficient = ∗ 100 = 78%
𝑇𝑆 2 −((7∗7)+(6∗7)+(6∗7))

References

1; https://grass.osgeo.org/grass78/manuals/r.kappa.html

2: http://www.50northspatial.org/classification-accuracy-assessment-confusion-matrix-method/

3: https://file.scirp.org/pdf/IJG_2017050414335934.pdf

4: http://gis.humboldt.edu/OLM/Courses/GSP_216_Online/lesson6-2/metrics.html

5: https://www.jnrd.info/2017/08/10-5027jnrd-v7i0-05/