Cover Type Classification Methods for Baker-Bay study Area, Washington State

Using Accuracy Assessments for Refinement

by Sarah Thomas
02/05/2014

ABSTRACT
This lab focuses on the use of unsupervised ISODATA classification of
the Baker-Bay study area image. ISODATA classification examines a large
number of unknown pixel values within an imagery dataset and divides them
into spectral classes based upon similar reflectance values. Pixels within a
spectral class should represent a similar cover type (Antonova, 2014). The
resulting ISODATA classes were compared to training and test reference datasets in order to
create information classes suited for modified LULC codes. An accuracy assessment was
conducted for the information classes assigned, as well as for two additional classifications
created by combining classes and the re-assignment of pixels to spectral classes were using rulebased refinement. The initial assessment presented an overall accuracy of 44.42%, which
increased to 56.41% after combining classes. The final ruled-based refinement classification
resulted in an overall accuracy of 61.76%. ISODATA classification is an applicable, objective
method of unsupervised classification, which can be improved by the more subjective techniques
of spectral class combination and rule-based refinement.
METHODS
The image used in this analysis is a modified subset from July 5th, 2005 of the Baker-Bay
Landsat TM imagery scene focused on the study area covering Mount Baker and Bellingham
Bay in Northwest Washington State, United States. The entire image covers of 1500 lines by
about 2500 rows with a pixel resolution of 25 meters by 25 meters (Antonova, 2014). The
imagery dataset uses six different bands to present parts of the electromagnetic scale, excluding
the infrared spectrum in TM Band 6. This imagery was analyzed using unsupervised ISODATA
classification in order to determine cover types. This lab focuses on unsupervised ISODATA
classification of the imagery using statistical comparison to region of interest ground truth
training and test data sets and a rule-based refinement of information classes.
Following the procedures outlined on the class website (Antonova,
2014), the Landsat TM imagery for the Baker-Bay study area was analyzed
and compared to region of interest ground truth points collected in 2014 and
previous years. The classification was performed in three stages. First, an
ISODATA classification of the Landsat TM image grouped pixels into 50
spectral classes where pixels in each class had similar spectral values. Each
spectral class was compared to a training ground truth dataset of over 800
GPS data points referenced to modified Landuse-Landcover (LULC) codes and
assigned into 13 information classes. An accuracy assessment was

performed to compare assigned information classes to a referenced test

dataset from 2014.
During the second stage of classification, spectral classes were
combined in order to improve the accuracy of information class assignment.
The accuracy of resulting classification was assessed using the same test
dataset. An additional classification took place using rule-based refinement,
which reclassified pixels within information classes to another on the basis of
meeting or breaking a set of rules defined for pixel nearness to roads,
elevation, and presence of slope. Again, the test dataset was used to
perform an accuracy assessment for the final cover type classification.
RESULTS
Accuracy and extent of cover types varied between the imagery
produced by training reference-based classes, combined classes, and the
rule-based classification. The initially assigned training reference-based
classification resulted in 13 information classes with an overall accuracy of
45.42% (Table 1). User accuracy covered a wide range, between zero and
100% and had an average of 47%. The average producers accuracy was
43.93% with a range of zero to 92.29%. The coverage of each information
class resulted as follows (Table 2, Figure 1); Residential 3.47%, Urban
1.52%, Pasture 9.76%, Crops 4.09%, Clearcut 1973-1992 13.76%,
Clearcut 1992-2002 5.75%, Clearcut 2002-2005 1.77%, Deciduous
7.21%, Conifer 42.44%, Water 4.95%, Rock 3.23%, Alpine 4.52%, and
Snow 1.61%. Information classes were then combine to improve accuracy.
Combining information classes resulted in coverage as follows (Figure
2): Pasture and Crops were combined to create an Agriculture class
covering 9.76% of the image; a new Deciduous including the former,
Clearcut 1973-1992, and Clearcut 1992-2002 covered 26.73% of the
image. After combining information classes, the overall accuracy improved
by 10.01%, to 56.41% (Table 3). The range of user accuracy remained the
same as in the initial classes, but the average user accuracy increased to
56.73% (Table 4). The range of producers accuracy range also remained the
same, but the average increased by 10% to 53.37%. A final reclassification
occurred using rule-based refinement.
The refined classification presented an image where classes were
assigned with 61.76% overall accuracy (Table 5). The average users
accuracy increased to 68.58% with a much smaller range than the initially
assigned classes, with percentages between 48.53% and 100%. The
producers accuracy with rule-based refinement increased to an average of
64.54% with a range of 17.14% to 92.29%. The final coverage of information
classes changed for most cover types, but the information classes of

Conifer and Snow remained at the same (Table 6, Figure 3). Agriculture
increased by 5.73%, and Rock increased by 2.25%, Many cover types
decreased in coverage, presented as follows: Residential 1.63%, Urban .
63%, New Growth 0.87%, Deciduous 2.02%, Water 4.3%, and Alpine
2.83%.

Table 1: Accuracy assessment produced for the training reference-based

classification of Baker-Bay study area image. The total accuracy for the
ground truth data to predicted classification was 45.42%. Classification was
based upon comparison of training reference dataset and assigned ISODATA
spectral classes.

Table 2: Table showing the coverage and accuracy of training referencebased classification based upon comparison between training reference
dataset and assigned ISODATA spectral classes.
Spectral
class
1
2

Information
Class
Residential
Urban

Color

Pixels
131838
57991

Area
(hectares)
82,39.88
3,624.44

Coverage
(%)
3.47
1.52

User
Acc (%)
46.05
72.55

Prod
Acc (%)
48.61
50.00

3
4
5
6
7
8
9

Pasture/Grass
Crops
1973-92
1992-2002
2002-2005
Deciduous
Conifer

215,976
155554
523,787
218943
67,488
274301
1614883

10
11
12
13

Water
Rock
Alpine
Snow

188481
122,759
171919
61280

13,498.50
9,722.13
32,736.69
13,683.94
4,218.00
17,143.81
100,930.1
9
11,780.06
7,672.44
10,744.94
3,830.00

Information Class
Residential
Urban
Pasture/Grass
Crops
1973-92
1992-2002
2002-2005
Deciduous
Conifer
Water
Rock
Alpine
Snow

5.676
4.09
13.765
5.75
1.77
7.21
42.44
4.95
3.23
4.52
1.61

41.94
32.31
50.00
20.00
64.10
24.07

27.08
26.58
45.45
25.00
92.59
16.46

51.10
90.91
17.24
0.00
100.00

70.99
74.63
27.03
0.00
66.67

Figure
1: A
map

depicting the coverage for training reference-based classes in the Baker-Bay

study area. Classification was based upon comparison training reference
dataset and assigned ISODATA spectral classes.

Table 3: Accuracy assessment of combined classes produced for

classification of Baker-Bay study area image. The overall accuracy was
56.41%. Classification was based upon the accuracy assessment for trainingreference based classification.

Table 4: Table showing the combined class coverage and accuracy of

classification based upon the accuracy of training-reference based
classification.
Spectr Informati
al
on Class
class
1
Residentia
l
2
Urban
3
Agricultur
e
4
New
Growth
5
Deciduous
6

Conifer

Water

8
9
10

Rock
Alpine
Snow

Colo
r

Pixels

Area
(hectar
es)
131838 8,239.88

Covera
ge
(%)
3.47

57991 3,624.44
371530 23,220.6
3
67488 4,218.00

1.52
9.76

101703 63,564.4
1
4
161488 100,930.
3
19
188481 11,780.0
6
122759 7,672.44
171919 10,744.9
3
61280 3,830.00

User
Acc
(%)

Prod
Acc
(%)

46.05
72.55

48.61
50.00

68.50

49.71429

64.10

92.59259

59.28

53.48837

51.10

70.99237

90.91
17.24

74.62687
27.02703

0.00
100.00

0.00
66.67

1.77
26.73
42.44
4.95
3.23
4.52
1.61

Information
Class
Residential
Urban
Agriculture
New Growth
Deciduous
Conifer
Water
Rock
Alpine
Snow

Figure 2.
A map
depicting
the
coverage
for
combined
classes in
the BakerBay study
area.
Classification was based upon the accuracy assessment for trainingreference based classification.

Table 5: Accuracy assessment for rule-based refinement classification of

Baker-Bay study area image. Pixels were re-assigned to information classes
based upon rule criterion set in regards to roads, presence on a slope, and
elevation

Table 6: Table showing the coverage and accuracy of rule-based refinement

classes. Pixels were re-assigned to information classes based upon rule
criterion set in regards to roads, presence on a slope, and elevation.
Spect
ral
class
1
2
3
4
5

Informati
on Class
Residential
Urban
Agriculture
New
Growth
Deciduous

Conifer

7
8
9
10

Water
Rock
Alpine
Snow

Color

Pixels

Area
(hectar
es)
70,141 4,383.81
33,956 2,122.25
589,325 36,832.8
1
34,038 2,127.38

Covera
ge
(%)
1.84
0.89
15.49

940,329 58,770.5
6
1,614,8 100,930.
83
19
163,578 1,023.63
208,491 1,330.69
64,276 4,017.25
61,280 3,830.00
Information
Class
Residential
Urban
Agriculture
New Growth
Deciduous
Conifer
Water
Rock
Alpine
Snow

24.71

User
Acc
(%)
48.53
63.86

Prod
Acc
(%)
45.83
72.60

57.40

73.14

96.15

92.59

78.36

48.84

51.10
97.73
17.65
75.00
100.00

71.54
71.67
17.14
50.00
66.67

0.90

42.44
4.30
5.48
1.69
1.61

Figure 3. A
map
depicting
the
coverage for
rule-based
refinement
classes in
the BakerBay study
area. Pixels
were reassigned to
information classes based upon rule criterion set in regards to roads,
presence on a slope, and elevation.
DISCUSSION
Accuracy assessments are necessary to obtain a realistic classification
of spectral classes into information classes (Antonova, 2014). In order to perform an accurate
classification of cover type, objective approaches can be applied using knowledge-based
combination of information classes and rule-based refinement techniques. The variation of
overall accuracy between the three stages of classification mainly resulted from the classification
methods being both subjective and objective. ISODATA classification is an applicable method
for unsupervised classification which is generally improved by further applying supervised
classification methods.
During the initial stage of classification of the Baker-Bay study area,
unsupervised ISODATA classification pixels were objectively assigned to spectral classes based
upon similar spectral values. However, the initial assignment of information classes based pixel
presence within spectral classes was a subjective task. Using the cross tabulation method for
assignment, several information classes included different spectral classes. For
example, the Residential information class included spectral classes 32,
44, and 45. Also, the Urban information class included spectral class
26 which only accounted for 76% of the total pixels within that spectral
class. The remaining pixels for that spectral class presided in Soil and
Residential information classes. Information classes may even share similar
spectral class values. For instance, Soil/Rock information class had 5 pixels
within the 30 spectral class, and Urban had 4 pixels. Deciduous,
Clearcut 1973 to 1992 and Clearcut 1992 to 2002 information classes all
held the spectral class of 17 with number of pixels at 7, 5, and 4

respectively. The assignment of spectral classes into information classes

must take into account the variability of spectral values within an information
classes and classify based upon the accuracy of spectral value presence.
The second stage of classification attempted to account for the inaccuracies presented in
the training-reference based classification. During this stage, a subjective approach was used to
assign information classes by grouping classes together based upon the accuracy of trainingreference based classification and the comparison with ISODATA spectral classes. Deciduous,
Clearcut 1973-1992 and Clearcut 1992-2002 the accuracy for the newly assigned were
combined to a new Deciduous information class in recognition that clear cut regions are likely
to be dominated by deciduous trees for 3 to 80 years, depending on environmental factors. The
Crops and Pasture information classes were combined in order to account for similar texture
and moisture conditions between the two cover types. The increase in accuracy (Table 3) for both
classes, demonstrates that information classes may contain similar spectral values that are not
differentiated in the ISODATA classification. Even though the training reference dataset assigned
specific spectral values to appropriate information classes, a more objective approach was
required for accurate classification.
The third stage of rule-based refinement used non-spectral data to delineate information
classes that contained pixels within the same spectral class. The first rule applied criteria for
discrepancies between Residential, Urban and Rock information classes, where areas that
are generally residential or urban were classified as rock. Erroneously classed Rock pixels
were re-assigned to residential or urban information classes based upon their distance from a
road. Conversely, Residential and Urban pixels were re-classed to the Rock information class.
A visual inspection of the resulting coverage (Figure 3) shows pixels were more accurately
assigned to respective cover types. Areas near Mount Baker are no longer classified as
Residential or Urban. Also, areas near roads are previously classified as Rock (Figure 2)
are now classified as Residential or Urban. Being that roads and many buildings within the
Baker-Bay study area are comprised of rock material, this refinement was necessary in order to
differentiate between actual rock surfaces, and residential or urban areas.
Another misclassification occurred as many pixels classified as Water were located on
steep north facing slopes in the Baker-Bay study area image (Figures 1, 2). Generally, water
surface types do not occur in these areas. For the purpose of improving classification accuracy,
pixels were re-classed into a new spectral class 14 and designated Shadows. A visual
inspection of the coverage demonstrates that the Water information class is no longer located
in the regions with steep slope such as Mount Baker (Figure 3). Even though the refined-class
assignment resulted in improved accuracy for this information class (Tables 5, 6), it is important
to note that the pixels classified as shadow were not included in the included in accuracy
assessment. The assigned LULC codes would not include a Shadows information class,
especially as shadows change with the angle of the sun, and do not directly affect classification
of cover type. However, we may find distinctly different cover types in regards to shadowing on
slopes, but the image processing using remote sensing must account for shadow spectral values.

Elevation data was also incorporated in the refined classification, where pixels were
assigned to areas of more likely occurrence of spectral values. Six models were run with the
following criteria: the Agriculture information class was to occur at low elevation;
Deciduous and New Growth information classes to occur at medium elevations, and
Alpine at high elevations. This refinement set low elevations at less than 200 meters, high
elevations above 1500 meters, and medium elevations occurred in between. This refined
classification (Figure 3) resulted in class coverage where Alpine no longer appeared at low
elevations. Conversely, the Agriculture information class no longer appeared at high
elevations. Medium elevations were primarily re-assigned to Deciduous, but some areas were
assigned as New Growth. Using rule-based refinement can improve the overall accuracy of
classification (Table 6), but this refinement is ultimately relies on the accuracy of initially
assigned spectral classes. For instance, the resulting class coverage for combined classes of
Agriculture and Deciduous appears accurate at during the second stage of classification
(Figure 2), however the coverage appears much more extensive than anticipated in the final rulebased refinement map (Figure 3).Thus, objective approaches should coincide with subjective in
order to create accurate to classifications of cover type.
Using the unsupervised ISODATA classification, combined classes, and rule-based
refinement, this lab resulted in the assignment of 50 spectral classes into ten information classes
based upon training and test reference datasets. These datasets can be checked for errors as the
initial modified LULC classification may have been misclassified. Also, classification could be
assigned to spectral classes resulting from the ISODATA classification in order to further
delineate information classes. Additional analysis may include alternate spectral data for the
Baker-Bay Study area, such as hyperspectral imagery or images from many dates (Antonova,
2014). Ultimately, the classification of spectral classes into information classes using the outlined
methods is a time-consuming process, in which both subjective and objective approaches may
result in error, making accuracy assessments an essential part of imagery classification.

LITERATURE CITED
Verbyla, David. Satelite Remote Sensing of Natural Resources. 1. Boca Raton,
Florida:
CRC Press, 1995. 107-111. Print.
Antonova, Natasha. 2014. Lab 3: Environmental Warfare in the Persian Gulf.
http://staff.wwu.edu/antonon/envr442/ENVI/442_lab3_ENVI.html