Professional Documents
Culture Documents
Multi-Scale Validation Strategy For Satellite Albedo Products and Its Uncertainty Analysis
Multi-Scale Validation Strategy For Satellite Albedo Products and Its Uncertainty Analysis
Earth Sciences
• RESEARCH PAPER • April 2015 Vol.58 No.4: 573–588
doi: 10.1007/s11430-014-4997-y
Received March 31, 2014; accepted October 8, 2014; published online December 8, 2014
Coarse-resolution satellite albedo products are important for climate change and energy balance research because of their
capability to characterize the spatiotemporal patterns of land surface parameters at both the regional and global scales. The
accuracy of coarse-resolution products is usually assessed via comparison with in situ measurements. The key issue in the
comparison of remote sensing observations with in situ measurements is scaling and uncertainty. This paper presents a
strategy for validating 1-km-resolution remote sensing albedo products using field measurements and high-resolution re-
mote sensing observations. Field measurements were collected to calibrate the high-resolution (30 m) albedo products de-
rived from HJ-1a/b images. Then, the calibrated high-resolution albedo maps were resampled (i.e., upscaled) to assess the
accuracy of the coarse-resolution albedo products. The samples of field measurements and high-resolution pixels are based
on an uncertainty analysis. Two types of coarse-resolution albedo datasets, from global land surface satellite (GLASS) and
moderate-resolution imaging spectroradiometer (MODIS), are validated over the middle reaches of the Heihe River in Chi-
na. The results indicate that the upscaled HJ (Huan Jing means environment in Chinese and this refers to a satellite constel-
lation designed for environment and disaster monitoring by China) albedo, which was calibrated using field measurements,
can provide accurate reference values for validating coarse-resolution satellite albedo products. However, the uncertainties
in the upscaled HJ albedo should be estimated, and pixels with large uncertainties should be excluded from the validation
process.
Citation: Peng J J, Liu Q, Wen J G, et al. 2015. Multi-scale validation strategy for satellite albedo products and its uncertainty analysis. Science China: Earth
Sciences, 58: 573–588, doi: 10.1007/s11430-014-4997-y
Over the past two decades, a variety of land-surface albedo al., 2013; Qu et al., 2013) produced in China, and Global
products have been routinely generated from various satel- Land Surface Albedo (GLOBALBEDO) from Satellite Data
lite data, including moderate-resolution imaging spectrora- (Lewis et al., 2012) produced by the European Space
diometer (MODIS) albedo products (Schaaf et al., 2002) Agency (ESA). One way to calibrate/validate (CAL/VAL)
produced by NASA, a global land surface satellite (GLASS) these surface albedo products is to compare reliable surface
albedo product (Liu et al., 2012; Liang et al., 2013; Liu et albedo values taken from field measurements with those
taken from satellite pixels (Liang et al., 2002; Jin, 2003;
Wang et al., 2004; Salomon et al., 2006; Hautecoeur and
*Corresponding author (email: liuqiang@bnu.edu.cn) Roujean, 2007; Susaki et al., 2007; Chen et al., 2008; Liu et
© Science China Press and Springer-Verlag Berlin Heidelberg 2014 earth.scichina.com link.springer.com
574 Peng J J, et al. Sci China Earth Sci April (2015) Vol.58 No.4
al., 2009; Zhang et al., 2010; Román et al., 2011; Cescatti et When both matches are tested and approved, the coarse-
al., 2012; Wang et al., 2012). However, because of the scale resolution product is validated. The advantage of this
discrepancy between point-scale in situ measurements and method is the introduction of the high-resolution albedo
pixel-scale remote sensing observations, the errors caused information. Consequently, the validation results are af-
by different comparison scales greatly affect albedo product fected by the high-resolution albedo uncertainties.
validation. Upscaling field measurements from the point Therefore, although the reference values approximate the
scale to the pixel scale is a challenge in CAL/VAL activities ground truth, the errors in the reference values, which is due
(Cohen and Justice, 1999; Barnsley et al., 2000; Lucht et al., to uncertainties in the validation process and the reference
2000; Liang et al., 2002; Jin, 2003; Susaki et al., 2007; data source, cannot be overlooked. The three main steps of
Roman et al., 2013; Wang et al., 2014). the uncertainty analysis include the following: the identifi-
Three common approaches are taken to reduce scaling cation of all uncertainty sources, uncertainty modeling and
errors. One approach is to set validation sites within homo- uncertainty propagation (Crosetto and Tarantola, 2001).
geneous areas. In this case, surface measurements with These uncertainties come from intrinsic errors within in situ
small instantaneous fields of view (IFOVs) are able to rep- measurements and from external errors caused by naviga-
resent the footprint of coarse-resolution pixels (Liang et al., tion or registration, inaccurate atmospheric correction, and
2002; Wang et al., 2004; Zhang et al., 2010). Previous stud- scale conversion (Liang et al., 2002; Wang et al., 2004;
ies have employed direct “point-to-pixel” comparisons in Buriez et al., 2007; Zhang et al., 2010). The uncertainty
these circumstances (Hautecœur and Leroy, 1998; Barnsley involved in remote sensing products has a significant effect
et al., 2000; Jin, 2003; Salomon et al., 2006; Chen et al., on the accuracy of the modeling and the analysis of
2008; Rutan et al., 2009). Moreover, Susaki et al. (2007) land-surface systems (Li and Wang, 2013; Li, 2014). These
demonstrated that differences in the albedo spatial resolu- uncertainties can result in an overestimation of the error of
tion have negligible effects when the measurement sites can the albedo product (Liang et al., 2002; Wang et al., 2004).
be assumed to be homogeneous. However, completely ho- The absence of uncertainty assessments restricts the appli-
mogeneous areas at the scale of coarse-resolution pixels are cation of multi-scale validation strategies in many ways. For
limited. Another approach is to choose those measurements example, the first match might not be satisfied because of
in which the IFOV is representative of the satellite pixel the limited accuracy of the high-resolution product. With
footprint (Barnsley et al., 2000; Román et al., 2009; Román regard to the second match, the large uncertainty in the ref-
et al., 2011; Cescatti et al., 2012; Wang et al., 2012); these erence value of certain pixels might lead to an exaggerated
measurements are usually gathered from the tops of towers assessment of the satellite product error.
of sufficient height. The representativeness of tower meas- The current study systematically assesses the uncertain-
urements is assessed by analyzing the spatial variation in ties in the reference values for each pixel and designs a
the vicinity of the tower (Lucht et al., 2000; Román et al., multi-scale validation strategy that minimizes uncertainties
2009). Given that only a few field sites qualify, that these and their influence on the validation results. The validation
sites are not evenly distributed on the global scale, and that results are presented with a discussion of the effect of the
they cannot cover all land types, this validation approach is uncertainty control strategy.
limited (Roman et al., 2013).
The third approach, which utilizes high-resolution, re-
motely sensed imagery to upscale the point-scale measure- 1 Methodology
ments to coarse resolutions (Liang et al., 2002; Wang et al.,
2004), is applicable for more heterogeneous areas. The ear- The framework for the multi-scale validation of the coarse-
liest prototype of this method used high-resolution images resolution albedo products is shown in Figure 1. Briefly,
to derive the fractional ground cover of different scene ele- three major steps are involved: (1) collecting the in situ
ments and assigned typical albedos to each scene element. measurements; (2) calibrating the high-resolution albedo
The coarse-resolution albedo is subsequently predicted us- maps with the in situ measurements; and (3) assessing the
ing a linear mixture model. The limitations of this approach uncertainty level of each coarse-resolution pixel using the
include the effects of land-cover classification errors and the co-area high-resolution pixels. Using this framework, sev-
representativeness of the albedo values (Barnsley et al., eral procedures are designed to control the uncertainties in
2000; Lucht et al., 2000). Liang improved the inversion the validation based on the analysis of the uncertainty sources
method for high-resolution albedo and directly used the data and their propagation. For the in situ measurements, a sam-
as the upscaling bridge (Liang et al., 2002). This multi-scale pling scheme is employed to catch the heterogeneity on
validation procedure was summarized by Zhang (Zhang et both the 30 m and the 1 km scales. Each coarse-resolution
al., 2010) as performing “two matches”: first, the in situ pixel is scored according to its total uncertainty resulting
measurements are matched with the high-resolution remote from geometric misalignment and nonlinearity in the albedo
sensing products; then, the high-resolution remote sensing upscaling. Then, the candidate pixels with acceptable un-
products are matched with the coarse-resolution product. certainty are used in the validation of the albedo products.
Peng J J, et al. Sci China Earth Sci April (2015) Vol.58 No.4 575
Figure 1 The proposed multi-validation procedures for the coarse-resolution albedo products. The solid-color boxes identify the steps that might introduce
uncertainties into the validation, and the gradient-filled boxes identify the solutions to the uncertainties that result from the previous step.
1.1 Uncertainties in the validation and their assessment pose, field measurements are referenced to calibrate the bias
in high-resolution albedo products.
1.1.1 Uncertainty sources and propagation Scale effects and geometric mismatches between two
The key issue in validating satellite albedo products is esti- images introduce uncertainty in the upscaling process. As
mating their reference values at the pixel scale. Using the Wu and Li (2009) summarized, scale effects “refer to the
multi-scale validation framework, the reference value is the contrast of information or the different characteristics at
aggregated co-area high-resolution albedo. However, a ref- different scales”, and their primary causes are surface het-
erence value might not always be a satisfactory approxima- erogeneity and the linearity/nonlinearity of the retrieving
tion of the true surface albedo because of the uncertainties algorithms. In this context, the uncertainty caused by the
in the validation procedure (Figure 2). scale effect is the combined result of spatial heterogeneity
Uncertainty originates from both the data source and the and the retrieval model. As previous studies have revealed,
validation process. In terms of data, both field measure- the linearity/non-linearity of the retrieval model is important
ments and high-resolution albedo maps are subject to errors. for scale effects. Albedo is usually retrieved using a linear
The errors within in situ measurements results from imper- model. However, even a linear model can result in a scale
fect instruments, inappropriate operations, and insufficient effect when non-uniform illumination (shading or sheltering)
samples. Conversely, proper instruments, strict operation or multiple scattering (multiple collisions between light rays
protocols, and reasonable sampling schemes reduce field and the in situ surface) is involved because these effects
measurement uncertainties. The errors in the high-resolution change the amount of reflected radiation. Non-uniform il-
albedo products originate from instrumental limitations, lumination incurs a scale effect only if intra-pixel heteroge-
radiometric calibrations, geometric mismatches, atmospheric neity exists, whereas multiple scattering incurs a scale effect
corrections, and retrieval algorithms. The data errors in- even with a uniform surface (Li et al., 2000). Topology is
clude bias and random errors. Field measurement bias can the primary cause for non-uniform illumination and multi-
be reduced by proper instrument adjustment prior to use and ple scattering between 30 m and 1 km (Wen et al., 2009).
careful operation, whereas random errors in field measure- In contrast, the uncertainty from geometric mismatching
ments can be reduced with repeated measurements. Random is independent of retrieval algorithms. Two types of geo-
errors in high-resolution albedo products are reduced during metric mismatching exist: registration error, which results
the upscaling (i.e., averaging) process, whereas bias is pre- from incorrect operations and is beyond the scope of this
served. Therefore, bias in high-resolution albedo products paper, and intrinsic uncertainty, which cannot be avoided.
should be corrected for as much as possible. For this pur- Because the basic unit of a remote sensing image is the pixel,
576 Peng J J, et al. Sci China Earth Sci April (2015) Vol.58 No.4
Figure 2 Illustration of the predominant uncertainty sources and their contribution to the total uncertainty in a reference value. The left boxes list the main
sources of uncertainty in the validation. After the processing steps shown in the intermediate boxes, these uncertainty sources add up to the total uncertainty
shown in the box on the right.
and resampling occurs several times in albedo product gen- (2)–(5) present the detailed calculation of each item:
eration, it is difficult to improve the sub-pixel registration
accuracy of a coarse-resolution pixel (Tan et al., 2006). grd
2
grd
2
bgrd
2
, (2)
Therefore, this paper considers sub-pixel geometric mis- n
matching to be an intrinsic feature of remote sensing albedo
products. The uncertainty caused by geometric mismatching high
2
high
2
high
2
, (3)
directly adds to the final total uncertainty, whereas the other n m
uncertainties are increased or decreased after upscaling.
gm
2
2
2
gm
2
gm1 , (4)
1.1.2 Uncertainties in the validation and their assessment n
The aforementioned uncertainties affect the accuracy of the 2
reference values. The validation strategy reduces the uncer- scale
2
(t1 h2 t2 ) f topo . (5)
tainties as much as possible and assesses the residual uncer-
tainty. Therefore, the uncertainty propagation is process- In eq. (2), grd
2
is composed of the bias in the in situ
based instead of model-based. Because the uncertainty sources 2
measurements bgrd and the random noise in the in situ
are independent, summing the squared uncertainties of dif-
ferent sources and mechanisms is a practical method for measurements grd
2
. If the appropriate protocol is followed
obtaining the final uncertainty in the reference values. Eq. 2
to collect the measurements, bgrd is typically small. The
(1) is proposed to conceptually represent the sources and
propagation of uncertainties as well as to estimate the total effect of grd
2
should be weakened due to repeated sam-
uncertainty in a reference value: pling. Moreover, n is the number of samples used in the
calibration of the high-resolution albedo data.
tot
2
grd
2
high
2
+ gm
2
scale
2
, (1)
In eq. (3), high
2
primarily originates from the random
where tot
2
is the uncertainty in the reference albedo value noise in the high-resolution albedo high
2
, which is weak-
for each coarse-resolution pixel calculated from the up- ened by the two-stage upscaling. The question about bias in
scaled high-resolution albedo. The four items on the right the original high-resolution albedo resurfaces due to eq. (3).
side of the equation estimate the uncertainty derived from However, by calibrating the high-resolution albedo with the
the in situ measurements, the high-resolution albedo image, in situ measurements, the bias in the high-resolution albedo
the geometric matching and upscaling, respectively. Eqs. is eliminated. Moreover, the uncertainty in the in situ meas-
Peng J J, et al. Sci China Earth Sci April (2015) Vol.58 No.4 577
urements is transferred into the calibrated high-resolution values in a high-resolution albedo map. The Gaussian and
albedo product. The uncertainty in the high-resolution al- triangular distributions are used to describe the spatial re-
bedo that is calibrated with the in situ measurements is as sponse characteristics of the MODIS reflectance products in
follows: previous studies (Huang et al., 2002; Tan et al., 2006). Un-
der an ideal hypothesis, the spatial response characteristics
grd
2
high
2
gm
2
Figure 3 An illustration of the templates and location shifts used to assess geometric processing uncertainty. The red boxes on the left represent the cov-
ered surface area of a nominal pixel in the 1-km-resolution albedo product, and the black dashed boxes indicate the actual covered area of the physical pa-
rameter.
of VALERI, in which two-stage elementary sampling units 1.2.2 Calibration of the high-resolution albedo
(ESU) were positioned to capture the land-cover character- As Section 2.1.1 explained, the bias in the high-resolution
istics within the research area. The elementary sampling albedo values results from instrument limitations, radio-
unit is referred to as an experiment site, which corresponds metric calibrations, geometric mismatches, and atmospheric
to the coarse-resolution pixel scale. The second-stage sam- corrections. Therefore, it must be calibrated with in situ
pling unit is called a quadrat, which corresponds to the high- measurements. Because the number of field measurements
resolution pixel scale. within a particular site is limited, to increase the stability of
Each experiment site covers at least 2×2 coarse-reso- the calibration, a one-parameter calibration equation is adopted.
lution albedo pixels. This minimum size ensures that the That is, an offset is applied to the entire high-resolution
low-resolution pixels are completely within the experiment albedo map for a particular date, which is estimated using
area given that the maximum geometric displacement is less the average difference between the blue-sky albedo ex-
than 0.5 pixels (Liang et al., 2002). Then, multiple quadrats tracted from the high-resolution albedo map and the in situ
are positioned to capture the variability across each experi- albedo.
ment site. The number of quadrats depends on the site het-
n
erogeneity. It is suggested that at least one quadrat is placed
within each land-cover type in the site (Morisette et al., ( qt (i) hq (i))
C i 1
, (8)
2006). Each quadrat covers at least 2×2 high-resolution n
albedo pixels and multiple measurements are acquired within
a quadrat to capture the variability of the central high-reso- where C is the calibration offset, qt is the averaged quadrat
lution pixel. Because the albedo changes with the solar zen- albedo, hq is the high-resolution albedo that corresponds to
ith angle, the sampling scheme configuration must comprise each quadrat, and n is the number of quadrats within the
between the sampling number and the time cost. site.
Peng J J, et al. Sci China Earth Sci April (2015) Vol.58 No.4 579
1.2.3 Pixel uncertainty rating HJ-1A/B are the first two satellites of the Environment
When validating the coarse-resolution albedo product, it is and Disasters Monitoring Microsatellite Constellation laun-
recommended that only pixels with small geometric mis- ched by China to achieve large-area, all-weather, continuous,
matching, gm1, and scaling uncertainty, scale, be used to and dynamic monitoring of the environment and natural
judge the accuracy of the albedo product. Using the estima- disasters (free download from http://218.247.138.121/
tion method introduced in Section 2.1.2, gm1 and scale are DSSPlatform/index.html). The HJ CCD cameras obtain
calculated for each coarse-resolution pixel. The pixels with 4-band images with a 30 m spatial resolution and a revisit-
a local (3×3 pixel) minimum for gm1 and scale values of less ing circle of less than 2 days. Its high spatial and temporal
than 3% are considered as Class B pixels. Moreover, the resolution makes it an acceptable candidate for the upscal-
pixels for each experiment site are assigned as Class A pix- ing bridge in the validation, helping to minimize the error
els. The remained pixels are classified as Class C pixels. caused by the scale discrepancy. The HJ images were at-
Validation using Class A pixels is similar to the traditional mospherically corrected using the 6S radiative transfer
direct validation method, in which the site average albedo is model with synchronously measured atmosphere parameters
compared with the coarse-resolution albedo product of the that were obtained from a sun-photometer (Sun et al., 2012)
pixel nearest to the center of the site. An alternative option and geo-rectified based on geo-referenced SPOT images
is validation with Class B pixels, in which the validation provided by the Watershed allied telemetry experimental
scope is broadened to an extensive area surrounding the research (WATER) experimental database. However, the HJ
experiment site. Validation with Class C pixels is not rec- CCD sensor has a lower signal-to-noise ratio (SNR) and
ommended due to their significant uncertainty, especially fewer spectral channels than coarse-resolution sensors (e.g.,
when the nonlinearity in the albedo upscaling process has MODIS). Therefore, the accuracy of the HJ albedo map
not been addressed. must be improved by calibration using in situ measurements
before the proper validation of the coarse-resolution albedo
product can be conducted.
2 A case study in the Heihe River area Because the HJ CCD is incapable of providing adequate
multi-angle observations for the albedo retrieval algorithms
2.1 Study area and data description based on the BRDF model inversion, the AB algorithm (the
primary algorithm used to generate the GLASS albedo
2.1.1 Albedo products product) is applied to the HJ albedo retrieval (Sun et al.,
Two global, 1 km albedo products (MCD43B3 and GLASS- 2013). In using the AB algorithm, modifications are made
02A06) are assessed in a validation attempt. The MCD43B3 to adjust the specifications of the HJ-1A/B CCD sensor (Li
albedo product is generated using the MODLAND (MODIS et al., 2000). The details of the AB algorithm can be found
Land) research team of the National Aeronautics and Space in (Qu et al., 2013) The regression coefficients that corre-
Administration (NASA; free download from http://reverb. spond to the surface reflectance values are used in this study
echo.nasa.gov/reverb/). The primary algorithm of this product because the synchronously measured atmosphere parame-
includes an inversion of the Ross-Thick/Li-Sparse-Recip- ters are available and a relatively accurate atmosphere cor-
rocal (RTLSR)-kernel-driven bidirectional reflectance dis- rection is expected. The HJ albedo calibrated using in situ
tribution function (BRDF) model with combined MODIS/ measurements is denoted by the CHJ albedo below.
Terra+Aqua observations over a 16-day window. This algo- To validate the satellite-derive albedo products, including
rithm derives a narrowband albedo via kernel integration the MCD43B3, GLASS02A06 and HJ albedo, the black-sky
and the narrowband-to-broadband conversion (Nightingale albedo and white-sky albedo are combined into the blue-sky
et al., 2008); it has a spatial resolution of 1 km and a tem- albedo using the measured sky-light ratio.
poral resolution of 8 days.
GLASS02A06 (free download from http://glass.bnu. 2.1.2 The in situ albedo
edu.cn/index.html) is the first version of the global 1 km A test of this validation strategy was conducted from July to
albedo product generated by GLASS, a research project August 2011 in the Heihe River Basin (37.7°–42.7°N,
conducted by the National High Technology Research and 97.1°–102.0°E), which is a typical inland river basin in
Development Program of China . The product is derived northwestern China (Li et al., 2013). The landscapes in this
from combined MODIS/Terra+Aqua data at a 1 km spatial area are diverse; they include mountains, forests, steppes,
resolution and an 8-day temporal resolution. The primary oases, and the Gobi desert. Ten experimental sites were
algorithm includes two parts: First, the daily shortwave al- chosen, distributed over the middle and lower reaches of the
bedo is estimated using the angular bin (AB) direct estima- basin. The sites contain various land cover types including
tion algorithm (Qu et al., 2013); then, the daily albedo data desert, oasis, sparse grassland, Gobi, and alkali, and each
are post-processed with a statistics-based temporal filtering one covered an area of at least 3 km×3 km. The sites are
(STF) algorithm to fill gaps and reduce noise (Liu et al., listed in Table 1 and Figure 4. The experiment was con-
2012). ducted for 36 days, including 13 days of measurements (one
580 Peng J J, et al. Sci China Earth Sci April (2015) Vol.58 No.4
Station name Station ID Location Land-cover type Measurement date Sampling scheme (Figure 6) Number of quadrats
38.764°N, July 29,
Huazhaizi HZZ_D Sparse grass a 9
100.317°E August 8, 27
38.740°N,
Dangzhai (A) DZ_D Desert July 31 b 6
100.558°E
38.841°N,
Dangzhai (B) DZ_F Farmland July 30 - 6
100.478°E
42.067°N,
Ejin Banner (A) EBA_G Gobi August 2 a 9
100.913°E
42.377°N,
Ejin Banner (B) EBB_G Gobi August 3 a 9
101.148°E
42.209°N,
Ejin Banner (C) EBC_A Alkali August 5 a 9
100.712°E
41.608°N,
Black City BC_G Gobi August 6 b 5
100.920°E
38.925°N,
Baji BJ_D Sparse grass August 9 a 9
100.260°E
38.715°N,
Heping County HPC_D Desert August 25 b 5
100.472°E
38.751°N,
Zhangye Airport AP_D Sparse grass August 22, 28 b 5
100.701°E
Figure 4 The surface albedo measurement sites in the Heihe River Basin. The left map shows the spatial distribution of the experimental sites; the photos
on the right were taken at the experimental sites covering various land-cover types.
or two sites per day); the remaining days had unsuitable site (Figure 6(a)), except for differences in the number of
observation conditions (rain or thick clouds; Figure 5). quadrats due to disparate environmental conditions across
Field measurements were collected in 3 km×3 km quad- several measurement sites (Table 1). For instance, because
rats (Q1–Q9) that were uniformly distributed within each the Dangzhai desert is more homogeneous than the other
Peng J J, et al. Sci China Earth Sci April (2015) Vol.58 No.4 581
(a) sampling scheme, one team sampled along the left route,
passing through four quadrats (1-4-7-8, Figure 6(a)), and
one sampled along the right route with the same workload
(3-6-9-5, Figure 6(a)). The observation process usually
lasted 3–4 h at each site, based on the satellite pass time. To
inspect the variance of the albedo during this period, a
CNR4 net radiometer was fixed at a point in Quadrat 2 to
obtain a successive record of the radiant fluxes and albedo
synchronous to the CMP6 measurements. This information
was used to evaluate the effect of the solar zenith angle on
the albedo measurements. The albedo of the experiment
sites in the desert and Gobi areas tended to vary by less than
2% throughout the observation times (usually between 10
am and 3 pm). This variation is one cause of the random
noise within in situ measurements.
The measurement at each point began approximately 20 s
after setup to enable a steady sensor reading. To diminish
possible instrumentation defects, measurements were re-
peated 6 times at each point; then, the two pyranometers
Figure 6 Two types of sampling schemes. placed in a group were exchanged, and another 6 measure-
ments were recorded at the same point. Because of the co-
sine response of the sensor, the height of the albedometer
measurement sites, six quadrats were observed there on July above the surface determines the footprint of the surface
31, 2011. Because of cloudy weather on August 25, 2011, albedo (Cescatti et al., 2012). In our experiment, 90% of the
five quadrats were measured when clouds did not obscure measured radiation originated from a circular area with a
the sun (Figure 6(b)). In addition, the Dangzhai farmland diameter of 7.8 m. The in situ albedo was calculated using
site contained several types of crops; thus, the quadrats were the ratio of upwelling and downwelling radiation. Because
divided by each crop type rather than being uniformly dis- the scale difference between the in situ measurements (ap-
tributed. The area of each sampling quadrat was 60 m×60 m, proximately 7.8 m) and the corresponding HJ pixels (30 m)
which is four times larger than a 30 m×30 m high-resolution was small, the average of the measured albedos at four
pixel. Four sampling points (P1–P4) were set within each sampling points in a quadrat was calculated as the “true
quadrat at intervals of 40 m (Figure 6) to capture the heter- albedo” of the quadrat.
ogeneity within the quadrat.
The upwelling and downwelling radiation fluxes were 2.2 Multi-scale validation results
measured with Kipp and Zonen CMP6 shortwave pyranom-
eters and a CNR4 net radiometer (http://www.kippzonen. 2.2.1 In situ albedo and HJ albedo
com). These instruments were leveled for a minimum view- For the corrected HJ albedo, Figure 7 presents a scatter dia-
ing angle before each measurement. Two CMP6 pyranome- gram of the absolute difference in the pixel-scale HJ albedo
ters were placed in a group to measure upward/downward from the quadrat-measured albedo and the relative deviation
radiation simultaneously. The CNR4 net radiometer ob- (standard deviation divided by the average) of samples
tained both upward and downward radiation measurements. within each quadrat. These quantities are positively corre-
Two teams sampled the quadrats simultaneously. In the lated (R2=0.7005), which indicates that inconsistencies
582 Peng J J, et al. Sci China Earth Sci April (2015) Vol.58 No.4
Figure 8 Comparisons between the HJ albedo and field measurements. Each diagram shows the sampled HJ albedo from one image and the corresponding
in situ measurements collected from one site; the date is noted at the bottom of each diagram. Quadrat 0 was measured using a CNR4, whereas the other
quadrats were measured using two CMP6.
To understand the significance of correcting the HJ al- Therefore, the error is three times greater without calibra-
bedo map using in situ measurements, we recall eq. (6). tion, and the bias uncertainty is significantly reduced using
Here, bgrd is assumed to be zero, and the root of this calibration procedure.
grd
2
h2 gm1
2
can be estimated using the RMSE between Figure 12 demonstrates the composition of the uncer-
tainty in the upscaled albedo of the different classes of pix-
the CHJ albedo and the measured albedo of the quadrats
els in the validation results from August 28, 2011. This fig-
(Figure 9(b)). Using the results from August 28, 2011 as an
ure shows that the calibrated uncertainty accounted for a
example, c high is approximately 5.871×103, but this
large proportion of the total uncertainty. The other uncer-
value would have been 1.765×102 if the step of calibrating tainty elements due to Class A and Class B pixels are obvi-
the HJ albedo with the in situ measurements was skipped. ously smaller than those associated with Class C pixels.
584
Peng J J, et al.
Sci China Earth Sci
April (2015) Vol.58 No.4
Figure 9 Illustration of error reduced by the calibration of HJ albedo. (a) The error between the HJ and surface-measured albedos; (b) the error between the calibrated HJ and surface-measured albedos.
Each CMP6 quadrat was measured with a CMP6 at four uniformly distributed points. The CNR4 quadrat was measured with a CNR4 at the fixed central point. The average error was calculated from all of
the quadrats’ measurements within a particular site. (a) shows that the average error (the dark, filled diamonds) of the HJ albedo is less than or equal to 0.0206. The corrected HJ albedo is closer to the in situ
measurements than the original HJ albedo (b).
Peng J J, et al. Sci China Earth Sci April (2015) Vol.58 No.4 585
Figure 10 The distribution of Class A and Class B pixels and two main
With regard to Class A pixels, this effect is due to the flat-
kinds of uncertainty. (a) Class A and Class B coarse-resolution pixels dis- ness and uniformity of the selected measurement sites. With
played on a HJ albedo image; (b) the distribution of geometric mismatch- regard to Class B pixels, this effect is attributed to the con-
ing uncertainty gm 2 , (c) the distribution of scaling uncertainty scale . trol of uncertainty from the pixel uncertainty rating. Clearly,
586 Peng J J, et al. Sci China Earth Sci April (2015) Vol.58 No.4
Table 3 Summary statistics of the validation for the pixels of different classes
GLASS02A06 MCD43B3
Pixel set Sample number
RMSE R2 Bias RMSE R2 Bias
Class A 64 0.0105 0.9235 0.008 0.0123 0.9294 0.0103
Class B 797 0.0185 0.7774 0.0092 0.0216 0.7582 0.0127
Class C 24675 0.0366 0.5238 0.0143 0.0397 0.4874 0.0181
Table 4 The RMSE between the coarse-resolution albedo and the corresponding upscaled CHJ albedo, calculated for three pixel classes
Table 5 The R2 between the coarse-resolution albedo and the corresponding upscaled CHJ albedo, calculated for three pixel classes
the proportions of gm1 and scale are small for both Class
A and B pixels but large for Class C pixels.
The RMSE between the coarse-resolution albedo product
and the reference albedo both contained uncertainties; thus,
the RMSE was denoted the “apparent RMSE”, which usu-
ally overestimates the error in the product. As the validation
result for the Class B pixels shows, the apparent RMSEs for
the MCD43B3 and GLASS02A06 datasets are 0.0216 and
0.0185, respectively, in which the uncertainty of the refer-
ence albedo is as large as 0.0136 (Figure 12). The uncer-
tainty associated with the reference albedo, and not the real
error of the albedo product, dominates the apparent RMSE.
When the Class C pixels are used, the RMSE increased by
0.0181 (0.0397 minus 0.0216) for the MCD43B3 and
0.0181 (0.0366 minus 0.0185) for the GLASS02A06 com-
pared with the Class B pixels. This increase in RMSE is
similar to the increase in uncertainty of 0.0131 (0.0385 mi-
Figure 12 The composition of uncertainty in the upscaled 1 km HJ albe- nus 0.0254). This result shows that evaluating the real error
do. Within the uncertainty of the original HJ albedo, the shaded segment
denotes the proportion that was calibrated via comparison with the in situ of the coarse-resolution albedo products using Class C pix-
measurements; the left section was transferred to the CHJ albedo. els is impossible.
Peng J J, et al. Sci China Earth Sci April (2015) Vol.58 No.4 587
ments. Remote Sens Environ, 115: 2184–2203 Tan B, Woodcock C, Hu J, et al. 2006. The impact of gridding artifacts on
Román M O, Schaaf C B, Woodcock C E, et al. 2009. The MODIS (Col- the local spatial properties of MODIS data: Implications for validation,
lection V005) BRDF/albedo product: Assessment of spatial representa- compositing, and band-to-band registration across resolutions. Remote
tiveness over forested landscapes. Remote Sens Environ, 113: 2476– Sens Environ, 105: 98–114
2498 Wang K, Liang S, Schaaf C L, et al. 2010. Evaluation of moderate resolu-
Roman M O, Gatebe C K, Shuai Y, et al. 2013. Use of in situ and airborne tion imaging spectroradiometer land surface visible and shortwave al-
multiangle data to assess MODIS-and Landsat-based estimates of di- bedo products at FLUXNET sites. J Geophys Res (Atmospheres), 115:
rectional reflectance and albedo. IEEE Trans Geosci Remote Sens, 51: D17107
1393–1404 Wang K, Liu J, Zhou X, et al. 2004. Validation of the MODIS global land
Rutan D, Rose F, Roman M, et al. 2009. Development and assessment of surface albedo product using ground measurements in a semidesert re-
broadband surface albedo from Clouds and the Earth’s radiant energy gion on the Tibetan Plateau. J Geophys Res, 109: D05107
system clouds and radiation swath data product. J Geophys Res, 114: Wang Z, Schaaf C B, Chopping M J, et al. 2012. Evaluation of moder-
1–19 ate-resolution imaging spectroradiometer (MODIS) snow albedo prod-
Salomon J G, Schaaf C B, Strahler A H, et al. 2006. Validation of the uct (MCD43A) over tundra. Remote Sens Environ, 117: 264–280
MODIS bidirectional reflectance distribution function and albedo re- Wang Z, Schaaf C B, Strahler A H, et al. 2014. Evaluation of MODIS
trievals using combined observations from the aqua and terra platforms. albedo product (MCD43A) over grassland, agriculture and forest sur-
IEEE Trans Geosci Remote Sens, 44: 1555–1565 face types during dormant and snow-covered periods. Remote Sens En-
Schaaf C B, Gao F, Strahler A H, et al. 2002. First operational BRDF, viron, 140: 60–77
albedo nadir reflectance products from MODIS. Remote Sens Environ, Wen J, Liu Q, Xiao Q, et al. 2009. Scale effect and scale correction of land-
83: 135–148 surface albedo in rugged terrain. Int J Remote Sens, 30: 5397–5420
Sun C, Liu Q, Wen J. 2013. An algorithm for retrieving land surface albe- Wolfe R E, Nishihama M, Fleig A J, et al. 2002. Achieving sub-pixel geo-
do from HJ-1 CCD data. Remote Sens Land Resour, 25: 58–63 location accuracy in support of MODIS land science. Remote Sens En-
Sun C, Sun L, Ma S, et al. 2012. Atmospheric correction method based on viron, 83: 31–49
HJ-1 CCD data (in Chinese). J Remote Sens, 16: 826–836 Wu H, Li Z L. 2009. Scale issues in remote sensing: A review on analysis,
Susaki J, Yasuoka Y, Kajiwara K, et al. 2007. Validation of MODIS albe- processing and modeling. Sensors, 9: 1768–1793
do products of paddy fields in Japan. IEEE Trans Geosci Remote Sens, Zhang R, Tian J, Li Z, et al. 2010. Principles and methods for the validation
45: 206–217 of quantitative remote sensing products. Sci China Earth Sci, 53: 741–751