Ecological Modelling 81 (1995) 3-29

Validity of agroecosystem models

A comparison of results of different models applied to the same
data set
B. Diekkriiger av , D. Sijndgerath a, KC. Kersebaum b, C.W. McVoy a
l

a Institut fir Geographicund Getikologie, Lunger Kamp NC, 38106 Brat.uwhwi~, Gwmuny
b Zentrum fir Agrarlandschafts-urtd Landnutzungs.forschcmgCALF), 15374 Miinc~, Gmnany

Abstract

The simulation resultsobtainedfrom 19 participantsof the workshop“Validation of AgmecosystemModels”

werecomparedanddiscussed.Althoughail modelswereappliedto the samedataset,the resultsdiffer significantly.
From the results it can be concludedthat the experienceof a scientistapplyinga model is as important as the
differencesbetweenvariousmodel approaches.Only one model simulatedall main processeslike water dynamics,
plant growthand nitrogendynamicswith the samequality, the othersare ableto reproducethe measureddynamic
only in parts.

Keywo&; Agricultural ecosystems;

Validation

1. Introduction After developing a model it is commonly applied

Simulation models have been developed for
decades. Considering the amount of published
models it seems that it is much easier to develop
a new model than verifying or validating existing
computer codes. This is mainly due to the fact
that laboratory and field measurements necessary
for model verification are expensiveand that it is
easier to obtain money for model development
than for experiments. The other reason is that
not all models are in the public domain and
therefore are not accessible for potential users.
l Corresponding
author.
to a limited number of simulation periods or
simulation sites, often the same sites on which
the model was developed. In this case it can be
expected that modelcalibrationandvalidationis
successful.
Testing a model on an independent data set is
often not possible becauseusually those data are
not available, unpublished, or not documented.
Stimulated by a former model comparison(de
WiIligen, 1991)the idea was to provide modeAers
with a data set which covers the processeswater
dynamics, nitrogen dynamics, plant growth and
pesticide dynamics. These data were collected by
members of the Collaborative Research Program
(CRP) 179 “Water and Matter Dynamics in
Agro-Ecosystems” which was established in Jan-

0304-3800/95/$09,50 Co1995 Elsevier ScienceB.V. Ail rights reserved

SSDI 0304-3800(94)00157-X
4 Il. Diekkfiispr el al. /Ecological Mudelling 81 (1995) 3-29

uary 1986 at the Technical University of Braun-
schweig, Germany, by the Deutsche Forschungs-
gemeinschaft (German Research Society).
The main objective of this long-term program
is the analysis and forecasting of effects which
farming and natural properties of specific sites
have on enerm fluxes, water fluxes, matter dy-
namics, microclimate and soil organisms. The dif-
ferentiation of water and matter dynamics in
space and time is analyzed. The atmosphere, the
soil surface, the saturated and the unsaturated
zones of the soif are the main compartments to
be analyzed. Therefore all investigations are fo-
cused on the soil.
The field research is carried out in the
Krummbach catchment near Neuenkirchen, and
in the Eisenbach catchment near Nienwohlde in
Southern and Eastern Lower Saxony. In both
catchments intensive measurement sites were es-
tablished on which all data necessaryfor model
development and validation like soil properties,
water content, soil suction, nutrient content, pes-
ticide concentration were coIlected. These data
were provided by the Institute of Geography and
Geoecologyof the Technical University of Braun-
schweig. Data were available from
- the Intensive Loam Site (IL) for the years
1987-1991,

Table 1
List of processesanalyzed by the participants
No. Author Simulated site and period Water Nitrogen Plant growth Soil temperature Pesticide
.
01 Claus et al., 1995 BS (911, BS, (91) b
02 Frank0 et al., 1995 IL (87-9l);IS (89-911, C + X
IS, @o-91), BS (90-911,
BS, (90-91)
03 Morgenstern and Kloss, 1995 IL (89-91) R -
04 Mirschel et al., 1995 IL (89-911, IS @O-91), c -
IS, (911, BS (911,
BS, (91)
05 Schultz and Mirschel, lY9.5 IL (89,911, BS (911, L + B +
BS, (91)
06 Kersebaum, 1995 IL (89-911, IS (89-91) c + B
07 Botterweg, 1995 IL (89-91) R -
08 Blombiick et al., 1995 IL (89,91) R + B
09 Bacsiand Zemankovics, 1995 IL t89,91), BS (911, c - B
BS, (91)
10 Smith, 1995 IL (87-91) R -I-
11 Jarvis, 1995 IL (87-91) R -
12 Grant, 1995 IS (90-91) R +
13 Vanclooster et al., 1995 IL (89-911, IS (89-91) R +
14 Svendsenet al., 1995 fL (89-911, IS (X9-91) R +
15 Schaaf et al., 1995 IL (89,911,BS (91), c +
BS, (91)
16 Schriider et al., 1995 IL (89,911,BS (911, (R)cf. (+I B -
No. 17
BS, (91)
17 Diekkriiger and Aming, 1995 IL (89-91). IS (89-91) R - X
18 Diekkriiger et al., 1995 IL (87-88) IR)cf. - X
No.17
19 Whitmorc, 1995 IL (89-91), IS (89-911, C + B
BS (911, BS, (91)
IL = Intensive Loam site, IS = Intensive Sand site, BS = Bockschlag, subscript r = reduced fertilization, C = Cascade model,
R = Richards equation, L = one layer model, b = simulation of plant development without biomass, B = simulation of plant
development including biomass, x = simple description of plant development, 0 used but not reported, * only evapotranspiration
computed.
 B. Diekkriiger et al. /Ecological
- the Intensive Sand Site (IS) for the years
1989-1991,
- the Intensive Sand Site with reduced fertiliza-
tion (IS,) for the year 1991,
- a loamy site called “Bockschlag” (BS) for the
year 1991,and
- a loamy site called “Bockschlag” with reduced
fertilization (BS,) for the year 1991,
A detailed description of the data set is given
in this issue by McVoy et al. (1995). In this paper
we will compare and discuss the model results.
For this comparison the participants were asked
to prepare model outputs in a given format, Be-
cause not every datum could be discussed and
du.e to the dynamics of the processesinvolved, it
is necessaryto give more information than mean
errors or correlation coefficients. Nevertheless,
evaluation can never be objective. Therefore, it is
recommended that the reader should also study
the other papers of this issue.
2. Model description
In addition to this paper and the description of
the data set, 19 papers deal with model applica-
tion to the data provided by the CRP 179 Table
1 summarizes the names of the authors, the simu-
lation sites and periods, and the processes ana-
lyzed. In the following we will refer to the num-
bers given in Table 1. Nearly all participants
simulated the Intensive Loam Site except [Oil
who analyzed only the Bockschlag and [12] who
investigated the Intensive Sand Site.
Each model is described by the authors.
Therefore, in this paper only a brief summary of
the simulated processesis given.
2.1. Water dynamics
Except [Ol] who simulated only evapotranspi-
ration, all participants computed water fluxes in
the soil. Eleven participants solved Richards’
equation for water transport, six participants used
cascade models. Because the model of [OS]con-
siders the root zone as one layer, the simulated
water contents cannot be compared with the re-
sults of the others.
Modding Xl (1995) 3-29 5
For Richards’ equation, information on the
retention curve and the hydraulic conductivity
curve are obligatory. Because hydraulic conduc-
tivities were not available, the participants had
either to calibrate the model or to estimate the
conductivities from basic soil properties. Differ-
ent approachescan be found in the papers.
Because good comparison between simulated
and measured water contents does not imply that
the water fluxes are correct, computed percola-
tion and evapotranspiration will also be dis-
cussed.
2.2. Nitrogen
Apart from their differences describing water
dynamics and N uptake by plants, which may
have an important influence on the results of soil
mineral nitrogen, the participating models vary
also in their complexity to simulate the nitrogen
transformations in the soil. Approaches for nitro-
gen mineralization/immobilization differ mostly
in their way to separate the organic nitrogen into
different fractions. While most of the models
coupled nitrogen transformations to the carbon
dynamics, the models of [05], [06], and [U] con-
sider only nitrogen. The main effect is that in
those model approacheswhere carbon is included
also net immobilization can occur while the oth-
ers describe net mineralization. The number of
active organic N pools rangesfrom one pool <[05])
to 6 pools ([14)X Microbial biomass is considered
by [12], [ 141and [ 191.Decay of organic pools is
commonly described by first-order kinetics except
for [05] who usesa zero-order kinetic. All models
consider a dependency of the decay coefficients
on temperature and soil water content. The model
of [14] considers additionally the influence of clay
content.
Denitrilkation is considered by all models ex-
cept for [053.The models of [OS]and 1061use only
one pool (nitrate) for mineral nitrogen while all
the others simulate also ammonium. For trans-
port of nitrogen [Ofi], [OS],[121,1131,[141 use the
convecticn-dispersion equation, the others use
only convection ([02] makes some assumptions on
dispersion and [lo] uses onIy numerical disper-
sion). Additionally [13] and 1191reported the con-
sideration of mobile and immobile soil solution.
6 8. Diekktiiger et al. /Ecological ModeIIing 81 (1995) 3-29

Table 2
Results of the plant growth simulation of the Intensive Loam Site. Linear correlation between simulated and measured biomass
above ground (y = ar + 6). R* = coefficient of determination
No. 1989 1990 1991
a b R2 a b R2 a b R2
05 0.99 1142 0.966 1.18 -24 0.937
06 0.88 6% 0.987 0.68 1568 0.975 1.01 166 0.925
OS 1.05 94 0.986 0.99 442 0.985
09 0.78 780 0.939 0.86 354 0.989
10 0.38 3857 0.486 0.67 1390 0.875 0.98 243 0.976
13 1.11 -WI0 0.985 0.71 1205 0.974 1.06 -102 0.946
14 1.06 -248 0.98g 1.01 1084 0.962 1.18 -271 0.952
15 0.74 3629 0.963 1.00 692 0.970
I6 1.01 -17 0.982 1.22 -425 0.955
19 0.87 914 0.961 0.92 1244 0.958 0.87 760 0.977

2.3.Plant namics. Additionally we compare the computed

biomass production and N-uptake with the mea-
For the IL and the IS there are 11participants sured ones.
whichgivemodelsfor plant developmentinclud-
ing biomass,one paperpresentsa modelwithout 2.4. Soil temperature
regardingthe biomassexplicitly(cf. Table11,four
authorsconsideronly a very simple description The simulation of soil temperaturesis re-
e.g.of the leaf areaindexor the rootingdepthin ported in eightof the papers,althoughten of the
order to satisfy the demands of other model participantsappliedmodelswhich alsocalculate
parts. The remaining three papers deal with soil heat flow. Usually simulatedsoil tempera-
biomassor LAI data as input variablesof their tures comparewell with measurements and large
modelswithout makingan attempt to modelthe differences between simulation and measure-
time courses, ments are only observednear the soil surface.
Most of the applied modelsare well estab- Therefore,computedsoil temperatureswere not
lished and have been used in the past by different requested for model comparison. The individual
research groups. The approaches are similar. the results can be found iu the papers indicated in
dry matter production is considered as a function Table 1.
of environmental conditions, e.g. irradiation, tem-
perature, water content, and nutrient supply. Table 3
Apart from [lo], all the other authorsregardthe Results of the plant growth simulation of the Intensive Loam
Site. Linear correlation between simulated and measured leaf
development statusof the plantsadditionally.For area index &Al) (y = ax + 6). R* - coefficient d detertnina-
details of the model approaches the reader is tion
referred to the detailed papers in this issue. No. 1989 1990 1991
In order to comparethe observedand the
a b R’ a b RZ a b R2
simulatedbiomassand L4I we calculateda re-
gressionanalysis.The results(seeTables2 and 3) 06 1.20 0.84 0.840 1.47 1.07 0.792 0.78 2.47 0.437
08 1.01 - 0.18 0.957 0.91 0.50 0.945
of this analysisare the slopeand the interceptof 09 0.52 2.45 0.547 0.47 0.70 0.784
the linearregressionfunctionaswell as the coef- 10 1.07 -0.31 0.955 0.98 0.32 0.838 0.39 2.17 0.219
ficient of determinationwhich givesan impres- 13 1.40 - 1.13 0.938 0.94 0.86 0.868 0.88 0.54 0.936
sion of how good the regression line represents 14 0.39 -2.83 0.301 0.82 0.15 0,924 0.44 2.26 0,356
the data. Theseresultsgivefirst hints to system- 15 0.62 1.58 0.328 0.72 0.70 0.744
16 0.41 3.85 0.357 0.47 3.31 0.464
atic under- or overestimationand of proper dy
 B. Diekkriiger et al. /Ecological
2.5.Pesfkide
Only three ([10],[11],[18]) of all participants
simulatedthe dynamicsof the pesticidesSima-
zine, Metamitron, and Methabenzthiazuron. In
all three papersthe degradationis describedas
first-order kinetic in which the parametersde-
pend on soil temperatureand soil humidity.The
transport of the pesticidesis calculatedby the
classicaiconvection-dispersion equation.
3. Results
Becauseeachmodelproducesan hugeamount
of output it is not possibleto discusseverysingle
result. The participants were askedto provide
- water cOntent at the depths of O-30, 30-60,
60-90 and O-200 cm,
- soil suction at the depths of 15, 45 and 75 cm,
- water fluxesat the depthsof 90 and 200cm,
- potentialandactualevapotranspiration and in-
terception,
- nitrogencontent at the depthsof O-30,30-60
and 60-90 cm,
- net minerafizationand denitrification,
- nitrogenleachingat the depthsof 90 and 200
cm,
- plant biomassaboveand belowground,
- total nitrogenuptakeby plants,
- root water uptake at the depthsO-39, 30-60
and 60-90 cm,
- pesticideconcentrationsat the depth of O-10
cm.
Due to limited numberof pagesonlyresultsof
the IntensiveLoam Site (IL) and the Intensive
Sand Site (IS) were presented here. For all other
information the reader is referred to the original
papers in this issue. Due to the fact that each
participant chose another simulation period, it
wasnecessary
to limit the comparisonto a period
whichwassimulatedby al1participants:
- Water transport: Intensive Loam Site
03/25/89-08/09/89, 04/12/90-12/31/90,
01/01/91-08/03/91; Intensive Sand Site
04/01/90-11/30/91 and
- Nitrogen dynamics: Intensive Loam Site
01/01/89-08/09/89, 03/24/90-10/25/90,
Modeiling 81 (199513-29 7
01/07/91-08/14/91; Intensive Sand Site
04/01/90-11/30/91.
Different statisticmeasurescan be calculated,
e.g. mean squarederror, standard deviation of
the error, correlation between measurement and
simulation. All n&rods suffer from svme draw-
backs:the dynamics involved is considered only in
parts. Therefore, in addition to mean errors and
correlationcoeffkientsthe simulatedtime courses
are describedand discussed.
3.1. intensive loam site
In 1989the comparisonwas restrictedto the
vegetationperiod,in 1990to the beginningof the
vegetationperiod until end of the year. In 1991
the comparisonperiodlastedfkom the beginning
of the year until harvest.Therefore,in 1989as
welt as 1990 the period of replenishment of soil
water wasnot includedin this comparison.Wsu-
ally this is the period in which peraAation and
nitrogen leaching take place.
Although all participants received the same
data set, the model quality can not be evaluated
without providing further information. It is im-
portant to know if a modelwas &&rated using
part of the measuredstate variablesor if the
model parameterswere derived only from the
data set. While[OlJ,[@I],[Osj,[ML [U9L[IO], 1121,
[15], [171and[18] did not calibratetheir modelby
minimizingthe deviationsbetweenmeasuredand
simulatedtime courses,the othersmainlytried to
improvethe simulationof the water dynamicsby
modifyingthe appropriatemodelparameters.Be-
causesoil hydrauliccouductivitieswere not pro-
vided this parameterwas often call&rated.The
calibration procedure and which parameter have
been akered is discussedin the individual papers.
Furthermore, it is important to notice whether
the whole periodwassimulatedwithout interrup-
tion or if onlya part of this period was computed.
While 1021,[03], WI, WI, WI, IlOl, IIlL [131,[141,
[17], [19] calcuIated the entire period of the In-
tensive Loam Site WS9-1990, [OS], [OS], [091
[15], [16] simulated only 1989 and l!Bl. Because
simulation errors may have a lastingeffect and
the winter periodis most importantfor replenish-
ment, percolationand nitrogenleaching,it could
8 [cm31cm~]
0.12 ,

02 03 04 06 97 08 08 10 11 13 14 t5 17 18

n O-30 cm 0 30-80 cm q 60-90 cm

[cmVcm’]
0.12 ,
1

,,084 - _. . . . . _. _ -; _ _ _ -. -. . . -. . -. -. -. . -. - 1

02 03 04 06 07 08 09 10 11 13 14 15 17 19

IO-30 cm 0 30-60 cm q 60-90 cm

[cm~lcm~]
0.12
I

02 03 04 06 07 08 09 10 11 13 14 15 17 19

l O-30 cm 0 30-60 cm 6 60-80 cm

Fig. 1. Square root of the mean squared error between simulated and measured water contents of the Intensive Loam Site for the
Years 1989 (a), 1990 tb) and 1991 W. For an explanation of the model numbers see Table 1.
 B. Diekktiger et al. /Ecological Modelling 81 (1995) 3-29 9

W-1

03 07 08 10 11 13 14 17

115 cm 045 cm El75 cm

kPa
60 ,

03 07 08 10 11 13 14 17

I15 cm 045 cm E75 cm

kPa

601

* , . __ _ _.

. _. _ _ _

. _. , _.

03 07 08 10 11 13 14 1r

n l5 cm 045 cm q 75 cm
Fig. 2. Square root of the mean squared error between simulated and measured soil suctions of the Intensive Loam Site for the
years 1989 (a). 1990 (b) and 1991 Cc).For an expIanation of the model numbers see Table 1.
10

a2 oi 0.4 OS oe a’7 0’8 0; 1.3 1s 1; IS

n l989 [3lSSO ElSSl

[mm1
=O”o

02 03 04 05 06 07 08 09 tQ 11 13 14 15 17 19

I1950 cl19e0 ElSSl

140

100
1-.-....
,204..

_.-.-
-.
[mm1

. . * _. . . . - - .._- I

1_.-.
. . . _ -. . . - -. --El..

_-i=‘
_. . _-
50..._.._.__..
__ - - . . . . . - - -

50,....*.....
n *..
. __

. . .

40

20

0 L
02
. .

*-

03 04 05

m
06

1989
07

UlWIO
08 OS
.&.
_. _

10

8
11

1901
13 14 15 17
I1s

Fig. 3. Cumulative potential (aI and actual (b) evapotranspiration and interception (19 of the Intensive Loam Site. For an
explanation of the model numbers see Table 1.
 6. Lbkkriiger er al. / Ecolugical Modelling XI (1995) 3-29 11

be expected that the simulation quality increases errors are computed by cascademodels. In 1990
in caseswhere the simulation is interrupted and the mean errors are generally smaller than in
restarted using appropriate initial conditions de- 1989while in 1991the error is larger than 1989.
rived from measurements. Analysing the differences between the simula-
tions, it can be concluded that
Soil water content, soil suction, euapotranspirution, - the cascade models show higher errors than
interception,percolation models basedon Richard’s equation,
- calibrated models are not better than uncali-
Soil water content and soil suction. The square brated models,
root of the mean squared error (SRMQE) be- - the results of models simulating the whole
tween simulated and measured water contents period without interruption are not worse than
are presented in Fig. 1. In 1989 the SRMQE is models only applied for 1989and 1991.
larger for the depth O-30 cm than for the depths Because general over- or underestimation of
30-60 and 60-90 cm. In this year the largest the water content with correct dynamic can not

02 03 04 06 Q7 Orl 09 10 it 13 14 15 17 19

I1989 q *990 Hl991

tmml
2o01
,SQ _ . . - . . .
,QQ _... b . . . . . _. . . .

-200 I I I t * s 1 r 1 0 ’ 1 ’ ’
02 03 04 06 97 08 09 1Q 11 13 14 15 17 19

m19as 01990 El991

Fig. 4. Cumulative percolation in the depth of 90 (a) and 200 (b) cm of the Intensive Loam Site. No data were submitted from the
simulations of 1021, [041, and IO91 for the depth of 90 cm and of [02], [04], [06], [09], [lS], and [I91 for the depth of ZOO cm. Positive
values are given for upward fluxes. For an explanation of the model numbrs see Table 1.
12 B. Diekkriiger et al. / Ecologica!
be differentiated from those simulations showing
wrong temporal pattern, the error calculation was
repeated with mean corrected simulation results
and measurements. Because different simulation
periods have to be compared, this is not an accu-
rate evaluation method but it shows that the
results of 1061,[OS],and [19] include a bias in the
simulated water contents.
Only models solving Richards’ equation are
able to compute the dynamics of soil suction.
Therefore, only eight models can be compared on
this site. Reminding that the comparison period
was limited to the vegetation period and that soil
suction can be measured only up to 80-90 kPa
only few measurementswere available. As can be
found in Fig. 2 the mean errors are higher in
1991 than in 1989 and 1990. Even the smallest
error of about 10 kPa is quite high, the largest of
about 55 kPa unreasonable. Only two of the
models were not calibrated ([lo] and [171) but
their results are not worse than those from cali-
brated models. If the mean error is calculated
from the logarithm of the soil suction the order of
the models remains the same.
Euapotranspiration/interception. The results of
the evapotranspiration and interception calcula-
tions of the Intensive Loam Site are given in Fig.
3. All potential evapotranspiration values for the
three periods are in the same range except 1071,
whose values are always much higher, and [OS],
whose values are smaller than others. It is inter-
esting to note that [07] used the same model as
[OS]but computed total different potential evapo-
transpiration values. Differences occur not only
in the magnitude but also in ranking the different
periods. Most of the models computed evapo-
transpiration values for 1990 which were larger
than for 1989 and 1991, which is mainly due to
different lengths of the simulation periods. Only
[7], [lo], and [13] showed another ranking of the
years. Nearly the same results can be found in the
results of the actual evapotranspiration values.
Although the magnitude of differences is smaller
there is still a large range, e.g. 262-455 mm for
1989.
Only seven models simulated interception (cf.
Fig. 3~). The differences among one another are
Modelling 81 (1995) 3-29
higher than for the evapotranspiration, about one
order of magnitude between smallest 1141and
largest [08] values. In opposite to others the model
of [14] simulated the 1989 interception much
higher than for 1990 and 1991.
Water flues at the depths of 90 and 200 cm.
Water fluxes in the soil are difficult to compare
because looking at the cumulative fluxes at a
certain key-date may lead to wrong conclusions
due to the fact that the dynamics of the water
fluxes is ignored; e.g. time-lags between two simu-
lations may be important when they are com-
pared at a key-day but unimportant for evaluating
the model quality. Another reason is that capil-
lary rise can only be computed when Richards’
equation is solved.
Large variations in computed water fluxes at
the depth of 90 cm are presented in Fig. 4. The
simulation of [19] shows the largest cumulative
percolation at this depth, which is in agreement
with small values for actual evapotranspiration
(cf. Fig. 3). Nearly the same behaviour can be
found in the simulation of [07] although Richards’
equation was solved. Capillary rise for all three
periods is calculated by the model of [lo]. Be-
cause this comparison is limited to the vegetation
period the percolation in winter is not included,
The simulation of [lo] shows distinct seasonal
variation with high values for capillary rise during
the vegetation period and for percolation in win-
ter and early spring. Because the 1990 period
lasts until the end of the year the capillary rise is
almost compensated by the winter percolation.
This is illustrated in the paper of [lo] who pre-
sented monthly water fluxes.
Except the results of [lo] the water fluxes at
the depth of 200 cm are all downwards. The
variation between the different results is high, the
smallest values for cumulative percolation is com-
puted by [17], the largest by [07]. Due to the
model approach the percolation rates are com-
monly much higher in cascade models (up to 40
mm/day) than in models solving Richards’ equa-
tion (maximal 2-5 mm/day).
General description of the results. Because mean
errors and cumulative fluxes do not provide
 B. Diekkriiger et al. /Ecological
enough information to evaluate the model re-
sults, the single results will be discussed in this
chapter. In order to avoid hundreds of plots the
reader is referred to the original papers in which
much more details are published.
[02]: The authors of [02] only submitted simu-
lated water content for the model comparison.
The simulation show the same dynamic as the
measured water contents, The mean error is small
(about 3% vol.).
[03]: The simulated water contents and soil
suctions compare well with the measurements,
although the range of the simulated water con-
tent is too low in the upper layer (O-30 cm). The
actual evapotranspiration is always more than 100
mm smaller than the results of the other authors.
[041:Although the mean error in water content
is low, the time course of this simulation shows a
behaviour typical for cascade model. During the
vegetation period the water content in the lowest
layer is constant for a long time and the replen-
ishment takes place instantaneously. Therefore,
the dynamic is not well described.
1051:Onfy simulated evapotranspiration and
interception values were submitted for the model
comparison. The actual evapotranspiration is
lower than most of those reported form the other
authors.
[06]: This simuiation shows the same temporal
pattern as the result of [04]. At the lower depth
the dynamic of the water content is characterized
by fast drying and rapid rewetting. Between both
periods the water content is more or less constant
at a lower or an upper limit. Only the water
content of the upper layer (O-30 cm) shows higher
temporal variability. Percolation takes place only
on a few days at high rates which is typical for
cascademodels.
[07]: This simulation is characterized by rapid
changes in soil suction and water content which
may be due to overestimation of saturated hy
draulic conductivity. While in the upper layer the
soil does not dry out sufficiently during the vege-
tation period the water content in the lower layer
is too low in 1990 and 1991. These low water
contents agreewith high percolation rates in 1990.
The cumulative potential evapotranspiration for
Modeihg RI (1995) 3-29 13
all years is much higher than that simulated by
others.
[OS]:A good agreement between simulated and
measured soil suction can be found in the results
of [08]. The adsorption as well as the desorption
phase is well described. The actual evapotranspi-
ration is as small as simulated by 1031and there-
fore more than HMI mm less than reported by
others. This may be due to overestimation of the
interception, which is more than double of the
results of others.
[09]: Only data for the depths of O-30 and
30-60 cm were submitted for model comparison,
no water fluxes were available. At both depths
the water content is underestimated about 10%
vol. The range betweenminimal and maximal
water content is much lower for the simulations
than for the observations.
[lo]: The range of the simulated water content
is smaller than observed which leads to time
courses with over- (O-30 cm) or underestimation
(30-60 and 6G-90 cm) of the water contentsbut
with a correct temporal pattern. The simulated
soil suctions at the depth of 45 and 75 cm are
much too low, the soil is never wetter than -30
kPa. The water fluxes are characterized by high
percolation rates in winter and high capillary rise
in summer times. This is the only simulationin
which the actual is as high as the potential evapo-
transpiration.
[ 1l]: The simulated time coursesof soil suction
and water content compare well with the mea-
surements. The desorptionaswell as the adsorp-
tion phase is described satisfactory.
[13]: During the rewetting phase in winter
1989/1990 the simulatedwater contents of all
depths are much lower than those measured. In
1991the desorption due to plant growth is about
50 days earlier than observed.
1141:The simulated temporal pattern of water
content and soil suction compare well with the
measurements although the range of simulated
water contents at the depth of 60-90 cm is lower
than obsened. The soil never dries out enough in
the upper layer and during summer 1991 at the
depth of 30-60 cm.
[IS]: Becausethe simulation was run only until
14 B. Diekkriiger et al. /Ecological Modelling 81 (1995) 3-29

[kg N ha.‘]
350

02 05 66 08 10 13 14 15 19

ml989 01990 El991 n l989-9l

Fig. 5. Net mineralization calculated by different models for separated time intervals at the Intensive Loam Site. For an
explanation of the model numbers see Table 1.

harvestthe rewettingof the soil is only calculated content in the upper and the lower layer are
for the winter period90/91. The simulatedwater alwaystoo low during the rewettingphases.The
contentsfor the remainingshort comparisonperi- samebehaviourcanbe foundin the simulationof
ods are generallyoverestimatedat the depthsof the soil suctionwhich compareswell with mea-
O-60cm. surementsduring the desorptionphasebut dur-
[17]: The dynamicof water content and soil ing the adsorptionphaseonly valuesup to - 15
suctionis describedwell but the simulatedwater kPaare computed.

[kg N ha.‘]
3501
/ -J
300 - /-

250-

200 -

150-

100-

--732 852 972 1092 1212 1332 1452 1572 1592

elapsed day8

x02 m 06 + 10 A13 l 14 +19

Fig. 6. Cumulative net mineralization of selected models on the Intensive Loam Site. For an explanation of the model numbers see
Table 1.
 B. Diekktiger et al. / EcologicaI ModelIing 81 (1995) 3-29 15

[191:This simulationis characterizedby low [19]) which simulated the lowest net mineraliza-
actual evaporationvaluesand high percolation tion in 1989show the highestnet mineralization
rates(up to 40 mm/day). Due to the low evapo- during the 1990period. As can be seenin the
ration the water contentsare too highduringthe time coursesof the net mineralization (Fig. 6)
vegetationperiod. During the rewetting period thesearethe onlyoneswhichsimulated phasesof
the water contentsare filled up until an upper net immobilization.Sothe higher mobilizationof
limit is reached.Afterwardsthe water contentsat nitrogenin 1990may be an effect of remineral-
all three depthsare constantfor more than 150 izationof immobilized nitrogen caused by wheat
daysuntil the nextvegetationperiodstarts. straw incorporation. Summing up the results of
both years, net mineralization during the growing
Soil nitrogen content, nitrogen leaching seasons variesonly between 128and 138’kg N/ha
Soil mineral nitrogen is the only measured except [lo] who computed very low mineralization
state variable availablein this data set for the ratesin all years. The cumulative net mineralii-
validationof nitrogenmodels.Sincemineralni- tion in Fig. 6 shaws that the differences between
trogen content in soil is the result of multiple those models which simulated the whole 3-year
simultaneousprocesses,it is difficult to valuate period becomeevident.The highest deviations
nitrogen modelsseparatefrom their codesde- betweenthe models occur after harvest of winter
scribingsoil water and plant N uptake.Because wheatin 1989.Model [02] started with a phase of
their validity are discussedin the other sections, net immobilization.After straw incorporation a
we wit1focus here on the most important trans- short period of irmnobilization/remineralizatiun
formation processesof nitrogen and on the N results.While the results of [19] shaw a rapid
transportin soil. immobilizationof nearly all mineral nitrogen in
soil followedby a relatively fast remineralization
Net minerakation. Fig.5 showsthe simulatednet during autumn, the model of [14] simulated a
mineralizationof each model for the different smoothbut long-term immobilization up to end
years.Large differencesbetweenthe modelsoc- of May when remineralization starts. In contrast
cur during 1991where net mineralizationranges to this dynamicbehaviour, [13] computed a linear
between38[IO] and 148kg N/ha [15].During the cumulativenet mineraliition throughout the 3
1989period net mineralizationvariesbetween28 years,which is very cioseto the time courseof
and 96 kg N/ha. Thosemodels([02], 1141and [19] over a long time. Cumulated net mineraliza-

[kg N ha.‘]
120

100

60

60

40

20

P
02 05 06 06 10 13 14 15 19

ml989 ~1990 al981 ~1989-91

Fig. 7. Denitrifkation losses calculated by different models for separated time intervals at the Intensive Loam Site.Forafi
explanation of the model numbers see Table 1.
16 B. Diekkriiger et al. / Ecological Modelling 81 (1995) J-29

(kg N h8-‘1
80 -1

, ,-
02 05 06 08 10 13 14 15 19

ml989 al990 81991 ~1989-91

Fig. 8. Nitrogen leaching ~490 cm depth calculated by different models for separated time intervals at the Intensive ham Site, For
an explanation of the model numbers see Table 1.

tion of modelswhichsimulatedthe wholeperiod seemsto be surprisingbecausethree of them

without interruption vary between193kg N/ha
[lOI and 340 kg N/ha [19] within the regarded
periodof 33 months.
Denittific~tion. Considerableamountsof denitri-
fication losseswere simulatedby [02], [06], [OS]
and [19] while the amounts simulatedby the
other models are negligible(see Fig. 7). This
(1021,[M] and [19]) use capacityapproachesfor
the water dynamics.The amountscalculatedfor
the whole period indicatethat denitrification is
estimatedalsooutsidethe growingseasonduring
late summerand autumn, The highestnitrogen
tossesby denitrificationare calculatedas 105kg
N/ha within about 3 yearsby [06] where about
one third is from outsidethe growingseason.

[kg N ha’]

=q

02 06 08 10 13 14 15

m O-30 cm 0 30-60 cm E/ 60-90 cm

Fig. 9. Square root of the mean squared error between simulated and measured mineral nitrogen contents in three depth during a
selected time intetvaf in 1989 at the Intensive Loam Site. For an explanation of the model numbers see Table 1.
 8. Oiekkriiger
Leaching of nitrogen. Variation in the amounts of
simulated nitrogen leaching in 90 cm (Fig. 8)
reflects mainly the differences in the soil water
fluxes at that depth. Because the comparison of
the single years is restricted to the growing sea-
son, the main period for nitrogen leaching in
winter is only partly included. So the amounts of
nitrogen leaching are mostly very low, except for
1191who simulated also high drainage. Corre-
sponding to the high capillary rise computed by
[lo] for the growing season,nitrate is coming up
from deeper soil layers into the root zone in this
simulation. Apart from the seasonal differences
between the models the cumulative leaching over
the whole 3-year period is nearly the same for all
models which computed this period without inter-
ruption. Only [19] simulated extraordinary high
lossesby leaching corresponding to the high esti-
mations of drainage water.
Mineral nitrogen in soil. The comparison of the
mineral nitrogen courses is difficult because the
models started at different times and used differ-
ent initial values. So in 1989 the first measured
nitrogen content has only been used by [06], [13],
[15] and [19]. Lower values have been estimated
by [02],[OS]and [14] while [lo] overestimates
the
[kg N hr’]
160
02
Fig. 10. Square root of the mean squared error between simulated and measured mineral nitrogen contents (O-90 cm) during
selected time intervals at Intensive Luam Site. For an explanation of the model numbers see Table 1.
et 01. / Ecoiogical ModeIIing 81 f 1995) 3-29 17
mineral N at this time. Nevertheless,Fig. 9 shows
the square root of the mean squared error
(SRMQE) between measuredand simulated min-
era! nitrogen contents of the single 30 cm layers
in 1989. This figure is typical also for the other
years, where the highest deviations occur mostly
in the upper 30 cm. This could be expected
becausethe upper 30 cm is the layer where most
of the transformation processestake place. The
nitrogen dynamic was influenced mostly by high
variation in the soil moisture and in’ the soil
temperature as well as by tillage and fertilization.
Regarding the whole measured profile (Fig. 10)
the SRMQEs are mostly smaller than the sum of
the single layers because errors are partly elimi-
nated due to inaccurate simulation (or measure-
ment) of the mineral nitrogen distribution in the
profile. Generally the SRMQEs were highest in
1990because the increase of mineral nitrogen in
spring can not be explained neither by natural
nitrogen transformations nor by the given man-
agement data. Probably there is an error in the
management data provided by the farmer, which
may have lasting effects on the results of the
following period of 1991.Nearly all models which
simulated the whole period without interruption
show a higher SRMQE in 1991 than the models
06 06 10 13 14 15
It969 01990 al991
18 B. Diekktiger et al. / Ecological Modelling
[08] and 1151which were restarted in 1991 with
new measured initial conditions.
General descriptionof the results. The correlation
between measured and simulated minerat nitro-
gen does not seem to be an appropriate method
to evaluate model resuhs. Highest coefficients of
determination (R’) were found for all models in
1990 where management data are doubtful and
were the errors are highest. The coefficients of
determination vary between 0.473([06]) and 0.387
([lo]). Because all models underestimated the
mineral nitrogen the slopesof the regressionlines
are generally low, The lowest P-values were
observed in 1991except for the model [15] (0.918)
which was restarted in October 1990 and [13]
(0.440)which was calibrated during the first year.
Additionatly some short descriptions of the model
results of the single participants are given:
[021: Although the model underestimated the
first measurement, the mineral nitrogen during
the growing season is generally overestimated
probably due to a lag in the N uptake. At harvest
simulated and measured nitrogen agree well. In
autumn mineralization is slightly overestimated
but in general the dynamic is reflected satisfac-
tory. The content of mineral N during the grow-
ing seasonof sugar beet is significantly underesti-
mated like in all other models probably due to
missing management data. Results for 1991 were
not provided.
[06]: The decreaseof mineral nitrogen content
at the beginning of 1989 is not reflected by the
model. Therefore, the nitrogen content in the soil
during the growing season is generally overesti-
mated although the dynamic is described satisfac-
tory. After harvest the release of nitrogen from
manure seems to be too fast. During the winter
time up to ApriI measured and simulated values
compare well. Due to the discussed problems
within 1990the nitrogen content is clearly under-
estimated at the beginning of 1991.Apart a little
lag in the F uptake the dynamic of mineral
nitrogen content is described satisfactory in 1991.
[08]: The model describes well the course of
mineral nitrogen during the whole year of 1989.
The model was restarted in 1991 and apart a lag
in the N uptake it reflects the dynamic during the
81 (1995) 3-29
main growing period of winter wheat well. The
increase of the mineral N content at the end of
the growing seasonis not simulated by the model.
[lo]: The model overestimates the mineral ni-
trogen content especiatly at the end of the grow-
ing season and after harvest. Due to high losses
by leaching the differences between simulation
and measurement decreasesin spring 1991. Due
to the general problems of 1990 the simulated
nitrogen content is too low in the beginning of
1991. The dynamic of the mineral nitrogen con-
tent described by the mode1is just the opposite of
the observed data which is also reflected by a
high negative correlation.
[13]: The simulated time courses in 1989 are
similar to the results of [06]. Due to the relatively
high mineralization the simulation compare well
with the measurements at the beginning of 1991.
During the growing season the simulated nitro-
gen dynamic correspond with the measured pat-
tern although the nitrogen content is slightly
overestimated.
[14]: The model shows a very good agreement
during the 1989 period, but in spring I990 in-
creaseof nitrogen is not reflectedby the model
due to long immobilizationperiod. In 1991the
model first underestimatesthe mineral nitrogen
content whereas it overestimates it during the
growing season. The dynamic of the nitrogen
content is described well.
[W]: Because the nitrogen uptake by plant
started too early, the model does not reflect the
measured nitrogen dynamics. The mineral N con-
tent during the growing seasonof winter wheat in
1989 is underestimated. Simulation data after
harvest were not provided. In 1991the simulation
compares we11with the measured data, only at
the end of the growing season the nitrogen con-
tent is underestimated.
[191: During the growing season in 1989 the
model overestimated the mineral nitrogen con-
tent. After harvest and straw incorporation a
rapid immobilization of nearly all mineral nitro-
genis simulatedfollowedby a rapid remineraliza-
tion which leads to higher nitrogen content than
observed. Due to the high nitrogen leaching the
model compares relatively well with measure-
ments in spring 1990. In 1991 the differences
 19
[tow hr’]
25
1

05 06 06 OS 10 13 14 l6 19

- measured

[tonr ha-* ]

OS 66 06 OS 10 13 14 16 19

- measured

25

20

15

10

0
05 06 06 09 10 13 14 16 19

- mmamured

Fig. 11. Simulated (bar-s) and measured (solid line) biomass of the Intensive Loam Site at the end of the growing Seasons for the
years 1989 (a), 1990 (b) and 1991 (~1. For an explanation of the model numbers see Table 1.
20 3. Diekkriiger Ed al. /Ecological Modelling 81 (1995) 3-29

[kg N ha-l]
400 ,

05 06 06 09 10 13 14 15 16 19

- measured

[kg N ha-l]
400 ,

06 06 06 OS 10 13 14 15 16 1s

- measured

[kg N ha-l]
400 ,

06 06 06 09 10 13 14 16 16 19

- measured
Fig. 12. Simulated (bars) and measured (solid line) nitrogen uptake by plants of the Intensive Loam Site for the years 1989 (a), 1990
(b) and 1991 W. For an expIanation of the muclel numbers see Table 1.
 8. Diekkdger et 01./Ecological
between simulation and measurements are signif-
icant.
Plant growth, biomassproduction, nitrogen uptake
by plants
The Intensive Loam Site was cultivated in 1989
and in 1991 with winter wheat and in the year
1990with sugar beets. Half of the papers dealing
with the IL gaveresults only for cereals([OS],[OB],
1091,[151,[SD, so the year 1990is missing. Two of
them ([05] and [19]) did not submit results con-
cerning the leaf area index.
The results of the regression analysis for the
biomass (cf. Table 2) show - with the exception
of one case ([lo] for 1989) - very high R’-values
indicating a good correspondence of simulations
and observations. But regarding the parameters
of the regression line it can be seen that the
results of most of the models differ from the ideal
1:l line. So, with the exception of e.g. [05], [OS]
and (141,all other models result in a slope which
is significantly different from one, leading to a
systematic over- or underestimation of the data.
Looking at the time courses this first impres-
sion is confirmed. In most cases (except [09] for
1989, [lo], [13] for 1990, and [15] for 1989) the
dynamic is describedmore or less in the right
way. But, with the exception of [OS] and [M]
which produced time courses with the right dy-
namic and in the right order of magnitude, all
others do over- or underestimate the measured
biomass (cf. Fig. 11).
It has to be noticed that four of the partici-
pants([OS],[06], [W] and 1131)did not regard any
decrease of biomass before harvest, the others
deal with senescencephenomena in a more or
lessmarkedway.
Obviously (cf. Table 3) the modelling of the
leaf area index caused much more problems to
the participantsthan modellingthe biomass.So
only three of them ([OS],[lo] for 1989and 1990,
1131)were ableto producetime courseswith the
dynamic and the order of magnitude shown by
the data.
The N-uptakecalculated by the different mod-
els varies between80 kg and over 700 kg, the
measured values are in the range of about 240 kg
(cf. Fig. 12).
Mndellin~ RI f 199513-29 21
Generaldescriptionof the results.[Ml: The dynam-
ics of the biomass given reflect the behaviour of
the data, although for 1991 the mode1 results in
an overestimation of the total biomass. A time
course of LA1 is not given. The computed N-up
take is in the right order of magnitude.
[06]: The time courseof the biomassresembles
that of the data but with an underestimationfor
1989and 1990 and an overestimation for 1991.
For eachof the two yearsthe LAI is muchtoo
high with a different dynamic than observed. The
N-uptake is about 5% too high. Remarkableis
that in all three years the biomass as we1 as the
N-uptake are nearly the same (biomass about
18000 kg/ha and N-uptake about 290 kg).
[08]: The time course of the biomass as well as
the one of the LAI are quite good with the right
dynamic and right values. There are some oscilla-
tions in the LAI in the year 1991 which are
incomprehensible. The computedN-uptake lies
about 100 kg over the measured one. It has to be
noticed that nearly the same uptakes result from
quite different biomasses in the two regarded
years.
1091:For the year 1989the computedplant
biomassincreasestoo earlyand too slowin oom-
parison with the data, for 1991the result looks
quite good. In both casesthe total amount of
biomass is in the right order of magnitude.De-
spite these results the LAI time course is given
only for 1989 almost correctly. The computed
N-uptake is 80 kg for 1989 and 180 kg for 1991,
both values being too low compared with the
measured ones. The question arises why in 1989
the N-uptake is only one half of the uptake in
1991,while on the same time the biomass in 1989
is greater than in 1991.Another result has to be
mentioned: in 1991 after reaching a maximum
value, the cumulative N-uptake decreases again.
[lo]: For 1989 and 1990 the biomass is in no
sense satisfactorily given by the model, the de-
crease is too early and too sharp and the total
biomass producedis significantlyunderestimated.
Opposite to theseresuItsthe time courseof the
IA looks quite good for 1989and 1990,whereas
for 1991 the increasein the LAI is computedtoo
late. The biomassas well as the N-uptake are
nearly the same in all three years, the latter one
22 B. Diekktiger er al. / Ecologiwl Modelling 81 (1995) 3-29

being about 300 kg each year, i.e. 15% too high Table 4
regarding the measured one. Results of the pesticidesimulationof the Intensive Loam Site.
Linear correlation between simulated and measured pesticide
[13]: For the two years with cereals (1989 and residues(y = u.r + b). RZ = coefficient of determination
1991) the time course is reflected very well with No. Pesticide Ll b R=
slight overestimation of the biomass, especially in
10 Methabenzthiazuron 0.81 0.62 0.984
1991. But for the sugar beet in 1990 the model 11 Methabenzthiazuron 0.89 - 0.24 0.917
increase in biomass is much too late compared 18 Methabenzthiazuron 0.85 0.26 0.980
with the data. Additionally the total amount of 10 Metamitron 0.99 0.03 0.954
biomass is significantly underestimated in this 11 Metamitron 0.76 0.20 0.959
year. The time courses of the LA1 look quite 18 Metamitron 0.90 0.08 0.954
good in all three years, though in 1989 the value 10 Simazine 0.91 0.04 0.987
it Simazine 0.81 0.11 0.992
is about 16% too high. The N-uptake calculated 18 Simazine 0.93 0.02 0.985
for 1989 and 1991 is in the right order of magni-
tude, whereasfor sugar beets the model results in
an unrealistic value of 730 kg.
[14]: This model is the only one which MS able right way but with an underestimation of the total
to produce right dynamics for all three years, biomass in each of the three years. Time courses
although in 1991 the biomass is overestimated. of LA1 are not given by this author and the
The evaluated N-uptakes are in the same order N-uptakefor eachyear is predictedcorrectly.It
of magnitude as the observed ones. Only the has to be noticedthat the uptakeis in the same
computed LA1 does not confirm this good im- order of magnitudein all three yearsalthough
pression, for cereals the descent is too early and the biomassis different, the highestbiomassin
much too sharp, whereas for sugar beets the 1989evenresultsin the smallestN-uptake.
dynamic is reflected well but with values too low.
[IS]: For 1991 the dynamic of the biomass is Pesticides
described quite well, but in 1989the growth starts The results of the pesticidesimulationsare
about 50 days too early and additionally the givenin Table 4, In all casesthe coefficientof
biomass is underestimated. The same holds for determination is larger than 0.9. For the short
the LAI: in 1989 too early and too low, the measurementperiods(about 100 days) the mod-
dynamic in 1991is given in a correct way, but the els produce nearly the same results. In addition
values are too low, also. The model leadsto a to this short period the Shnazine dynamic was
correct value of N-uptake for 1991, but for 1989 simulated for three years.The results are pre-
the simulation results in an underestimation of sentedin the papersof [lo], [ 111,and [la]. Be-
about 25% of the observed value. Regarding the causeno measurementswere available the results
almost identical biomassesin both years this is a can only be compared amongone another. But
strange result. the differences are significant:oppositeto [ll],
[163:This model leads to a correct dynamic of whoseprofile showsonepeakin the depthof 100
the biomass for both years regarded with a signif- cm, two peaks in the depth of 25 cm and of
icant overestimation
of the total biomassproduc- 85-100cm canbefound in the simulationsof [lo]
tion in 1991.The samedoesnot hold for the LAI and [18]. Becauseall simulationsshow at least
dynamic:in both years it increasestoo early, one peakin nearlythe samedepth the transport
decreasestoo late and it seems as if it is trun- part of the modelyieldedthe sameresult. While
catedat the top. The N-uptakefor 1989is in the the simulatedconcentrationsof [lo] and Ill] are
sameorder as observed,for 1991it is 30% less in the sameorder of magnitudethe resultsof [18]
than observed,This result is surprisingbecause are significantlylower at April 1991(about 1%).
the biomassproductionin both years is nearly Thesedifferencescanbe explainedby the differ-
identical. ent approaches for temperaturedependency: [lo]
1191:The dynamic for the biomass is given in a and [ll] use an Arrhenius type, 1181uses a differ-
 B. Diekktiger et al. / Ecological Modding 81 (19951 3-29 23

ent approach according to O’Neill (Spain, 1982).
[18] showed that both approaches compare well
in the range of about 1%lS°C, the mean temper-
ature of the measurement period. For all other
temperaturesthe degradationratesdiffer signifi-
cantly. Due to missingmeasurements this com-
parisonis speculative but it showsthat (a) a good
simulationon short periodsdoesnot necessarily
lead to appropriatelong-term forecastsand (b)
the pesticide data available for this studyare not
sufficient for model validation.
3.2. Intensive sand site
In contrast to the IntensiveLoam Site only
someparticipantssimulatedthe IntensiveSand
Site. Becausebiomassdata were availableonly
for 1990 and 1991 this period was chosen for
model comparison. The period was alwayssimu-
lated without interruption and therefore the re-
sults were not divided into different simulation
periods. While [02], [14] and [19] calibrated parts
of their model the others simulated the Intensive
Sand Site without modifying parameters.
Soil water content, soil suction, evupotranspirution,
interception,percolation
All results of this comparisonare given in
Table 5. The mean error in water content de-
creases with depth. Because the water content
data show high temporal variability which cannot
be explained by the water dynamics the calcula-
tion of the mean error is questionable on the
IntensiveSand Site. The smallest error showsthe
simulation of [I21 in the depth of 60-90 cm.
Because1121 simulatedconstantwater contentin
this depth without any temporal variation the
calculationof mean error in water content is
dubious.
Only two of the participants submitted values
for interception. As reported before at the lnten-
sive Loam Site the values of [14] are much lower
than those from [17]. The actual evapotranspira-
tion simulated by 1193is less than 50% of the
value reported by others. These underestimation
results in art overestimation of the percolation
rate, about four time higher in the depth of 90 cm
than reported by the other authors.
General description of the results. [02]: The simu-
lated time course ot’ water content shows a small
range(about 5% vol.). Althoughthe meanerror
is low the dynamicis not well described.
[06]: The range betweenlowest and highest
water content is 510% vol. which is lower than
observed.The dynamicin the depths of O-60 cm
is described adequately,the simulateddynamicof

Table 5
Results of the water flux simulations of the Intensive Sand Site. Negative values for water fluxes in the soil are given for percolation
02 06 12 14 17 19
mean error in water 4.4 4.1 5.9 6.8 5.6 13.6
content O-30 cm (% Vol.)
meanerror in water 3.8 4.2 3+4 4.8 4.6 9.1
content30-60 cm (% vol.)
meanerrorin water 2.8 4.7 2.2 2.9 4.0 8.9
content 60-90 cm (% vol.)
mean error in soil 16.6 15.7 26.8
suction 15 cm (kPa)
meanerrorin soil 20.5 17.0 29.0
suction 45 cm &Pa)
interception (mm) 20.4 89.4
potential evapotranspiration (mm) 1118 1210 1201 1043
actualevapotranspiration
(mm) 960 1049 1035 897
waterfluxesin thedepth -74 - 150 -133
of 90cm(mm)
water fluxes in the depth -250 -175
of 200 cm (mm)
24 B. Diekktiiger
the lowestlayerdoesnot agreewith the measure-
ments.
[12]: Althoughthe dynamicin the upperlayer
is describedwell, the water content in winter
90/91 is overestimated,In the lower layer the
simulatedwater content and the soil suctionare
constant.The time courseof soil suctionis ade-
quatelydescribed in the depth of 15 cm but in the
depth of 45 cm the dynamic does not correspond
with measurements.
[14]: The dynamic of the water content is de-
scribed satisfactory but the water content is per-
manently overestimated in the depth O-60 cm.
The soil suction in the depth of 45 cm is too high
during the vegetation period but the dynamic is
describedweI1.
[17]: The simulated time coursesof water con-
tent are comparablewith the resultsof [14], but
[17] permanentlyunderestimatedthe water con-
tent. Although the meanerror in soil suctionis
largerthan that calculatedfor [12] and[14],this is
the only simulationin which the soil suctionin
the depth of 45 cm reachesthose low values
which havebeen observed.The dynamicis de-
scribedwell in both depths.
[19]: The resultsof [19] showthe samepattern
[kg N ha.‘]
lb97 1217
Fig. 13. Cumulative net mineralization of selected models on the Intensive Sand Site. For an explanation of the model numbers see
Table 1.
et al. /Ecological Modding 81 (1995) 3-29
as reported for the Intensive Loam Site. The
simulatedrangeof water content is much lower
than observedand the water content is perma-
nentlyoverestimated,During the winter time the
water contentis constantfor more than 150days
and the soil doesnot dry out enoughduring the
vegetationperiod. This may be due to the ex-
treme low evapotranspiration values which causes
high cumulative percolation.
Soil nitrogen content, nitrogen leaching
Net mineralization. In Fig. 13 the time course of
net mineralization is shown for the four models
which provided this site in their data sets. Three
of the models ([02], [14] and [193)show phasesof
net immobilization whereas [06] describes only
net mineralization.Differencesbetweenthe re-
sults are significant.Over the simulationperiod
of abouttwo yearsthe cumulativenet mineraliza-
tion of [06] is more than doubleof the amount
calculatedby [14].
Denirrificarion,As expectedon a sandysoil only
small amountsof denitrificationwere computed
by most of the models.While 1141simulatedno
1337 1457 1577 1697
elapsed days
x02 l 06 * 14 A 19
 B. Diekkriiger et al. /Ecological Modelling 81 (199513-29 25

[kg N hw’]
100
I

00 -. . . . . _______.__,__.._..._______

02 06 12 14

n O-30cm q 30-60cm q SO-SOcm 50-QOCm

Fig. 14. Square root of the mean squared error between simulated and measured mineral nitrogen contents at the intensive sand
site in different depth increments for a selected time interval in 1990/91. For an explanation of the model numbers see Table 1.

denitrificationlosses,[06] estimated7 kg N/ha, year simulation.Togetherwith the low errors the

[19] 20 kg N/ha and 102152kg N/ha during the R* value indicatethat the modelof [14] fits the
2-yearperiod. data as the best.Also the simulationof [06] gives
very good resultsduring 1990,but in 1991the
Leaching of nitrogen. No leachingdata for the 90 model overestimatedthe soil mineral nitrogen
cm depth were submitted by [02]. The lowest contentdueto the highmineralization.Due to an
lossesby leaching(79 kg N/ha) were simulated error in the data file, resultsof [19] canonly be
by [14].The leachingof 91 kg N/ha computedby interpretedreferringthe figure in hismanuscript.
[06] canbe explainedmostlyby the differencesin The modelreflectedthe pattern well, but Seems
net mineralizationbetweenboth models.Due to to tend to a slight overestimationof mineral
the high amountsof simulateddrainage[19] cal- nitrogenduring the growing season. Model 1121
culatedlossesof 164kg N/ha for the comparison fits the mineralnitrogen content in the ploughing
period. layer well but the depletion during the growth of
plants is delayed in both years. fn deeper layers
Mineral nitrogen in soil. Generallythe agreement the model tends to overestimatemineral nitro-
betweenmeasuredand simulatedmineralnitro-
gen content in the soil is better than on the
IntensiveLoamSitedespitethe fact that all mod- Table 6
els had problems in simulatingthe water dy- Results of the mineral nitrogen simulations @-!I0 cm) for the
namic. The simulation of 1141has the lowest period of 1990-1991 on the Intensive Sand Site. Linear corre-
valuesfor the SRMQE (cf. Fig. 14). They are lation between simulated and measured values (y = ux + b),
abouthalf of thosefrom [06] and[ 191.The errors R2 = coefficient of determination
of [02] are much higher comparedto the other No. a b R2
modelswhich is mainlycausedby low valuesfor 02 0.71 85.1 0.2%
plant uptakein 1991.The correlationspresented 06 0.87 26.9 0.686
12 0.76 48.7 0.54El
in Table 6 were much higher than on the loam 14 0.81 18.1 0.920
site which is probablyalsoan effect of the whole
26 B. Diekkriiger et al. /Ecological
gen. As describedfor the water dynamicsthe
modelof [12] computednearlya constantnitro-
gencontentin the depthof 60-90 cm.
Plantgrowth,biomass
production,nitrogenuptake
byplants
The Intensive Sand site was cultivated in 1990
with sugar beets, and in 1991with summer barley.
For each of both years only four data on biomass
and LAI are availabte so that a regressionanaIy-
sis makes no senseand emphasis is laid upon the
discussion of the dynamicsand the biomassand
N-uptakevalues.
OnIy four of the participants(1061,1121,1141
and [19]) submittedresultsconcerningthis site,
three of them simulatedtime coursesof biomass
which decreasein a more or less marked way
before harvest,
The dynamicof the biomassfor both yearsis
calculatedvery web givenby two of the partici-
pants ([14] and [19]), with a slight underestima-
tion of biomass by [19]. [06] computed a right
time course with correct values regarding the
data only for 1991,whereas this author underesti-
mated the biomass for 1990 by about 35%. The
increase in biomass computed by [12] is in both
years too late compared with the data with an
additional underestimation of the total biomass.
The modelling of the time course of LA1
yieldeda similar result: El21and [14] submitted
good results regarding the base of only four data.
But it has to be mentioned that the decrease in
1991computed by [14] is too early and too sharp
in comparisonwith the data. The LA1 values
computed by [06] are twice as high as the data
and additionallytheir dynamicis not reproduced.
[19] did not provide any resultsconcerningthe
time courseof the MI.
The amountof N-uptakeis measuredin 1990
as195kg and in 1991as about 130 kg. For 1990a
value similar to the data is computed only by [12]
while all others reported values of about 240 kg.
In 1991the computed values vary between 140kg
[19] and 250 kg [06], indicatingthat all models
calculated a N-uptake which is too high com-
paredwith the measuredone. It hasto be men-
tioned that contrary to the results obtained at the
Intensive Loam Site the results of Cl43and [19]
Modelling 81 (1995) 3-29
indicatethat different biomasses
causesdifferent
N-uptakes.
4. Discussionand conclusions
The presentation of the simulation results
shows that except the model of [14] there is no
unique model which simulates all processesin the
same quality. Although all processesare intercon-
nected and therefore dependent of each other
nearly all models include simple approaches for
some processes.
The base of all modelsis the calculationof
water fluxes. There, two main philosophies are
presented:the cascadeconcept and Richards’
equation.Both modelshaveadvantages and dis-
advantages.Commonlyfast computingtime and
lessparameterswere pronouncedas an advan-
tageof the cascadeconcept.The disadvantageis
that the applicability is limited to sites where
capitlaryrise can be neglectedand where water
saturationdoesnot occur. Sometimesthe simu-
lated time coursesof cascademodelslook like a
square wave with high water contents in winter
and low water contents in summer times. This
may be sufficient if mainly other processesare to
be simulated.
Nowadays due to increasing computer power
available the amount of parameters is more im-
portant than the computer time needed for a
simulation. For water transport parameters of the
hydraulic conductivity curve and the retention
curve can be derivedfrom basic soil data like
texture and bulk density.Because saturated hy-
draulic conductivitieswere not availabIefor this
study,[lo] and[17] estimatedthem from basicsoil
data usinga pedotransferfunction.Their results
are not worsethan thosefrom modelswhichhave
been calibrated.In addition to the results re-
ported here, [17] estimatedall water transport
parametersfrom basic soil data using a pedo-
transfer function. The resulting water fluxes are
similar to those from the simulation using mea-
suredretentioncurves.
The conclusion from these examples is that the
pros and cons concerning the water transport
approach are obsolete. From the simulation re-
 B. Diekkriiger et al. / Ecdagicol
sultsit is clear that anotherpoint is most impor-
tant: The processknowledgeof the personrun-
ning a simulationmodel.This is illustratedby the
fact that two participantsappliedthe samecom-
puter code but yielded totally different water
fluxes. Often the quality of a water transport
model is eva!uated by comparing simulated and
measured water contents. While the water con-
tent is important only for transformation :::ro-
cesses, the water fluxes dominate leaching ;~f
agrochemicals. Unfortunately, it is nearly impos-
sible to measure water fluxes in the soil and
therefore this is the critical point in modelling
water dynamics. No unique solution can be ob-
tained if water fluxes have to be derived from the
dynamic of the water content. As a consequence
the range of the simulated cumulative evapotran-
spiration is very high and results in a similar
variation in cumulative percolation.
The results of the nitrogen model are signifi-
cantly influenced by the results of the water
transportandthe plant growth model.The differ-
ences betweenthe modelapproachesare signifi-
cant only in short periods,e.g. after straw incor-
poration,but over the whole periodthesediffer-
ences are negligible. Therefore, a model which
used zero-order kinetics for net mineralization
yielded comparable results to those models using
first-order kinetics. The differences in simulated
denitrification lossesare also significant. Because
it is not possibleto measurethoseprocesses,
the
behaviour of the nitrogen model may be appro-
priate while the description of single processes
may fail.
The time course of mineral nitrogen in the soil
is a resutt of management, leaching and plant
uptake,Takinginto accountthat small-scale spa-
tial variabilitymayinfluencethe measurement of
nitrogensignificantly,it is clearthat for tong-term
forecaststhe exactdeterminationof the boundary
conditionsis asimportantas the modelapproach
itself. To calibratea modeldataon different time
scalesare needed.Long-term applicationof a
modelcalibratedon a short period mayfail. The
data availablefor this studyare not sufficientto
provewhichapproachis suitablefor short aswell
as for long period.
The discussion of simple versus complex nitro-
Mudelling 81 (199s) 3-29 27
gen models is the same as for pesticide models.
One result of this comparison study was that for
short-term simulationsall pesticidemodelsbe-
havein the samemannerbut for longerperiods
the resultsdiffer. Althoughlaboratorymeasure-
ments suggestthat a first-order kinetic is not
appropriate for many pesticides,most of the
modelsare limited to this approach.In contrast
to the pesticidedynamicdue to the complexityof
Lie nitrogencycle,it is more difficult to detect
deviationsfrom first-order kineticsin this case.If
only standard measurements like mineral nitro-
gen content are availablefor model evaluation,
complexmodels do not differ from simple ap-
proaches.In this case not all processesunderlying
complex models can be validated.
The results of the simulation of plant biomass
show that the dynamicof plant growth can be
described adequatelybut the simulated biomasses
differ from those measured. Because most of the
simulation models were developed for cereals the
biomass of sugar beetswas only roughlysimu-
lated. Most of the modelsdo not describethe
senescence correctly.This maybe due to the fact
that plantgrowthmodelswere mainlyincludedin
the model systemsto computethe information
neededfor the evapotranspiration and the nitro-
gen model.Becausemost of the evapotranspira-
tion models are not very sensitiveto errors in
plant height, LA1 and root length distribution,
simple models are as adequateas complexones.
The differences in simulatednitrogenuptakeby
plants are significantand influencethe resultsof
the nitrogen model more than the denitrification
lossesor the differencesin the descriptionof the
net mineralization.
Evaluating all single findings some general
conclusions can be drawn from this comparison:
- a good simulationon short periodsdoesnot
necessarilylead to appropriatelong-termfore-
casts,
- simple modeIs run by an expert may lead to
better results than those computedfrom a
complexmodelappliedby non-expertusers.
- significanterrors within the calculationof one
processmay lead to generalwrong resultsof
the wholemodel,
- the processes in the soil mainlydependon the
28 B. Diekktiger el al. / Ecoiogicd
boundary condition (e.g. evapotranspiration,
irrigation, fertilization). Problemsin determin-
ing these boundary conditions may influence
the simulation resufts significantly.
From the resultsit is clear that modelvafida-
tion is mainly determined by the availability of
measurements. Dependingon the point of view it
may be concludedthat nearly aft or nearly no
model is validated using this data set. Because
the most important processes are difficult or im-
possibleto measure,the validationof singlepro-
cessesis mainlyindirect. Becausein additionto
temporalvariabilitythe spatial variabilityis im-
portant it seems that it is necessary to improve
field measurement techniques instead of develop-
ing new models.
In this comparison simple as well as complex
models were involved. Usually one argument for
using a simple model is that the results are suffi-
cient for management recommendations. It seems
that the results of this study verify this argument.
But it has to be noted that the results of the
complexmodelsare not worse than those from
simpIe models.The applicabilityof a model is
limited to those processesand situationswhich
the modefferbelieveare important.The simpfic-
ity is often modelinherentanda potentialuseris
limited to what a modefferhasdecidedfor him.
In future it is moreimportantto developmethods
for derivingmodelparametersfrom other infor-
mation like hydraulicconductivityfrom soil tex-
ture. Combiningthose transfer functions with
modelsin which the user may decide on the
complexityof modeldescriptionwill leadto tools
which may be sufficient from a scientific as well
as from a managementpoint of view. Emphasis
shouldbe laid upon a goodtrainingof the model
usersbecausethe results of all models are signifi-
cantlyinfluencedby the knowledgeof the user.
Acknowkdgements
We would like to thank all scientistsof the
CollaborativeResearchProgram379“Water and
Matter Dynamicsin Agroecosystems”which is
financedby the German ResearchFoundation
(Deutsche Forschungsgemeinschaft).
Without
Mdelling 81 (1995) 3-29
their encouragementand help this workshop
would not have been possible.
We alsothankafl participants of the workshop
for kindly volunteeringtheir model results for
this comparison.We hopewe havenot misinter-
pretedanyof their resultsor conclusions.
References
Bacsi, Z. and Zemankovics, F., 1995. Validation: an objective
or a tool? Results on a winter wheat simulation model
application. Ecol. Model., 81: 251-263.
BlombHck, IL, Stlhli, M. and Eckersten, H., 1995. Simulation
of water and nitrogen flows and plant growth for a winter
wheat stand in central Germany. Ecol. Model., 81: 157-
167.
BotteMreg, P., 1995.The user’s influence on model calibration
resulks; an example of the model SOIL, independently
calibrated by two users. Ecol. Model., 81: 71-81.
Claus, S., Wernecke, P., Pigla, U. and Dubsky, Ct., 1995. A
dynamic model describing leaf temperature and transpira-
tion of wheat plants. Ecol. Model., 81: 31-40.
de Will&en, P., 1991. Nitrogen turnover in the soil-crop
system; comparison of fourteen simulation models. Fert.
Res., 27: 141-149.
Diekkriiger, B. and Arning, M., 1995. Simulation of water
fluxes using different methods for estimating soil parame-
ters. Ecol. Model., 81: 83-95.
Diekkriiger, B., N%ersheuser, P. and Richter, O., 1995.
Modeling pesticide dynamics of a loam site using HERB-
SIM and SIMULAT. Ecol. Model., 81: 111-119.
Franko, U,, OeIschlTgel. B, and Schenk, S., 1995. Simulation
of temperature, water- and nitrogen dynamics using the
model CANDY. Ecol. Model., 81: 213-222.
Grant, R.F., 1995. Dynamics of energy, water, carbon and
nitrogenin agricultural ecosystems: Simulation and experi-
mental validation. Ecol. Model., 81: 169-181.
Jaryis, NJ., 1995. Simulation of soil water dynamics and
herbicide persistence in a silt loam soil using the MACRO
model. Ecol. Model., 81: 97-109.
Kersebaum, KC., 1995. Application of a simple management
model to simulate water and nitrogen dynamics. Ecoi.
Model., 81: 145-156.
McVoy, C.W., Kersebaum, K.C., Arning, M., Kleeberg, P.,
Othmer, H. and Schrijder, U., 1995. A data set from north
Germany for the validation of agroecosystemmodels: dot-
umentation and evaluation. Ecol. Model., 81: 265-297.
Mirschel, W., Wenkel, K.-O. and Koitzsch, R., 1995. Simula-
tion of soil water and evapotranspiration using the model
BOWET and data sets from Krummbach and Eisenbach,
two research catchments in North Germany. Ecol. Model,,
81: 53-69.
Morgenstern, M. and Kloss, R., 1995. Simulation of the soil
water balance on the “Intensive Loam Site”. Ecol. Model.,
81: 41-52.
 B. Diekkriiger et al. ,I Ecological Modellin~ 81 (1995~J-29 29

Schaaf. T., Priesack. E. and Engel, T., 199% Comparing field
data from north Germany with simulation of the nitrogen
model N-SIM. EC& Model., 81: 223-232.
Schriider, U., Richter, 0. and Velten, K., 1995. Performance
of the plant growth models of the Special Collaborative
Program 179 with respect to winter wheat. Ecol. Model.,
8 1: 243-250.
Schultz, A. and Mirschel, W., 199% Simulating soil water
balance, nitrogen behaviour and biomass components us-
ing the agroecosystem model AGROSIM-Winter Wheat
and data from the north German Krummbach catchment.
Ecol. Model., 81: 133-144.
Smith, R.E., 1995. Opus simulation of a wheat/sugarbeet plot
near Neuenkirchen, Germany. Ecol. Model., 81: 121-132.
Spain. J.D., 1982. BASK microcom puter models in biology.
Addison-Wesley, London.
Svendsen. H.. Hansen, S. and Jensen, H.E.. 1995. Simulation
of crop production, water and nitrogen balances in two
German agro-ecosystems using the DAISY model. Ecol.
Model.. 81: 197-212.
Vanclooster, M.. Viaene, P., Dichls, J. and Feyen, J., 1995. A
deterministic evaluation analysis to an integrated m&crop
model. Ecol. Model.. 81: 183-195.
Whitmore, A.P., 19%. Modelhng the mineralization and
leaching of nitrogen from crop residues during three suc-
cessive growing seasons. Ecol. Model.. 233-241.