Professional Documents
Culture Documents
Journal of Convention & Event Toruism
Journal of Convention & Event Toruism
To cite this article: Zvi Schwartz PhD (1997) Convention and Conference Facilities, Journal of
Convention & Exhibition Management, 1:1, 71-88, DOI: 10.1300/J143v01n01_06
-----
Reservations
Data
Outside Model
Information
Managersevaluate 3
inputs and submit thelr
prediction
Zvi Schwartz 73
ANALYSIS OF ERRORS
Data
This study uses the forecast errors of a model described in Schwartz and
Hiemstra (1996). The correcting algorithm is applied to their data and
prediction errors to demonstratc its applicability when group bookings dis-
tort the prediction of a solid quantitative model. In their study, Schwartz and
Hiemstra tested the accuracy of several methods in forecasting daily occu-
pancies in three hotels. The occupancy in 45 sampled days was predicted
for each ,of the following forecasting horizons: 1,2,3,7, 14,2 1,30,45,60,
and 99 days in advance. That is, for each hotel, 450 daily predictions were
tested using information from up to 1149 past booking curves (a period of
about three years). The errors of the Curves Siinilarity model are used since
the Curve Similarity model was the most accurate among thc tested models.
Errors are measured as the percentage of the absolute deviation (APE).That
IAi - ~ i l= , I:~
A.100 where Ai is the number of rooms sold at day i, Fi is
is, yq- I
the forecasted number of rooms sold at day i, and ei is the prediction error at
day i. The data set includes 3 hotels; however, due to space limitations, this
study describes how the adjustment process is applied to one hotel only.'
Pattern of Errors
The analysis of the errors begins with a visual inspection of the
observed errors' patterns. The graphs were examined since a systematic
pattern can reveal a cause of inaccuracy and thus indicate what remedies
might be necessary. A chart of the accuracy level (measured as the Abso-
lute Percentage Error) vs. the forecasting horizon is plotted for each day
of the sample. These graphs are grouped as follows: For each forecasted
Zvi Schwurfz 73
day, the forecasting horizon with the worst performance (or the larger
APE) is identified. Then, all days (graphs) with the same worst forecast-
s
ing horizon are grouped together and lotted on the same chart. For
example, Figure 2 holds 8 sampled days. Thcse days belong to the same
group because all of them have the worst predictions at a forecasting
horizon of 30 days.
Note the similarities of the patterns in Figure 2. This surprising degree
of similarity indicates that there is a systematic cause behind the observed
errors. Furthermore, note how the model’s accuracy is significantly
improved when moving from a forecasting horizon of 14 days to 2 1 days,
and then deteriorates at the 30 days horizon. The reason for this phenome-
non becomes clear when one inspects the actual booking curves of these
days given by Figure 3.
Most curves have a similar shape. The “saddle” pattern in Figure 2
seems to be caused by a sharp increase in the number of booked rooms
(Figure 3) starting around 30 days before the date of stay.
How Does a Large Increase in Number of Reservations on Hand
Aflect the Model’sAccuracy?
Sudden and large shifts in the curve’s shape represent a large amount of
bookings within a short period of time. These significant changes in num-
ber of booked rooms are believed to be a major source of distortion for
quantitative extrapolative forecasting models. It is easy to see why the
changes might affect trend or growth models. These models analyze the
trend, fit a line to the data, and extrapolate to the future. Thus, a sharp
change in the shape of the curve, which occurs immediately atter a predic-
tion is made, is likely to increase the forecasting error. Consider the typical
FIGURE 2. APE of 8 Different Curves (Max. APE at forecasting horizon of
30 days)
APE
35%
30%
25?&
ewe
15%
10%
5%
0 20 40 60 80 100
Forecastinghorizon
76 JOURNAL OF CONVENTION & EXHIBITION MANAGEMENT
Reservations
so0
400
300
200
100
0
150 -
100 - ..-..-.._..
50-
0.
FIGURE 5. A Typical Error When a Large Change Occurs Soon After the
Forecast is Made
Reservations
150
100.
FIGURE 6.A Typical Error When a Large Change Occurs Before the Fore-
cast Is Made
Reservations
150 120 90 60 30 0
Days before the date of stay
closer the predictions are to the jump, the larger the negative error is.
Predictions made after a jump are higher than the actual (Forecasting
horizon of 7,3,2,and 1 days).
The visual inspection of the charts leads to the following hypotheses:
H(a) Theforecasting error is negatively related to the change in resewa-
tions that occurs in theperiod following theforecasting day.
H(b) Theforecasting error is positively related to the change in ivsewa-
tions that occurs in the period preceding theforecasting day.
78 JOURNAL OF CONVENTION t3 EXHIBITION MANAGEMENT
H(c) The strength of the relation hypothesized in H(a) and H(b) depends
on theforecasting horizon.
H(d) The efect of a change in reservations on the forecasting error is
larger when the changefollows the day offorecast.
The changes in the number of reservations on hand (before and after the
prediction) were recorded for every observation. Table 1 lists the “win-
dows,” or the number of days before and after the prediction in which the
change in reservations was measured.
The relations between the errors and the changes in reservations before
the prediction are more complicated, The plots indicate a strong positive
Reservatlons
120 loo 80 60 45 21 0
Days before the date of stay
Zvi Scltwartz 79
10
14 10 10
L 21
I 10
I 10
I
45 10 15
60 10 20
99 10 20
Prediction's Errors
150 T
linear relation for short forecasting horizons (1-3 days) and a weaker
positivc linear relation for a 7 days horizon. Horizons of 14 and 21 days
show a quasi Sine pattern that converges to zero (Figure 9). The scatter
plot of 30 to 99 days shows little or no correlation.
80 JOURNAL OF CONVENTION & EXHIBITION MANAGEMENT
loo--
50--
**
-100-
-150 *
.
The Linear Model
A first order linear model with two independent variables was fitted:
where
j = (14,21),
The fitted regression function in the original units of XIis given by:
RESULTS
The linear regression model (1) was applied to ten forecasting horizons
(SAS Institute Inc. 1988). The results are reported in Table 2. The F tests
for the regression relation are shown at the top of the table. The test
indicates that with a > 95%, HO: = fl2 = 6 3 = 0 is rejected for forecasting
horizons of 1 to 45. That is, for these forecasting horizons, a linear relation
exists between the dependent variable (predictions error) and the set of
independent variables. HO is not rejected for forecasting horizons of 60 to
99. This result is not surprising since no linear relations were observed in
the relevant scatter plots. Also note the adjusted coefficient of multiple
determination. It indicates how much of the variation in the prediction
error is reduced when the two independent variables (bookings before and
bookings after) and the cross product variable are considered. About 70%
of the variation can be eliminated by the regression models of forecasting
horizons 1 to 7. Moderate levels of reduction (30% to 60%) can be
expected for forecasting horizons of 14 to 45.
The partial F tests (not reported here) and the equivalent t tests indicate
that some of the linear regression models might be improved by excluding
one independent variable and the interaction variable. As indicated by the
scatter plots, an improvement can be gained by modeling the nonlinear
relations. The results of the nonlinear model with the Sine transformation
(3), is reported in Table 3. Note the improvement in F test, in adjusted R2
and in the P value of the regression coefficients when XIis transforme&.
DISCUSSION
The results of the linear regression model and those of the nonlinear
model suggest that hypotheses a and b cannot be rejected for forecasting
horizons of I to 45 days. That is, the hypotheses on the relation between a
&
TABLE 2. Results of First Order Linear Model with Two Variables and an Interaction
Horizon
Ragressini9aXs&s 1 2 3 4 14 21
R Square 70% 76% 77% 74% 62% 56%
Adjusted R Square 68% 74% 76% 72% 59% 53%
F-Sianiticance 0.0000 o.oo00 0.0000 O.oo00 0.0000 0.0000
Bookings after
wediction
(hoking before) ..
" P" .*.
.. .... ..,.* *<., ....
,,yq$p ..
(booking after) I -0.006 0.013 1 -0.004 0.035 I -0.003 0.024 0.165 .
bA,. <,,
W$ k&&& 0.192 0.306
Regression Statistics 30 45 60 99
R Square 35% 44% 7% 7%
Adjusted R Square 3o?A 40% 0% OYO
R Square 73%
Horizon
21
61%
I
Adjusted R Square 71% 58Vo
F-Significance
~~
I
CoeHicie P-value
I
Coefficie P-value
I
Intercept 45.347 0.000
Bookings before prediction 600.420 0.011
Bookings afier prediction -0.740 -0.683
(bookingbeforeMbookina after)
change in reservations that occurred before or after the prediction and the
forecasting error are supported. Furthermore, since various significance
levels were observed, it is apparent that these relations depend on the
forecasting horizon and H(c) is supported as well. For forecasting horizons
ofj = 1 .. .7,the absolute value of pjl is smaller than the absolute value of
p.2, that is, lpjll < 10j21. Hence, hypothesis H(d), which speculates that the
change following the prediction has a larger effect, is supported. This
finding does not hold for the nonlinear model. The comparison of the two
coefficients is not immediate. When a transformation is performed, the
estimator has least square properties with respect to the transformed
observations, and not with respect to the original observations (see Neter,
Wasserman, & Kutner, 1990, p. 15 1). Thus, to estimate the effect of Xj, on
Yj, we differentiate Yj with respect to Xjl. In this special case of a quasi
Sine transformation, it is given by:
84 JOURNAL OF CONVENTION & EXHIBITION MANAGEMENT
CONCLUSION
This study suggests a systematic procedure that combines the predic-
tion of a forecasting quantitative model with judgmental prediction. The
inclusion of human judgment is aimed at reducing the forecast errors by
considering information which is not available to the quantitative model.
The study identified the sharp changes in reservations to be a major cause
of inaccuracy and formulated the relations between the forecast errors and
the large increases in reservations. These relations can be used to adjust
the prediction of the quantitativemodel. The correcting algorithm requires
a judgmental prediction of group reservations.
The framework suggested in this article is significantly different from
the one currently practiced by many convention hotels. Currently, as
86 JOURNAL OF CONVENTION & EXHIBlTlON MANAGEMENT
30 Y = 54.2-0.602X2
45 Y = 87.759-0.594X2
60 N/A
99 NIA
--- -
Reservation
Data
__.--
--
I Outside Model
1 Informatlon
NOTES
1. The mechanism of fitting a correcting algorithm and the framework of the
model are identical for all convention hotels; the actual parameters of the correct-
ing formulas as listed in the results section would vary among hotels.
2. Microsoft Excel Version 5 was used in the production of the charts in this
paper. Figure 2 is a scatter XY chart (Microsoft, 1993, p. 328). The curve is
smoothed by the piecewise addition of linearly blended second order polynomials
(Burger & Gilles, 1992, pp. 276-277).
REFERENCES
ASAE (1993). ASAE 1993 Factbook, Washington, DC. American Society of
Association Executives, 24.
Andrew W.,Cranage D. and Lee C. (1990). Forecasting hotel occupancy rates
with time series models: An empirical analysis. Hospitality Reseatrh Joiirnal,
I4 (2), 173-8I.
Bunn D. and Wright G. (1991). Interaction of judgmental and statistical forecast-
ing methods: issues & analysis. MattagemettfScience, 37 (9, 50 1-5 18.
Burger P. and Gilles D. (1992). Interactive Cornpuler Graphics, Firttclional, Pro-
cedural and Device Level Methods. Addison- Wesley, Palo Alto.
Hogarth R . and Makridakis S.(1981). Forecasting and planning: An evaluation.
Managemenl Science. 227, 1 15-38.
Libby R. and Lewis B. (1982). Human information processing in accounting: The
state of the art. Accotiriling Orgartizafiotts,and Sociely, 7, 23 1-85.
88 JOURNAL OF CONVENTION di EAWIBITION MANAGEMENT
SUBMITTED: 09/26/96
ACCEPTED: 0 1/ 12/97