Professional Documents
Culture Documents
Nonvestibular Motion Cueing in A Fixed-Base Driving Simulator: Effects On Driver Braking and Cornering Performance
Nonvestibular Motion Cueing in A Fixed-Base Driving Simulator: Effects On Driver Braking and Cornering Performance
de Groot*
J. C. F. de Winter
Department of BioMechanical
Engineering
Faculty of Mechanical, Materials and
Maritime Engineering
TU Delft
2628 CD, Delft, The Netherlands
M. Mulder
Control and Simulation Division
Faculty of Aerospace Engineering
TU Delft
2600 GB, Delft, The Netherlands
P. A. Wieringa
Department of BioMechanical
Engineering
Faculty of Mechanical, Materials and
Maritime Engineering
TU Delft
2628 CD, Delft, The Netherlands
Abstract
Motion platforms can be used to provide vestibular cues in a driving simulator, and
have been shown to reduce driving speed and acceleration. However, motion platforms are expensive devices, and alternatives for providing motion cues need to be
investigated. In independent experiments, the following eight low-cost nonvestibular
motion cueing systems were tested by comparing driver performance to control
groups driving with the cueing system disengaged: (1) seat belt tensioning system,
(2) vibrating steering wheel, (3) motion seat, (4) screeching tire sound, (5) beeping
sound, (6) road noise, (7) vibrating seat, and (8) pressure seat. The results showed that
these systems are beneficial in reducing speed and acceleration and that they improve
lane-keeping and/or stopping accuracy. The seat belt tensioning system had a particularly large influence on driver braking performance. This system reduced driving speed,
increased stopping distance, reduced maximum deceleration, and increased stopping
accuracy. It is concluded that low-cost nonvestibular motion cueing may be a welcome
alternative for improving in-simulator performance so that it better matches
real-world driving performance.
Introduction
Driving simulators are broadly used for research, training, and assessment.
The effectiveness of a simulator depends to a large extent on its fidelity, or level
of realism. A distinction can be made between two types of fidelity: objective
(or physical) fidelity and perceptual (or psychological) fidelity (Advisory Group
for Aerospace Research and Development, 1980; Burki-Cohen, Soja, & Longridge, 1998). Objective fidelity is the extent to which the simulator replicates
the physical characteristics of the simulated vehicle and environment, for example, in terms of brightness and contrast of visual display, or temporal synchronization of physical motion. Perceptual fidelityarguably a more valid criterion
than objective fidelityis defined as the degree to which the operators performance and control strategies in the simulator and real vehicle correspond, as
well as the degree to which the operator subjectively perceives the simulator to
produce its real-world counterpart. Researchers have been concerned with gaining an in-depth understanding of the relationship between user performance
Presence, Vol. 20, No. 2, April 2011, 117142
2011 by the Massachusetts Institute of Technology
*Correspondence to s.degroot@tudelft.nl.
Experiments
2.1 Apparatus
0
2
0
0
0
9
3
5
20
13
60
12
28
36
15
31
Number of
women
E
I
I
E
E
Experienced/
inexperienceda
W
B
W
W
B
Within-/
betweensubjects
design
2
2
1
1
4
4
1
2
1
1
2
4
1
Number of
sessions per
participant
10 stops
10 stops
10 stops
4 turns
4 stops
4 turns
6 stops
4 turns
14 turns
10 stops
14 turns
8 turns
14 turns
Number of
maneuversb
A
A
A
C
A
B
A
B
C
A
C
B
C
Task
Number of
participants
SG
G
G
SG
G
SG
G
G
SG
G
Automated
controlsd
Unit
Description
Vini
DTTini
DTTfin
R2time
m/s
m
m
Mean V
SD DTTfin
Maximum deceleration
m/s
m
m/s2
Onset jerk
m/s3
NOTE. The measures were calculated for each participant over the 2nd to the 11th stop of the session. t represents
the elapsed time since the onset of braking.
Table 3. Dependent Measures for Tasks B and C
Abbreviation
Unit
Description
NrDeparturesa
LCE45deg (L)
LCE45deg (R)
V45deg (L)
V45deg (R)
SDLP (L)
SDLP (R)
SDLP (L)
SDLP (R)
#
m
m
m/s
m/s
m
m
m
m
All other measures during Task B were calculated for each participant as the mean of the second to the fifth turn of
the session. For Task C, the dependent measures were calculated as the means of all 908 turns with radii of 1520 m.
Data from 10 s prior to 20 s after road departures were removed.
the first moment of pressing of the brake pedal at a distance of less than 175 m before the intersection.
For the cornering tasks (Tasks B and C), the measures
LCE45deg (lane center error at the midpoint of the 908
turn) and V45deg (velocity at the midpoint of the 908
turn) provide information on the path and speed halfway
through the turns. Because only relatively small changes
in vehicle paths can be expected, the speed effectively
determines the lateral acceleration required to complete
a turn. We therefore decided not to include the lateral
acceleration in the measures, also because of the large
Figure 2. (a) Seat belt tensioning system on the back of the seat. From right to left, the motor, gearbox, coupling, and sleeved
cylinder can be seen. The original belt tension device is also visible below the sleeved cylinder. (b) No tensioning moment applied
by motor. (c) Tensioning moment applied, and belt pulled by the sleeved cylinder.
resonating sounds. The experiment was run with 13 participants as a within-subjects design.
2.5.3 Motion Seat (Longitudinal and Lateral
Acceleration Cueing). An investigation by Mollenhauer et al. (2004) showed that a motion seat had a positive effect on driving performance and the subjective experience of realism, irrespective of the motion tuning
Figure 7. (a) Seat cover with 26 vibration elements. The elements are positioned under the drivers left and right legs. (b) Seat
cover as used in the simulator. The two most centrally placed actuators were not used.
Figure 8. (a) Schematic picture of the pressure seat. Note the placement and orientation of the two pneumatic actuators.
The right actuator is active in left turns and vice versa. (b) Pressure system fitted in the back of the simulators seat, with the
two metal plates fitted to the pneumatic cylinders.
shown in Figures 8(a) and 8(b). For left turns, the plate
on the right side was pressurized and the plate on the left
side remained unpressurized. For right turns, this situation was reversed. The maximal force of approximately
200 N was chosen by the experimenters as being the
largest force which could still be considered comfortable
while driving. This experiment was a between-subject
design with 31 participants who had to complete Task C
in one driving session.
3
Results
95% low
95% high
15.84
74.00
4.63
0.96
9.37
2.66
4.51
2.32
<.001
.013
.016
.026
.005
.009
<.001
<.001
0.55
0.69
0.53
0.71
0.46
0.52
0.87
0.99
0.64
22.39
0.32
0.06
0.21
0.23
1.03
2.04
1.72
3.02
2.79
0.00
1.02
1.45
2.45
4.83
14.98
40.08
2.98
0.92
8.45
1.94
6.57
5.48
.267
.632
.570
.178
.169
.859
.253
.013
0.24
0.14
0.15
0.45
0.18
0.05
0.25
0.54
0.35
6.35
0.61
0.05
0.06
0.65
0.24
0.53
1.15
4.01
1.06
0.01
0.32
0.77
0.82
3.76
.511
.734
.086
.401
.492
.186
.317
.001
0.18
0.09
0.48
0.23
0.19
0.37
0.28
0.94
0.98
11.93
0.21
0.03
0.42
0.25
0.42
0.98
1.94
8.45
3.09
0.01
0.87
1.28
1.26
3.75
.524
.298
.703
.160
.667
.201
.595
.277
0.22
0.25
0.14
0.45
0.11
0.50
0.19
0.46
1.04
2.74
1.42
0.05
0.28
0.43
0.69
2.65
0.56
8.14
2.03
0.01
0.18
1.81
1.14
8.39
Off
14.10
36.76
5.41
0.95
9.01
1.77
6.44
5.57
(Continued)
Table 4. Continued.
p
.255
.572
.845
.148
.181
.359
.327
.212
0.44
0.22
0.08
0.56
0.52
0.35
0.38
0.48
0.77
8.79
1.80
0.01
0.21
0.53
0.49
0.80
2.77
15.57
1.48
0.07
1.08
1.40
1.41
3.43
.181
.590
.519
.934
.023
.350
.367
.495
0.46
0.18
0.22
0.03
0.79
0.32
0.30
0.23
0.37
18.11
1.30
0.03
0.10
0.82
0.63
2.34
1.91
10.46
2.53
0.04
1.20
2.25
1.67
4.77
Off
On
14.43
52.43
5.23
0.93
9.43
2.40
6.37
5.66
95% low
95% high
p represents the probability of observing the given means by chance if the means would actually be equal.
d represents Cohens d, a measure of the size of the difference between the means in relation to the pooled SD.
c
95% low and 95% high represent the 95% confidence interval for the true difference of population means.
b
Eng
Fun
On
On
pa
db
95% lowc
95% highc
.503
.515
.957
.139
.610
.189
.640
0.21
0.21
0.02
0.48
0.16
0.42
0.15
0.40
0.33
0.26
0.20
0.65
0.02
0.09
0.80
0.66
0.27
1.39
1.10
0.12
0.14
95% low
95% high
.195
.995
.882
.188
.872
.863
.731
0.42
0.00
0.05
0.42
0.05
0.05
0.11
0.19
0.59
0.26
0.25
0.96
0.08
0.16
0.89
0.59
0.22
1.24
0.81
0.09
0.11
95% low
95% high
.143
.388
.075
.672
.114
.184
0.32
0.12
0.46
0.16
0.72
0.53
0.00
0.17
0.21
0.07
1.15
0.03
0.25
0.00
1.05
0.09
1.23
0.77
0.24
0.05
95% low
95% high
.231
.585
.299
.188
.878
.675
.743
0.46
0.21
0.40
0.51
0.06
0.16
0.13
0.11
1.02
1.24
0.53
1.21
0.22
0.25
0.44
1.77
0.40
2.55
1.41
0.33
0.35
(Continued)
Table 5. Continued.
Off
On ? Off
On
95% low
95% high
.161
.453
.830
.268
.806
.214
.260
0.56
0.29
0.08
0.44
0.10
0.49
0.44
0.10
0.84
0.33
2.21
1.29
0.04
0.06
0.56
0.39
0.27
0.64
1.01
0.18
0.21
95% low
95% high
.798
.909
.044
.165
.342
.568
.058
0.09
0.04
0.70
0.47
0.32
0.19
0.65
0.77
0.85
0.60
0.35
0.60
0.09
0.01
0.99
0.96
0.01
1.95
1.68
0.17
0.36
On ? Off
On
95% low
95% high
.042
.841
.537
.845
.279
.379
.131
0.70
0.07
0.21
0.07
0.37
0.30
0.52
0.02
0.62
0.42
0.78
0.49
0.07
0.05
1.31
0.76
0.23
0.94
1.65
0.18
0.36
95% low
95% high
.334
.880
.417
.367
.024
.819
.145
0.22
0.02
0.18
0.16
0.46
0.07
0.50
0.08
0.54
0.39
0.82
0.10
0.10
0.03
0.21
0.47
0.17
0.32
1.22
0.08
0.17
(Continued)
Table 5. Continued.
Off
On
95% low
95% high
.493
.333
.073
.607
.328
.230
.003
0.25
0.36
0.68
0.19
0.36
0.45
1.16
0.76
0.33
0.74
0.94
0.73
0.04
0.11
1.55
0.93
0.04
1.58
2.12
0.17
0.50
p represents the probability of observing the given means by chance if the means would actually be equal.
d represents Cohens d, a measure of the size of the difference between the means in relation to the pooled SD.
c
95% low and 95% high represent the 95% confidence interval for the true difference of population means.
b
maneuver. The largest effects were found for the stopping consistency (p .201, d 0.50), onset jerk (p
.277, d 0.46), and deceleration smoothness (p .160,
d 0.45), all in favor of the on condition. A remarkable but insignificant finding is that because of the
screeching tire sound, participants started braking from
higher speeds (p .524, d 0.22) and at shorter distances to the intersection (p .298, d 0.25), but with
slightly lower maximum decelerations (p .595, d
0.19). In this respect, it must be noted that the feedback
was only presented when the longitudinal acceleration
was larger than 8 m/s2 in the longitudinal direction and
7.2 m/s2 in the lateral direction. This feedback only
appeared at the highest decelerations, and might cause
participants to search for the onset limit of the sound,
thereby increasing their average deceleration values.
An important aspect of the screeching tire sound is
that it can act like a binary warning signal, leading to behavioral adaptation. The mean maximum deceleration
for the combined on and off groups was 7.1 m/s2 in sessions 1 and 2 and 5.9 m/s2 in sessions 3 and 4, which is
a significant difference (p .002, d 0.60). An additional control group of five participants (data not shown)
who drove without any screeching tire sounds showed
constant maximum deceleration over time: 6.3 m/s2 in
sessions 1 and 2 and 6.2 m/s2 in sessions 3 and 4 (p
Off
On
36.3
60.3
36.1c
36.1c
50.4
48.1
50.0
47.2
48.2
56.5
52.5
41.2
pa
db
.027
.026
.308
.504
.241
0.73
0.73
0.39
0.22
0.44
p represents the probability of observing the given means by chance if the means would actually be equal.
d represents Cohens d, a measure of the size of the difference between the means in relation to the pooled SD.
c
Two experiment results were tested against the same baseline score.
b
For the motion seat, both the engineering and fun ride
approaches of motion cueing resulted in a significant
increase of the realism score compared to no-motion
feedback.
Vini (m/s)
DTTini (m)
DTTfin (m)
R2time ()
Mean V (m/s)
SD DTTfin (m)
Maximum deceleration (m/s2)
Onset jerk (m/s3)
pa
db
95% lowc
95% highc
.014
.178
.015
.139
.002
.005
.001
<.001
0.30
0.18
0.31
0.20
0.35
0.36
0.41
0.57
0.12
7.31
0.15
0.02
0.12
0.17
0.27
1.21
1.11
1.35
1.44
0.00
0.56
0.95
0.99
3.21
0.07
0.12
0.33
0.12
0.10
0.01
0.01
0.43
0.46
0.05
0.88
0.70
0.09
0.15
.161
.252
.009
.011
.137
.114
.022
0.20
0.14
0.32
0.33
0.20
0.23
0.33
p represents the probability of observing the given means by chance if the means would actually be equal.
d represents Cohens d, a measure of the size of the difference between the means in relation to the pooled SD.
c
95% low and 95% high represent the 95% confidence interval for the true difference of population means.
b
Vini (m/s)
DTTini (m)
DTTfin (m)
R2time ()
Mean V (m/s)
SD DTTfin (m)
Maximum deceleration (m/s2)
Onset jerk (m/s3)
Inexperienced
(n 34)
Experienced
(n 26)
pa
db
95% lowc
95% highc
15.77
47.93
6.00
0.93
10.16
3.38
6.92
7.19
16.08
52.55
4.38
0.92
10.12
2.35
6.33
5.24
.605
.348
.046
.468
.912
.045
.174
.081
0.14
0.25
0.53
0.19
0.03
0.53
0.36
0.46
1.50
14.39
0.03
0.01
0.55
0.03
0.27
0.25
0.88
5.15
3.20
0.03
0.62
2.04
1.44
4.15
p represents the probability of observing the given means by chance if the means would actually be equal.
d represents Cohens d, a measure of the size of the difference between the means in relation to the pooled SD.
c
95% low and 95% high represent the 95% confidence interval for the true difference of population means.
b
Discussion
esting result was that the subjective realism of the simulator was increased irrespective of what cueing strategy
was used (fun ride or engineering approach).
The screeching tire sound caused participants to avoid
high acceleration during driving sessions 3 and 4 as compared to sessions 1 and 2. A disadvantage of screeching
tire feedback, however, is that the tire sound is only
audible during very high accelerations. With the sound,
participants braked later than without the sound, and
from higher speeds; they subsequently slowed down
with fewer brake modulations, higher mean deceleration,
but a smaller maximal deceleration. This indicates that
drivers braked so that they searched for the limit of hearing the screeching tire sound. Because many driving simulation studies report on unrealistically fast driving, the
screeching sound seems a justified means to avoid the
highest accelerations, but does not solve the problem of
a lack of motion cues during normal driving conditions.
In order to present proportional auditory feedback from
low acceleration levels, the beeping sound feedback was
developed. During braking, slightly lower speeds were
obtained because of the beeping sound, but the deceleration profile was found to be less constant. During cornering, a lower speed for left turns, slightly smaller lane
center errors, and fewer road excursions were found. A
quasitransfer test (Task C without feedback) showed that
the group previously driving with beeps had slightly
smaller SDLP values for both left and right turns and
also had fewer road excursions. This shows that the
beeps might have caused a small learning effect for steering the car smoothly through the turns.
The road noise feedback was not based on vehicle
acceleration, but instead on vehicle speed. The mean
speed was reduced during the braking task, and all other
measures improved slightly as well. For the cornering
task, speeds and lane center errors were also reduced,
but only the decrease in lane center error for right turns
reached statistical significance. When the feedback was
removed in a subsequent session, the effects were
reduced in magnitude, but the participants formerly
driving with the speed feedback had fewer road departures. This shows that adding speed-dependent feedback
can help to reduce vehicle speeds, as has been found
before by Davis and Green (1995) and can subsequently
noise system showed that retraction of the supplementary cues had a favorable effect on the number of road
departures. A potential disadvantage of using unrealistic
cues during training is that the transfer to a real vehicle is
disturbed, because the learner depends on cues during
training which do not exist in reality. The human sensorimotor system is highly adaptive to varying sensory contributions. For human stance control, a number of
experiments have demonstrated the adaptation capabilities of the human sensorimotor control system
(Peterka & Loughlin, 2004; Van der Kooij, Jacobs,
Koopman, & Van der Helm, 2001; Nashner, Black, &
Wall, 1982). When certain cues are missing, or others
exaggerated, humans will adapt quickly to the new situation. It is therefore likely that acceleration cues in the
simulator would be substituted swiftly by vestibular feedback when transferring to a real vehicle. Nonetheless, it
remains an open question as to whether or not alternative motion cueing systems result in satisfactory transfer
to the real world (see also Groeger & Banks, 2007). This
question will have to be answered empirically by experiments.
Acknowledgments
This research is supported by the Dutch Ministry of Economic
Affairs. We thank Green Dino BV, The Netherlands. Parts of the
results in this paper have been presented at earlier conferences
(Boschloo, Wieringa, Kuipers, De Winter, & Mulder, 2005; De
Winter et al., 2007; De Winter, De Groot, Mulder, Wieringa, &
Dankelman, 2008). We further acknowledge the eight teams of
undergraduate students who contributed to the development
and experimental testing of the various low-cost motion cueing
systems.
References
Advisory Group for Aerospace Research and Development.
(1980). Fidelity of simulation for pilot training (AGARDAR-159). Neuilly sur Seine, France: North Atlantic Treaty
Organization.
Allen, R. W., Park, G., Cook, M., & Fiorentino, D. (2009).
Training and assessment of novice drivers. In Proceedings of
the Driving Simulation Conference, 91102.
Suzuki, K., & Jansson, H. (2003). An analysis of drivers steering behaviour during auditory or haptic warnings for the
designing of lane departure warning system. JSAE Review,
24, 6570.
Vaden, E. A., & Hall, S. (2005). The effect of simulator platform motion on pilot training transfer: A meta-analysis. The
International Journal of Aviation Psychology, 15, 375393.
Van der Kooij, H., Jacobs, R., Koopman, B., & Van der Helm,
F. (2001). An adaptive model of sensory integration in a
dynamic environment applied to human stance control. Biological Cybernetics, 84, 103115.
Van Erp, J. B. F. (2005). Presenting directions with a vibrotactile torso display. Ergonomics, 48, 302313.
Von der Heyde, M., & Riecke, B. E. (2001). How to cheat in
motion simulationComparing the engineering and fun ride
approach to motion cueing (Technical Report No. 089).
Tubingen, Germany: Max Planck Institute for Biological
Cybernetics.