Professional Documents
Culture Documents
CSME2024TestMethodsSubmissionCopy
CSME2024TestMethodsSubmissionCopy
Abstract—This paper presents a benchmark between two Nowadays, vehicle modeling and simulation is important
testing methods for evaluating light-weight vehicles’ for active safety systems development [6,7]. Simulations are
lateral/yaw stability with and without electronic stability increasingly used in the designs and tests of ground vehicles in
control (ESC) systems. To date, the open-loop test method, virtual environments prior to physical prototypes being
i.e., Sine with Dwell testing maneuver, recommended by fabricated [8]. In the Australia performance-based standards
FMVSS-126 is widely applied to objectively evaluate the for articulated heavy vehicles, both in-vehicle test and
lateral/yaw stability of road vehicles with and without ESC. simulation are permitted to evaluate the directional
On the other hand, the closed-loop approach, that is, Double performance of these large vehicles [9]. The open-loop testing
Lane-Change testing maneuver, suggested by ISO-3888-1 is procedure by FMVSS-126 has been well-specified in the
commonly used to subjectively assess the lateral/yaw commercial software package, CarSim [10], for assessing the
dynamics of conventional passenger cars. To identify potential lateral/yaw stability of light-weight vehicles [11].
correlation between these two testing methods, an attempt is
If numerical simulation is allowed to assess the lateral/yaw
made to compare these two methods using numerical
stability of light-weight vehicles, the gap between the
simulations. Simulation results disclose distinct features of
objective and subjective testing methods (i.e., those by
each testing methods.
FMVSS-126 and ISO-3888) may be shortened due to the
Keywords-testing methods for lateral/yaw stability; sine following facts: 1) a well-established driver model may be
with dwell testing maneuver; double lane-change maneuver; selected for the virtual closed-loop test (i.e., the Double
numerical simulation Lane-Change maneuver); 2) the fine-tuned driver model is
uniformly used to evaluate all testing vehicles under various
I. INTRODUCTION operating conditions. To identify the gap between the open-
To increase safety of light-weight vehicles (e.g., passenger and closed-loop testing methods and find the root causes for
cars), the US Government has established FMVSS-126, which shortening the gap between the objective and subjective
is a vehicle standard that requires all passenger cars sold in testing procedures, we compare these two testing methods
North America to include an electronic stability control (ESC) through the evaluation of the lateral/yaw stability of a sport
system starting in 2012 [1]. An ESC system has the ability to unit vehicle (SUV) with and without ESC using numerical
produce a yaw moment for enhancing the lateral stability of simulations based on CarSim software. The objective of this
the vehicle without driver intervention [2]. Simulations and research is to find an effective alternative to the open-loop
tests demonstrate that vehicle stability and path-following testing method by FMVSS-126 for effectively evaluating the
performance under emergency maneuvers at high lateral lateral/yaw stability of light-weight vehicles.
accelerations can be improved with ESC systems [3]. The rest of the paper is organized as follows. Section II
To objectively assess the lateral/yaw stability of passenger introduces the open- and closed-loop testing methods. Section
cars with and without ESC, an open-loop testing method, i.e., III describes the selected testing vehicles. Section IV presents
Sine with Dwell testing procedure, was recommended by the simulation results of the SUVs based on the objective and
FMVSS-126, and it is widely applied [4]. On the other hand, subjective testing approaches. Section V compares the two
to subjectively evaluate the lateral/yaw stability of testing methods based on the attained simulation results.
light-weight vehicles, a closed-loop testing approach, that is, Finally, conclusions are drawn in Section VI.
Double Lane-Change maneuver, is recommended by II. TESTING METHODS
ISO-3888 [5]. Both testing methods are executed on proving
ground with in-vehicle tests. This section briefly introduces the open- and closed-loop
testing methods recommended by FMVSS-126 [4] and
ISO-3888 [5], respectively.
1
A. Sine with Dwell (Open-loop) Testing Method Lateral acceleration at 1.07 seconds after initial steering input,
To validate ESC systems, FMVSS-126 recommends an can be calculated as follows,
open-loop test procedure, i.e., Sine with Dwell test as shown
in Fig. 1. The test procedure uses a sinusoidal steering wheel
input with a frequency of 0.7 Hz. The initial speed of the
vehicle is 80 km/h.
where the lateral displacement should be larger than 1.83m,
when GVWR ≥ 3,500 kg, while the lateral displacement needs
to be larger than 1.22m, when GVWR <3,500 kg. Note that
t0 = Steering wheel input starting time,
AC.G. = Lateral acceleration, corrected for the effect of roll
angle and sensor offset from vehicle C.G. position.
B. Double Lane Change Testing Method
Figure 1: Sine with Dwell steering input [4]. The double lane change test procedure outlined in
ISO-3888-1 is a method to subjectively evaluate the
Three separate tests are performed, where the vehicle is lateral/yaw stability of light-weight vehicles. Fig. 2 shows the
travelling at 80 km/h, and the steering angle is increased at specific test course layout. The track dimensions of the
13.5 deg/sec until lateral acceleration of 0.5 g is met. This test Double Lane Change are as follows; Section 1 length is 15m,
is also done in the opposite direction, with a steering angle with a width of 1.1 x vehicle width + 0.25m. Section 2 length
increased at -13.5 deg/sec until -0.5 g lateral acceleration is is 30m. Section 3 length is 25m, lane offset of 3.5m, with a
met [4]. width of 1.2 x vehicle width + 0.25m. Section 4 length is 25m.
The lateral stability for the Sine with Dwell test is defined Section 5 length is 15m, with a width of 1.3 x vehicle width +
as a ratio of vehicle yaw at a specific time, to the first local 0.25m. Section 6 length is 15m, with a width of 1.3 x vehicle
peak yaw rate at 0.7 Hz. A typical ESC-equipped vehicle has width + 0.25m [5].
less than 5 percent likelihood of satisfying the NHTSA’s
spinout definition if it meets the required lateral criteria. Two
lateral stability criteria tests are done to see if the ESC meets
the requirements. One second after completing the Sine with
Dwell manoeuvre, the yaw rate cannot be more than 35% of
the first local peak yaw rate. 1.75 seconds after completing the
Figure 2: Double lane change track sections [5].
manoeuvre, the yaw rate cannot be more than 20% of the first
local peak yaw rate. ISO states that the initial test should have an entry speed of
80 +-3 km/h. The secondary test run should be taken at the
maximum possible speed that allows the vehicle to
successfully complete the test [5]. A test will be deemed
successful if the vehicle is able to make the double lane
change within the prescribed path.
where,
III. TESTING VEHICLES
ψt = Yaw rate at time t (in seconds),
ψPeak = First local peak yaw rate generated by the 0.7 Hz Sine The vehicle model chosen to be used throughout all
with Swell steering input, simulations is the standard CarSim E-Class SUV. The specific
t0 = Time to completion of steering input. details of the vehicle model are listed in Table I.
The responsiveness criterion measures the ability of a TABLE I. E-CLASS SUV VEHICLE PARAMETERS
vehicle's responsiveness to the driver's inputs while ESC is
Table Column Head
intervening. The lateral displacement of the vehicle's centre of Variable
gravity with respect to the initial straight path during the Sine Term Value Units
with Dwell manoeuvre, prior to the steering dwell, defines the hC.G. Height of centre of gravity 720 mm
criterion. It’s important that the acceptable lateral stability l Wheelbase 2950 mm
threshold does not compromise the driver’s manoeuvrability a Distance from CG to front axle 1180 mm
of the vehicle. The limit of an ESC-equipped vehicle with a
b Distance from CG to rear axle 1770 mm
Gross Vehicle Weight Rating (GVWR) of 3,500 kg has a
minimum lateral displacement of 1.83 metres at 1.07 seconds Wt Track width 1575 mm
after initial steering input. If the GVWR is greater than 3,500 hf Front ride height 390 mm
kg, the minimum lateral displacement is 1.22 metres [3]. hr Rear ride height 380 mm
h Height of vehicle body 1714 mm
2
Table Column Head
Variable
Term Value Units
m Sprung mass 1590 kg
IXX Roll inertia 984.4 kg-m2
IZZ Yaw inertia 2687.1 kg-m2
IYY Pitch inertia 2687.1 kg-m2
mfu Front unsprung mass 102.2 kg
Figure 5: Yaw rate over the entire test procedure.
kf Front spring rate 146 N/mm
mru Rear unsprung mass 115 kg Fig. 5 more clearly illustrates where the ESC Off vehicle
kr Rear spring rate 46 N/mm
fails the Sine with Dwell test. The yaw rate continually
increases, to the point where the vehicle no longer satisfies the
In this research, the SUV with and without ESC is modeled lateral stability criterion.
in CarSim. For simplicity, ESC On denotes the SUV with
ESC, while ESC Off represents the SUV without ESC. Using
both the open- and closed-loop testing methods, numerical
simulation based on CarSim is used to evaluate the lateral/yaw
stability of the SUV with and without ESC. Note that in the
closed-loop testing, the built-in driver model in CarSim is
used.
IV. SIMULATION RESULTS
C. Sine with Dwell Figure 6: Vehicle roll with resetting time.
This section outlines the CarSim results for the Sine with
Dwell procedure. Due to the nature of the procedure, test Fig. 6 illustrates the impact of yaw control on the ESC On
results are overlaid between consecutive runs with varying vehicle. As ESC is activated, the body roll will be controlled,
steering inputs. represented by the sharp and sudden decline in roll angles.
Figure 3: Steering wheel angle with resetting time. Figure 7: Lateral acceleration with resetting time.
Fig. 3 displays the steering wheel angle for the Sine with Fig. 7 demonstrates how the ESC system interacts with the
Dwell procedure with increasing amplitudes. This is similar to vehicle under large lateral acceleration forces. The rapid
Fig. 2, only with multiple iterations, with both left- and adjustments in the graph are moments the ESC is engaged.
right-hand turns being conducted. TABLE II. SINE WITH DWELL ESC OFF FAILURE
Table II shows the data at the point where the ESC Off
vehicle fails the Sine with Dwell test and compares it with the
Figure 4: Yaw rate with resetting time.
ESC On vehicle at the same instance. It should be noted that
Fig. 4 shows the yaw rates for ESC On and ESC Off. Fig. the ESC On vehicle passes every iteration of the Sine with
5, shown below, depicts the yaw rates for both vehicles plotted Dwell procedure.
over the entire test procedure, with no overlay. Up to the point of ESC Off failure, the ESC On vehicle
experiences lower yaw rates.
3
D. DOUBLE LANE CHANGE
1) Double Lane Change, Test 1, 80km/h
Similar to Sine with Dwell, various output parameters
were recorded in CarSim, depicted below.
4
Figure 16: Roll angle comparison at 113 km/h.
At the failure speed, there is no delay from when the roll Figure 18: Double lane change max yaw rate ESC On/Off.
angle increases for either ESC On or Off. At approximately
Yaw rate plays an important role when determining the
2.25 seconds into the test, the ESC begins engaging which is
stability of a vehicle during extreme manoeuvres. At the
demonstrated by the rapid movements of the roll angle output.
failure speed of 113 km/h, the maximum yaw rate for ESC
Even at the maximum speed, the roll angle has lower
enabled was 19.47 deg/s, and without ESC was 26.27 deg/s.
maximum values demonstrating its effectiveness.
Without an ESC controller, there is an increase of peak yaw
rate by 35%. A lower yaw rate helps maintain control of the
vehicle is one of the most important aspects to investigate
when determining the stability of a vehicle. This demonstrates
that the test applies the ESC system under extreme
manoeuvres.
5
TABLE V. SINE WITH DWELL AND DOUBLE LANE CHANGE, ESC ON VI. CONCLUSIONS
Maximum Run Values Obtained During
Each Test, ESC On For the SUV without ESC, in the failure cases as shown in
Test Speed, Table IV, both the open- and closed-loop testing methods
Lateral
Procedure [km/h] Yaw Rate Roll Angle
Acceleration achieve excellent agreement in terms of the vehicle
[deg/s] [deg]
[g] performance measures of yaw rate, roll angle, and lateral
Sine with acceleration. This implies that using numerical simulations
Dwell 77.2 38.90 2.45 0.367 and well-established driver models, the open- and closed-loop
Double Lane 113 19.47 2.46 0.694 testing methods can attain a direct correlation. Compared with
Change the open-loop testing method, the closed-loop testing method
is more time efficient. However, for the SUV with ESC, in the
failure cases shown in Table V, the two testing methods
TABLE VI. SINE WITH DWELL AND DOUBLE LANGE, ESC OFF
exhibit significant differences in terms of vehicle performance
Maximum Run Values Obtained During
Each Test, ESC Off
measures, except for the roll angle. This may be attributed to
Test Speed,
Lateral the fact that the open-loop testing method emphasizes yaw rate
Procedure [km/h] Yaw Rate Roll Angle control with very rigid limitation, whereas the closed-loop
Acceleration
[deg/s] [deg]
[g] method only specifies loose path boundary violation criteria.
Sine with It’s expected that if equivalent yaw rate control limitation is
Dwell 77.5 25.22 2.47 0.640 predefined for the closed-loop testing method, both methods
Double Lane 113 26.27 2.46 0.650 may be in good agreement of vehicle performance measures.
Change This prediction will be validated in the future research.
The Sine with Dwell test is an open-loop manoeuvre, while ACKNOWLEDGMENT
Double Lane Change is a closed-loop. This posed a challenge
We would like to thank Connor Stephens and Philip Moore
to compare them as the results may be interpreted much
for their assistance with CarSim initialization and research.
differently. It was decided upon that the comparison would be
based on how much the ESC system would be engaging
REFERENCES
during a range of speeds, up until the point of failure. As the
results will be displayed much differently, this allows us to see [1] National Highway Traffic Safety Administration (NHTSA), Final
how much the ESC system is being applied and tested. Regulatory Impact Analysis: FMVSS No. 126, Electronic Stability
Control Systems. Office of Regulatory Analysis and Evaluation,
For the Double Lane Change manoeuvre, it was determined National Center for Statistics and Analysis, 2007.
that the failure of the test would be once the vehicle exits the [2] E. Lee, S. Kapoor, T. Sikder, and He, Y. He, “An optimal robust
controller for active trailer differential braking systems of car-trailer
track dimensions. Using the maximum values obtained from combinations,” Int. J. Vehicle Systems Modelling and Testing, Vol. 12,
the results, it can be determined that reducing a speed by a Nos. 1/2, pp.72–93.
calculated amount will provide set regulations for the [3] S. Zhu, and Y. He, “A driver-adaptive stability control strategy for sport
investigated parameters. Comparing the results can prove to utility vehicles,” Vehicle System Dynamics, Vol. 55, No. 8, pp:
1206-1240.
be difficult, as the Sine with Dwell test has maximum limit
values for the lateral acceleration and yaw rate. The Double [4] US Department of Transportation, “Laboratory test procedure for
Lane Change only has physical track dimensions to determine FMVSS 126, electronic stability control systems,” National Highway
Traffic Safety Administration, Washington, DC 20590, USA.
whether the test is successful or not. However, determining the
[5] International Organization for Standardization, Passenger cars – Test
difference between ESC On and Off values for each test can track for a severe lane-change manoeuvre – Part 1: Double lane-change,
determine how active the stability control system is, providing ISO-3888-1, Second edition. Geneva: International Organization for
insight as to whether it’s a suitable test. Standardization; 2018.
[6] J. Yu, and Y. He, “A model-based design synthesis method for
Table V shows the results of both tests with ESC On. For autonomous articulated vehicles,” Applied Mathematical Modelling,
Sine with Dwell, the yaw rate exceeded the maximum value. 127: 803-822, 2024.
For the Double Lane Change, the maximum lateral [7] S. Zhu, Z. Ni, A. Rahimi, and Y. He, “On dynamic stability evaluation
acceleration was found. Table VI shows the results of both methods for long combination vehicles,” Vehicle System Dynamics, Vol.
tests with ESC Off. For Sine with Dwell, the lateral 60, No. 12, pp:3999-4034, 2022.
acceleration exceeded the maximum value. For the Double [8] B. Duprey, M. Sayers, and T. Gillepie, “Using TruckSim to test
performance based standards,” SAE paper 2012-01-1919, 2012.
Lane Change, the maximum yaw rate was found. This
[9] National Transport Commission, Performance-based standards scheme –
demonstrates that the Sine with Dwell test utilizes the ESC the standards and vehicle assessment rules. National Heavy Vehicle
more for the yaw rate of the vehicle, while the Double Lane Regulator, Australian, November 2022.
Change method utilizes the ESC for lateral acceleration. This [10] M. Sayers, and P. Mather, “FMVSS 126 Electronic Stability Test and
information is useful as each test will provide different data CarSim,” Technical Memo, Mechanical Simulation, 2008.
regarding vehicle handling and ESC efficiency. Due to testing [11] S. Zhu, and Y. He, “Design and validation of differential braking
time being less for the Double Lane Change compared to the controllers for sport utility vehicles considering the interactions of driver
Sine with Dwell, this will result in less cost. and control system,” Ergonomics International Journal, Vol. 2, No. 3, pp:
1-15, 20018.