Professional Documents
Culture Documents
Jusoh Et Al (2023) Numerical Solver of A (Alpha) - Stable For Stiff ODEs
Jusoh Et Al (2023) Numerical Solver of A (Alpha) - Stable For Stiff ODEs
______________________________________________________________________________________
and multistep methods, while addressing the stability II. RESEARCH METHODOLOGY
behavior associated with stiffness. Among the active First, the general linear multistep method (LMM) for
research related to the idea are elaborated in [2] and [3] first-order ODEs is examined in the following manner.
which show different approaches in “hybriding” methods
from two different backgrounds. Meanwhile, studies on the k k
A( ) − stability properties of numerical methods,
j =0
j yn + j = h j y 'n + j ,
j =0
(3)
specifically the RK methods, by [4] show that those
methods are able to solve problems of stiffness efficiently.
The Singly Diagonally Implicit RK (SDIRK) was first where j and j are constants by assuming that not both
proposed by [5] which emphasized the requirement of 0 and 0 are zero, with k 0 . k is the order of the
identical diagonal coefficients, aii = . This condition
method and h is the step size.
ensures that the linear system, when solved using Newton Subsequently, the linear difference operator is formulated
iteration, adopts the form of I − hJ . As a result, the for the A( ) − Extended Singly Diagonally Implicit BBDF
computational cost of predicting solutions is reduced, as the
system is solved with the same matrix for each time step, as ( A( ) − ESDIBBDF) method, incorporating additional
mentioned in [6]. Besides, the singly diagonally implicit function evaluation, as demonstrated below.
approach overcomes certain limitations encountered by both
k + s −1 k + s −1
fully implicit and explicit RK methods, as discussed in [7].
In [8], the Block BDF (BBDF) method demonstrated Ls ( y ( x); h) :
j =0
s, j −2 yn + j − 2 = h s , k + j − 2 f n + j − 2
j =3
(4)
better performance compared to the classical BDF method
in solving stiff problems, achieving improved accuracy and
execution time. Instead of estimating solutions individually, where k = 3 ; s = 1, 2, 3 for yn +1 , yn + 2 and yn + 3
the method employs a block-wise approach by utilizing the respectively.
previous block of backvalues. To enhance the accuracy of In order to establish a singly diagonally implicit behavior,
the BBDF method, [9] introduced the Block Extended BDF the diagonal elements of the method are set as i ,i = and
(BEBDF) method, which includes additional function i ,i = . Then, we expand (4) to get
evaluations.
The relevance of a method in solving stiff problems is
demonstrated by its stability properties. According to [10], L1 ( y ( x); h) = 1, −2 yn − 2 + 1, −1 yn −1 + 1,0 yn + yn +1 − hf n +1
the proposed method must be at least almost A − stable to L2 ( y ( x); h) = 2, −2 yn − 2 + 2, −1 yn −1 + 2,0 yn + 2,1 yn +1 +
solve stiff problems. Meanwhile, [11] introduced a method
with L( ) − stability which is the requirement for numerical yn + 2 − h ( 2,4 f n +1 + f n + 2 )
integration for stiff initial value problems. The Singly L3 ( y ( x); h) = 3, −2 yn − 2 + 3, −1 yn −1 + 3,0 yn + 3,1 yn +1 +
Diagonally Implicit BBDF (SDIBBDF) method developed 3,2 yn + 2 + yn + 3 − h ( 3,4 f n +1 + 3,5 f n + 2 + f n + 3 )
in [3], offers enhanced A − stability and effectively
estimates solutions for stiff problems compared to other (5)
existing solvers. Additionally, [12] introduces the A()
Equation (5) is arranged in matrix form, and each column
Stable BBDF with fixed coefficients, emphasizing its ability
matrix is let as A j and B j as follows:
to efficiently solve stiff ODEs while maintaining stability.
Furthermore, this research will examine the error norm
minimization technique proposed by [13] to attain a specific A0 A1 A2 A3 A4 A5
order of accuracy. This technique involves selecting free 1, −2 1, −1 1,0 yn − 2 0 0 yn +1
parameters of the principal error norm of the method, as
expressed by the following equation. 2, −2 2, −1 2,0 yn −1 + 2,1 0 yn + 2 =
3, −2 3, −1 3,0 yn 3,1 3,2 yn +3
n p +1 (6)
B3 B4 B5
( p +1 j )2
A( p +1) =|| ( p +1) ||2 = (2)
j =1 0 0 f n +1
h 2,4 0 f n + 2
Therefore, the objective is to develop the 3,4
3,5 f n + 3
A( ) − ESDIBDDF method that is capable to solve stiff
ODEs efficiently.
The structure of the paper is as follows: The subsequent Taylor series expansion about x = xn is applied to the
section provides the derivation of the proposed method, approximate relations of (5), and the y ' terms are collected
while the following sections focus on the analysis of which yields
convergence and stability. Section V delves into the
implementation of the method, while Section VI discusses Ls ( y ( x); h) = C0 y ( x) + C1 y '( x) + + Cq y q ( x ) + , (7)
the numerical simulations conducted. Finally, the overall
findings of the research are concluded in Section VII.
where
B j = B3 + B4 + B5 =
100 10 100
Given that convergence conditions relate to the 11
j =3
consistency of a method, the following definition of 1 1 60 3
consistency is provided. 100 100 25
Definition 4. An LMM is said to be consistent if it has order By satisfying condition (11), the A( ) − ESDIBBDF
p 1. method confirms its consistency. Consequently, it can be
verified that the method meets the second condition for
Since the A( ) − ESDIBBDF method satisfies Definition 4 convergence, which is zero stability that can be defined as
as it is of order 3 thus, the method is consistent.
From (8), Definition 6. An LMM is said to be zero stable if no root of
the first stability polynomial, p ( ) , has modulus greater
Definition 5. A block method is consistent if and only if than one, and if every root with modulus one is simple.
where A j , B j are r r matrices and the linear difference (r , h ) = (r ) − h(r ) = 0 ,
Definition 8. The LMM in (1) is said to be absolutely stable In order to effectively solve stiff ODEs, a method must
in a region R for a given H if and only if for that H , all possess an A( ) − stability, which is an essential property
the roots, rs = rs H of the stability polynomial of the linear associated with stiffness. However, the following theorem
k − step method, (r , H ) = ( r ) − H ( r ) , satisfy | rs | 1 , by [14] revealed that
ks = 1, 2, , k where H = h and (r ) and (r ) are the
Theorem 3. (i) An explicit LMM cannot be A− stable. (ii)
first and second characteristic polynomials respectively. The order of an A− stable implicit LMM cannot exceeded
Otherwise, the method is said to be absolutely unstable. two. (iii) The second order A− stable implicit LMM with
smallest error constant is the Trapezoidal rule.
Fig. 1 illustrates the region of absolute stability for LMM
as referred to [12]. The figure shows that the region of
Due to the fact that the A( ) − ESDIBBDF method is an
absolute stability is on the left part and half of the plane as
stated in Definition 9. order 3, achieving A− stability is not possible.
In view of this, two alternative stability properties, as
defined by [17], which are more practical and suitable for
the solutions of many problems are presented here.
S = {H :| Arg (− H ) | , H 0} . (13)
Fig. 1. The region of absolute stability for LMM. The stability graph of the method is generated using
Maple software. Therefore, the stability region of the
Definition 9. A numerical method is said to be A− stable if A( ) − ESDIBBDF method is given as the unshaded region
its region of absolute stability contains the whole left-hand of Fig. 2 with D = 0.56 and = 65 .
half-plane, Re(h) 0 .
with 1,2,3 are the backvalues. Then, notation i is where T is the total number of steps whereas N is the
number of equations.
introduced to specify the iteration as follows:
Table 1 to 4 represent the numerical results obtained from
en(i++11) = yn(i++11) − yn(i+)1 , en(i++21) = yn(i++21) − yn(i+)2 , en(i++31) = yn(i++31) − yn(i+)3 the derived method in comparison to existing solvers. The
subsequent notations have been employed:
where y ( i +1) denotes the (i + 1)th iterative values of
yn +1, n + 2, n + 3 , and e ( i +1)
denotes the differences between A( ) − ESDIBBDF : A( ) − Extended Singly
n +1, n + 2, n + 3
Diagonally Implicit BBDF
the (i )th and (i + 1)th iterative values of yn +1, n + 2, n + 3 . BBDF(3) − : Block Backward Differentiation
Thus, the Newton iteration takes the form: − Formulas of order 3 by [18]
FI3BBDF : Fully Implicit 3-Point Block
( i +1) F ( y (i ) ) Backward Differentiation
y n +1 =y (i )
n +1 − 1 n(i+)1 ,
F1( yn +1 ) Formulas by [8]
ode15s : Variable step variable order solver
( i +1) F ( y (i ) )
y n+2 =y (i )
n+2 − 2 n(i+) 2 , based on the numerical
F2( yn + 2 ) differentiation formulas by
F3 ( yn( i+)3 ) MATLAB
yn( i++31) = yn( i+)3 − . ode23s : Modified Rosenbrock formula of
F3( yn( i+)3 ) order 2 by MATLAB
h : Step size
The following matrix shows the computational MAXE : Maximum error
arrangements conducted to obtain the approximations: AVE : Average error
TIME : Computational time
6 f n +1
1− h 0 0
11 yn +1 e( i +1)
169 3 f n +1 6 f n + 2 n( i++11) Test Problem 1 (Linear equation):
− − h 1− h 0 en + 2 y ' = −10 y + 10
110 55 yn +1 11 yn + 2 e( i +1) with initial condition of y (0) = 2 for the interval of
6 f
9 3 f n+3
137 3 f n + 2 0 x 10 .
− − h n +1 − − h 1 − h n+3
2 55 yn +1 110 55 yn + 2 11 yn + 3 Exact solution: y ( x) = 1 + e −10 x
Eigenvalue: = −10
6 Source: Artificial problem.
−1 11 0 0
0 0 (i )
yn +1 f n +1 1
(i )
Test Problem 2 (System of linear equation):
(i )
= 0 yn + 2 + h 0 f n(+i )2 + 2
169 3 6
−1 1
110 (i ) 55 11 y1 = 9 y1 + 24 y2 + 5cos x − sin x,,
9 137 yn + 3 f (i )
3 6 n+3 3 3
−1 3 1
2 110 55 55 11 y2 = −24 y1 − 51y2 − 9 cos x + sin x,
3
4 2
with initial conditions of y (0) = , over x 0,10 .
VI. NUMERICAL SIMULATION 3 3
This section focuses on performing numerical experiments 1
Exact solution: y1 ( x) = 2e −3 x − e −39 x + cos x,
involving linear and system of nonlinear stiff problems to 3
assess the efficiency of the A( ) − ESDIBBDF method in 1
y2 ( x) = −e −3 x + 2e −39 x − cos x
terms of maximum error and computational time. 3
Eigenvalues: 1 = −3, 2 = −39
Source: [19].
0 x 10 . h METHOD y1 y2 y3
Eigenvalue: −2000 10-2 A() − ESDIBBDF 3.39132e+02 4.73979e+00 2.86203e+01
Source: [21]. ode15s 1.74768e-02 1.75038e-07 4.45546e-03
ode23s 1.74566e-02 1.74705e-07 4.46974e-03
Table 1 and 2 represent numerical results when
the A( ) − ESDIBBDF method is solving linear stiff ODEs A() − ESDIBBDF
-4
10 1.46530e-06 5.34398e-09 6.33550e-07
problems with different step sizes. The results are compared ode15s 1.74840e-02 1.75169e-07 4.45557e-03
with compatible existing methods in terms of accuracy ode23s 1.74723e-02 1.75240e-07 4.45215e-03
(MAXE) and computational time (TIME). The numerical 10-6 A() − ESDIBBDF 7.04146e-07 1.99246e-11 1.27377e-07
results presented are illustrated as accuracy curves in Figure
ode15s 1.74950e-02 1.75599e-07 4.44233e-03
3 and 5, and as efficiency curves in Figure 4 and 6.
ode23s 1.74877e-02 1.75097e-07 4.44364e-03
TABLE 1
NUMERICAL RESULTS FOR TEST PROBLEM 1
Based on the results, the proposed method has better
h METHOD MAXE TIME accuracy than the comparing methods. Accuracy of the
10-2 A() − ESDIBBDF 1.57520e-02 5.74144e-06 solutions is getting better when smaller step sizes are used
BBDF(3) − 2.66015e-02 3.01573e-05
as analysed in Figure 3 and 5. This is due to the higher
number of function evaluations which contributes to better
FI3BBDF 7.46115e-02 6.20203e-05
accuracy. By observing the efficiency curves in Figure 4 and
10-4 A() − ESDIBBDF 1.77907e-06 5.06323e-05 6, the A( ) − ESDIBBDF method is able to compute
BBDF(3) − 1.47613e-05 2.54289e-04 solutions more efficiently compared to the existing methods.
FI3BBDF 1.10060e-03 5.93956e-04 This is explained by the nature of the method which is in the
10-6 A() − ESDIBBDF 1.78097e-10 3.97866e-03 singly diagonally implicit form instead of fully implicit.
BBDF(3) − 1.64619e-09 2.18970e-02
Meanwhile, for the numerical results in Table 3 and 4, the
methods are tested with a system of nonlinear problem and
FI3BBDF 1.10361e-05 5.90466e-02 the well-known Chemistry problem by Robertson which has
a highly stiff behaviour that models the kinetics of a
TABLE 2 chemical reaction. By referring to [22], the problem has only
NUMERICAL RESULTS FOR TEST PROBLEM 2 a single stiff eigenvalue which is almost to −2000 . These
h METHOD MAXE TIME problems are the ideal indicators to measure the
performance of a method as a stiff solver. Therefore, for
10-2 A() − ESDIBBDF 2.88653e-01 4.71617e-05
these experiments, the proposed method is compared with
BBDF(3) − 1.57000e-01 5.93021e-04 ode15s and ode23s, the MATLAB solvers for stiff
FI3BBDF 1.22995e-01 8.90275e-04 problems. Since the program for A( ) − ESDIBBDF
10 -4
A() − ESDIBBDF 5.37948e-05 6.12751e-04 method is running using a C++ software, thus the TIME
BBDF(3) − 1.40000e-03 1.83490e-03 between the two Mathematical software will not be
FI3BBDF 8.45420e-03 4.88259e-03 considered as it is not a fair comparison.
By referring to Table 3 and 4, it can be analysed that the
10-6 A() − ESDIBBDF 5.40211e-09 7.25020e-02
ode15s and ode23s have comparable accuracy. These results
BBDF(3) − 1.45000e-07 1.83291e-01 can be clearly observed in the accuracy curves of the
FI3BBDF 8.54545e-05 4.68624e-01 numerical results presented in Figure 7 and 9. When solving
for the highly stiff problem as shown in Table 4, both
solvers are able to compute the solutions better than the
proposed method when a bigger step size of h = − 0.01 is
used.
Fig. 3. Accuracy curves for Test Problem 1 Fig. 5. Accuracy curves for Test Problem 2
Fig. 4. Efficiency curves for Test Problem 1 Fig. 6. Efficiency curves for Test Problem 2
Fig. 7. Accuracy curves for Test Problem 3 Fig. 9. Accuracy curves for Test Problem 4
REFERENCES
[1] A. A. Nasarudin, Z. B. Ibrahim, and H. Rosali, “On the integration of
stiff ODEs using block backward differentiation formulas of order
six,” Symmetry, vol. 12, no. 6, pp: 952, 2020.
Fig. 8. Efficiency curves for Test Problem 3 [2] S. J. Aksah and Z. B. Ibrahim, “Modified block Runge-Kutta methods
with various weights for solving stiff ordinary differential equations,”
Global J. Pure Appl. Math., vol. 12, no. 6, pp: 5283-5302, 2016.
However, in Figure 9, better accuracy is shown by the [3] S. J. Aksah, Z. B. Ibrahim, and I. S. M. Zawawi, “Stability analysis of
proposed method for each iteration point as the step sizes singly diagonally implicit block backward differentiation formulas for
are getting smaller while there is no significant stiff ordinary differential equations,” Mathematics, vol. 7, no. 2, pp:
improvement shown by both solvers. 211, 2019.
[4] Y. A. Sabawi, M. A. Pirdawood, and A. D. Khalaf, “Semi-implicit
and explicit Runge-Kutta methods for stiff ordinary differential
equations,” J. Phys.: Conf. Ser., vol. 1999, no. 012100, 2021.
VII. CONCLUSION [5] S. P. Nørsett, “Semi-explicit Runge-Kutta methods,” Dept. of Math.
Comp., Univ. Trondheim, Trondheim, Norway, Rep. No. 6/74, 1974.
In this paper, the three points A( ) − ESDIBBDF method of [6] J. Stal, “Implementation of singly diagonally implicit Runge-Kutta
order three for solving the first order stiff ODEs is methods with constant step sizes,” Bach.elor’s thesis, Lund Univ.,
Lund, Sweden, 2015.
successfully developed. The method implements the strategy [7] F. Ismail, N. I. Jawias, M. Suleiman, and A. Jaafar, “Solving linear
Error norm minimization technique for better accuracy is ordinary differential equations using singly diagonally implicit
also considered when the method is developed. Runge-Kutta fifth order five-stage method,” WSEAS Trans. on Math.,
vol. 8, no. 173, pp: 393-402, 2009.