Professional Documents
Culture Documents
What Is Chaos?: March 2008
What Is Chaos?: March 2008
net/publication/260719595
WHAT IS CHAOS?
CITATIONS READS
9 1,814
3 authors:
Muhammad Shafiq
University of Vaasa
57 PUBLICATIONS 425 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Sajid Iqbal on 13 March 2014.
1
subsequent behavior of the system i.e., a system in
Subharmonics, quasiperiodicity are some other
which the later states of the system follow from, or
types. This field of science more generally called
are determined by, the earlier ones. Such a system
“Nonlinear dynamics” is the study of dynamical
contrasts with a “stochastic or random system” in
behavior (i.e., the behavior in time) of a nonlinear
which future states are not determined from
system. A nonlinear system is a system whose time
previous ones e.g., sequence of heads or tails of an
evolution equations (differential equations) are
unbiased coin, or radioactive decay [4].
nonlinear i.e., the variable in the equation appear in
a nonlinear form. Nonlinear systems have always
If a system is deterministic, this doesn’t necessarily
played an important role in the study of natural
imply that later states of the system are predictable
phenomena, but the last few decades have seen an
from knowledge of the earlier ones. In this way,
intensified interest and renewed vigour in nonlinear
chaos is similar to a random system. For example,
systems research [1-2].
chaos has been termed "deterministic chaos" since,
although it is determined by simple rules, its
The main reason for this growth is the recent
property of sensitive dependence on initial
availability of inexpensive computing power.
conditions makes a chaotic system, in practice,
Unlike linear systems, which have closed-form
largely unpredictable. Hence uunpredictable
solutions, few nonlinear systems possess closed-
behavior of deterministic system is called “chaos”.
form solutions and therefore, numerical techniques
The core of the problem is to harmonize this
play a crucial role in the process of finding and
underlying determinism with the apparent
analyzing nonlinear phenomenon. Before the
randomness [2,4].
advent of low cost computers, the ability to
perform nonlinear simulations was restricted to
II. HISTORY OF CHAOS
researchers with access to a large computing
facility; now, anyone with a personal computer
may simulate a nonlinear system [4]. The roots of chaos theory go back to Henry
Poincaré who tried to resolve an unresolved
problem of Newtonian Laplacian celestial
One of the elementary tenets of science is that
mechanics, the three body problem. In which he
deterministic systems are predictable: given the
found that there can be orbits which are
initial condition and the equations describing a
nonperiodic, and yet not forever increasing nor
system, the behavior of the system can be predicted
approaching a fixed point. Through this
for all time. The discovery of chaotic systems has
investigation Poincaré came to understand that
eliminated this viewpoint. Simply put, a chaotic
infinitely complicated behaviors could arise in
system is a deterministic system that demonstrates
simple nonlinear systems [1-2].
random behavior. Chaos also called “strange
behavior”, is currently one of the most exciting
topics in nonlinear systems research [2,4]. One of the earliest known experimental reports of
deterministic chaos occurred during 1927 in the
British scientific journal Science. The Dutch
D. Nonlinearity and Chaos
electrical engineer Balthasar van der Pol and his
colleague van der Mark, reported on the "irregular
Linear systems are never chaotic; for a dynamical
noise" heard in a telephone earpiece attached to an
system to display chaotic behavior it has to be
electronic tube circuit [1-2].
nonlinear. The basic element for understanding
chaos is the concept of nonlinearity. Nonlinear
Chaos theory stems, in part, from the work of
dynamics is concerned with the study of systems
Edward Lorenz of MIT, a meteorologist, who
whose time evolution equations are nonlinear. All
simulated weather patterns on a computer in 1960.
real systems are nonlinear at least to some extent.
Working with a computer having limited memory,
Some abrupt and dramatic changes in nonlinear
after viewing a particular pattern, he wanted to
systems may give rise to the complex behavior
recover the data and started the program again,
called chaos. The words, chaos and chaotic are
except he put in the values rounded off to 3 places
employed to describe the time behavior of a system
instead of the original 6. He was surprised to find a
when that behavior is aperiodic (it never exactly
completely different result on his computer. Lorenz
repeats) and is “apparently” random or noisy.
printed a paper about this subject called,
Beneath this apparent chaotic randomness is an
"Predictability: Does the Flap of a Butterfly's
order determined by the system equations.
Wings in Brazil Set off a Tornado in Texas?" and
Actually, most of the chaotic systems are
the title of “The Butterfly Effect” has remained [1-
completely deterministic [2,6].
2,6].
A system is deterministic if the above given
Actually the butterfly effect phenomenon was
guidelines in principle completely determine the
discovered by Lorenz during his investigation into
2
a system of coupled differential equations (1) used theory was the computer. Much of the mathematics
as a simplified model of 2D thermal convection, of chaos theory involves the repeated iteration of
known as Rayleigh-Bernard convection. These simple mathematical formulas, which would be
equations are now called the Lorenz equations are impractical to do by hand. Computers made these
given as: repeated calculations practical, while figures and
images made it possible to visualize these systems.
dx [2].
= σ(x − y)
dt
dy (1) III. QUANTIFYING CHAOS
= − xz + rx − y
dt
dz It can be difficult to tell from data whether a
= xy − bz physical or other observed process is random or
dt
chaotic, because in practice no time series consists
of “pure signal”. There will always be some form
Where σ, r and b are dimensionless parameters.
of corrupting noise, even if it is present as round-
Fig.1 above shows the Lorenz attractor. The orbit is
off or truncation error. Thus any real time series,
bounded but not periodic and but convergent.
even if mostly deterministic, will contain some
randomness. Mathematicians have devised many
additional ways to make quantitative statements
about chaotic systems. These include: fractal
dimension of the attractor, Lyapunov exponents,
recurrence plots, Poincaré maps, bifurcation
diagrams, and transfer operator.
3
The logistic map is a non-invertible map i.e., the periodic fixed point becomes unstable and two new
map can be iterated forward in time with each xn stable fixed points emerge. This equation
leading to a unique subsequent value xn+1, the demonstrates how deterministic systems (the stable
reverse is not true. It is also called “iterated map outcomes) can, when pushed, produce
function” as it maps one value of x, say x0 , into unpredictable and chaotic outcomes. At higher
another value of x that we call x1. By repeatedly values of r (3.5-4) the system demonstrates
iterating the logistic map, various kinds of sensitive dependence on initial conditions that is,
behaviors can be observed. The sequence of minor changes in the value of r results in markedly
iterated solutions to the map is called a “trajectory” different outcomes [1].
as well as “orbit” [1].
An interesting feature of this diagram is that as the
B. Bifurcation Diagram of Logistic Map periods go to infinity, r remains finite. When r is
greater than approximately 3.57, the orbits become
A bifurcation is a qualitative change in the chaotic. Hence this bifurcation diagram
dynamics that occurs as a system parameter is demonstrates a nice example of the importance of
changed. A bifurcation diagram shows the possible chaos theory in even very simple nonlinear
long term values a variable of a system can obtain systems. Bifurcation diagram is the basic tool of
as function of a parameter of the system. An studying the change in system behavior in response
example is the bifurcation diagram of the logistic to the variation of system parameters [2].
map. In this case, the parameter r is shown on the
horizontal axis of the plot and the vertical axis V. ATTRACTORS
shows the density of the possible long term
population values of the logistic function [1-2]. The orbit of the logistic map is attracted through
repeated iterations towards the orbit whether it is
periodic or chaotic. The “attractor” is the set of
points approached by the orbit as the number of
iterations increases to infinity i.e., it is the
equilibrium solution to which the system
converges. If the system settles down to a periodic
orbit, then it is said to have a “periodic attractor”
e.g., periodic-1 attractor, periodic-2 attractor or
periodic-4 attractor and so on. If on the other hand
the system behaves chaotically with an aperiodic
orbit, then it is said to have a “chaotic attractor”
more commonly referred to as a “strange attractor”.
A strange attractor contains an infinite number of
points bounded within a definite region of the state
space (an attractor with fractal dimension); the
Fig. 2 Bifurcation Diagram
resulting behavior is called “chaos”. Thus chaos is
a bounded aperiodic behavior of a system. In short,
Fig. 2 above shows that for r less than one, all the
the attractors are the pinnacle and origin of chaos
points are plotted at zero. Zero is the one point
[1-2].
attractor for r less than 1. For r between 1 and 3, we
still have one point attractors, but the 'attracted'
As Lorenz was the first person to chance upon a
value of x increases as r increases, at least to r = 3.
strange attractor, he noticed that for certain ranges
Bifurcations occur at r = 3, r = 3.45, 3.54, 3.564,
of a parameter, the trajectories starting from very
3.569 (approx.), etc., until just beyond 3.57, where
close initial conditions diverge fast and lead to
the multiple unstable periodic oscillations, which
entirely different future states. This is called
means chaotic behavior. A small change in r can
“sensitive dependence on initial conditions” that is
make a stable system chaotic, and vice versa. This
a hallmark of chaos and the key property of chaotic
sequence is called the "period doubling route to
systems [3].
chaos" [1].
This sensitivity has a very important implication.
The period doubling sequence occurred through the
Much of the study of dynamical systems is
bifurcation (splitting into two) of the previous fixed
propelled by the necessity of predicting future
points when they become unstable. It nicely shows
states of the system. But sensitive dependence on
the forking of the possible periods of stable orbits
initial conditions in chaotic systems renders
from 1 to 2 to 4 to 8 etc. This splitting is known as
prediction impossible beyond a short period of
“Pitchfork Bifurcation’. At each period doubling
time. The reason is that initial conditions cannot be
bifurcation point the previously stable attracting
measured or specified with infinite accuracy.
4
Minuscule errors in defining initial conditions do
not matter in stable periodic systems, for orbits
starting from slightly different initial conditions do
not diverge exponentially. But in a chaotic
attractor, arbitrarily close states diverge
exponentially and prediction becomes impossible
unless the initial conditions are known with infinite
information and specified with infinite accuracy
that is impossible. In brief, two nearby starting
points can evolve into two entirely uncorrelated
trajectories. Hence the final state is unpredictable
even though the system is deterministic [5].
VI. CONCLUSIONS
REFERENCES
[1] Paul S Addison. Fractals and Chaos. An
illustrated course. IOP Publishing Limited.
1997.
[2] Robert C. Hilborn. Chaos and Nonlinear
Dynamics. An Introduction for Scientists and
Engineers. Oxford University Press. 1994.
[3] D. C. Hamill, S. Banerjee and G. C.
Verghese, “Chapter 1: Introduction,”
Nonlinear Phenomena in Power Electronics,
edited by S. Banerjee and G. C. Verghese,
New York. IEEE Press, 2001. pp. 1-20.
[4] Thomas S. Parker and Leon O. Chua,
“Chaos: A Tutorial for Engineers”, IEEE
Proceedings 75 (8), 1987. pp 982-1008.
[5] S. Banerjee, “Chapter 3: Basics of
Bifurcation and Chaos Theory,” Nonlinear
Phenomena in Power Electronics, edited by
S. Banerjee and G. C. Verghese, New York,
IEEE Press, 2001. . pp. 53-110.
[6] Edward N. Lorenz. The Essence of Chaos.
Washington University Press. 1993.