Download as pdf or txt
Download as pdf or txt
You are on page 1of 6

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/260719595

WHAT IS CHAOS?

Article · March 2008

CITATIONS READS

9 1,814

3 authors:

Sajid Iqbal Suhail Aftab


University of Engineering and Technology University of Engineering and Technology, Lahore
61 PUBLICATIONS   415 CITATIONS    37 PUBLICATIONS   165 CITATIONS   

SEE PROFILE SEE PROFILE

Muhammad Shafiq
University of Vaasa
57 PUBLICATIONS   425 CITATIONS   

SEE PROFILE

Some of the authors of this publication are also working on these related projects:

A Novel Environment Friendly and Efficient Gaseous Insulator View project

Master Reserach View project

All content following this page was uploaded by Sajid Iqbal on 13 March 2014.

The user has requested enhancement of the downloaded file.


WHAT IS CHAOS?
Sajid Iqbal1, Suhail Aftab Qureshi2 and Muhammad Shafiq3
1
Faculty of Engineering, University of Central Punjab, Lahore.
2
Department of Electrical Engineering, UET, Lahore.
3
College of Engineering, Islamia University, Bahwalpur.
sajid.iqbal@engg.ucp.edu.pk

ABSTRACT: - Chaos occurs widely in nonlinear A. Properties of Chaotic System


dynamical systems. It is an aperiodic behavior in
a deterministic system that shows sensitive The chaotic dynamical systems must have the
dependence on initial conditions. Chaotic system following characteristics:
exhibits apparently random and unpredictable
1. They must be sensitive to initial conditions.
behavior. In a deterministic system starting from
2. Their periodic orbits must be dense.
an exactly known initial condition we can repeat
3. They must be topologically mixing.
the sequence of outcomes as many times as we
feel like whereas in a random system the sequence “Sensitivity to initial conditions” means that each
of the outcomes cannot be repeated. This new point in such a system is arbitrarily closely
science grounds understanding of order in approximated by other points with significantly
apparent randomness and simplicity in apparent different future trajectories. Therefore, an
complexity. arbitrarily small perturbation of the current
trajectory may lead to significantly different future
Index terms: - Bifurcation, chaos, nonlinear behavior. “Topologically mixing” means that the
dynamics, strange attractor. system will evolve over time so that any given
region or open set of its phase space will eventually
I. INTRODUCTION overlap with any other given region [1-2].

Chaos is often a catchy name for nonlinear B. Importance of Chaos Theory


dynamics. This term is used to explain the
apparently complex behavior of so called simple, The scientists and engineers are absorbed by chaos
linear and well behaved systems. Chaotic behavior theory due to two reasons:
looks erratic and almost random like the behavior
1. Chaos theory has provided theoretical and
of system strongly influenced by external random
noise. The mathematical definition of chaos is experimental tools to categorise and
unpredictable long time behavior arising in a understand complex behavior that had
deterministic dynamical system because of confused earlier theories.
sensitivity to initial conditions (popularly referred 2. Chaos is universal; it shows up in mechanical
oscillators, electric circuits, chemical reactions,
to as the butterfly effect). Chaos theory is defined
as the qualitative study of unstable aperiodic optical systems, nerve cells, lasers etc.
behavior in deterministic nonlinear dynamical The chaotic behavior shows incredible qualitative
systems [1-2,6]. and quantitative universal properties. These
universal properties are independent of system
The chaos occurs in very simple systems that are details. This universality means that what can be
almost free of noise. Actually, these systems are learnt by studying the chaotic behavior of a
fundamentally “deterministic”; i.e., the precise mechanical oscillator can be applied immediately
knowledge of initial conditions of the system to understand the chaotic behavior of other systems
principally allows us to predict future behavior of [3].
that system. Consequently chaos may be described
as a bounded, aperiodic, and noisy like oscillation: C. Nonlinear Dynamics
a deterministic system appears to behave randomly
even though there is no random input. In unstable The word chaos is a catchphrase used to describe a
nonlinear systems a variety of strange effects are particularly complex behavior of dynamical
observed including subharmonics, quasiperiodic systems. Chaos is actually only one kind of
oscillation, intermittency and chaotic behavior [1- behavior exhibited by these systems.
2].

1
subsequent behavior of the system i.e., a system in
Subharmonics, quasiperiodicity are some other
which the later states of the system follow from, or
types. This field of science more generally called
are determined by, the earlier ones. Such a system
“Nonlinear dynamics” is the study of dynamical
contrasts with a “stochastic or random system” in
behavior (i.e., the behavior in time) of a nonlinear
which future states are not determined from
system. A nonlinear system is a system whose time
previous ones e.g., sequence of heads or tails of an
evolution equations (differential equations) are
unbiased coin, or radioactive decay [4].
nonlinear i.e., the variable in the equation appear in
a nonlinear form. Nonlinear systems have always
If a system is deterministic, this doesn’t necessarily
played an important role in the study of natural
imply that later states of the system are predictable
phenomena, but the last few decades have seen an
from knowledge of the earlier ones. In this way,
intensified interest and renewed vigour in nonlinear
chaos is similar to a random system. For example,
systems research [1-2].
chaos has been termed "deterministic chaos" since,
although it is determined by simple rules, its
The main reason for this growth is the recent
property of sensitive dependence on initial
availability of inexpensive computing power.
conditions makes a chaotic system, in practice,
Unlike linear systems, which have closed-form
largely unpredictable. Hence uunpredictable
solutions, few nonlinear systems possess closed-
behavior of deterministic system is called “chaos”.
form solutions and therefore, numerical techniques
The core of the problem is to harmonize this
play a crucial role in the process of finding and
underlying determinism with the apparent
analyzing nonlinear phenomenon. Before the
randomness [2,4].
advent of low cost computers, the ability to
perform nonlinear simulations was restricted to
II. HISTORY OF CHAOS
researchers with access to a large computing
facility; now, anyone with a personal computer
may simulate a nonlinear system [4]. The roots of chaos theory go back to Henry
Poincaré who tried to resolve an unresolved
problem of Newtonian Laplacian celestial
One of the elementary tenets of science is that
mechanics, the three body problem. In which he
deterministic systems are predictable: given the
found that there can be orbits which are
initial condition and the equations describing a
nonperiodic, and yet not forever increasing nor
system, the behavior of the system can be predicted
approaching a fixed point. Through this
for all time. The discovery of chaotic systems has
investigation Poincaré came to understand that
eliminated this viewpoint. Simply put, a chaotic
infinitely complicated behaviors could arise in
system is a deterministic system that demonstrates
simple nonlinear systems [1-2].
random behavior. Chaos also called “strange
behavior”, is currently one of the most exciting
topics in nonlinear systems research [2,4]. One of the earliest known experimental reports of
deterministic chaos occurred during 1927 in the
British scientific journal Science. The Dutch
D. Nonlinearity and Chaos
electrical engineer Balthasar van der Pol and his
colleague van der Mark, reported on the "irregular
Linear systems are never chaotic; for a dynamical
noise" heard in a telephone earpiece attached to an
system to display chaotic behavior it has to be
electronic tube circuit [1-2].
nonlinear. The basic element for understanding
chaos is the concept of nonlinearity. Nonlinear
Chaos theory stems, in part, from the work of
dynamics is concerned with the study of systems
Edward Lorenz of MIT, a meteorologist, who
whose time evolution equations are nonlinear. All
simulated weather patterns on a computer in 1960.
real systems are nonlinear at least to some extent.
Working with a computer having limited memory,
Some abrupt and dramatic changes in nonlinear
after viewing a particular pattern, he wanted to
systems may give rise to the complex behavior
recover the data and started the program again,
called chaos. The words, chaos and chaotic are
except he put in the values rounded off to 3 places
employed to describe the time behavior of a system
instead of the original 6. He was surprised to find a
when that behavior is aperiodic (it never exactly
completely different result on his computer. Lorenz
repeats) and is “apparently” random or noisy.
printed a paper about this subject called,
Beneath this apparent chaotic randomness is an
"Predictability: Does the Flap of a Butterfly's
order determined by the system equations.
Wings in Brazil Set off a Tornado in Texas?" and
Actually, most of the chaotic systems are
the title of “The Butterfly Effect” has remained [1-
completely deterministic [2,6].
2,6].
A system is deterministic if the above given
Actually the butterfly effect phenomenon was
guidelines in principle completely determine the
discovered by Lorenz during his investigation into

2
a system of coupled differential equations (1) used theory was the computer. Much of the mathematics
as a simplified model of 2D thermal convection, of chaos theory involves the repeated iteration of
known as Rayleigh-Bernard convection. These simple mathematical formulas, which would be
equations are now called the Lorenz equations are impractical to do by hand. Computers made these
given as: repeated calculations practical, while figures and
images made it possible to visualize these systems.
dx [2].
= σ(x − y)
dt
dy (1) III. QUANTIFYING CHAOS
= − xz + rx − y
dt
dz It can be difficult to tell from data whether a
= xy − bz physical or other observed process is random or
dt
chaotic, because in practice no time series consists
of “pure signal”. There will always be some form
Where σ, r and b are dimensionless parameters.
of corrupting noise, even if it is present as round-
Fig.1 above shows the Lorenz attractor. The orbit is
off or truncation error. Thus any real time series,
bounded but not periodic and but convergent.
even if mostly deterministic, will contain some
randomness. Mathematicians have devised many
additional ways to make quantitative statements
about chaotic systems. These include: fractal
dimension of the attractor, Lyapunov exponents,
recurrence plots, Poincaré maps, bifurcation
diagrams, and transfer operator.

IV. CHAOS IS EVERYWHERE

Examples of deterministic systems that exhibit


chaos include the atmosphere, the solar system,
Figure 1 Lorenz attractor plate tectonics, turbulent fluids, population growth,
power electronic circuits etc. But still there is more,
The two main components of chaos theory are the chaos thrives in a myriad of areas e.g., biology,
ideas that systems - no matter how complex they computer science, economics, engineering, finance,
may be - rely upon an underlying order, and that mathematics, meteorology, philosophy, physics,
very simple or small systems and events can cause politics, psychology, stock market and robotics and
very complex behaviors or events. This latter idea in future chaos theory will be applied in more fields
is known as “sensitive dependence on initial [1-2, 4].
conditions”, a circumstance discovered by Edward
Lorenz. This sensitive dependence on initial A. Logistic Equation
conditions is referred to as “The Butterfly Effect”
and it has spawned research over the last several The logistic equation (2) also called the “Verhulst
decades known variously as chaos theory, model” is given by the equation:
complexity theory, stochastic processes etc [2,6].

Mitchell Feigenbaum notably discovered the xn +1 = rxn (1 − xn ) (2)


universality in chaos (order in disorder), permitting
an application of chaos theory to many different Where r is a parameter representing growth rate
phenomena. He looked deeply into turbulence, the and xn is the variable at the nth iteration and n is the
home of strange attractors, and saw universality. running variable. This is a model of population
He showed that period doubling is the normal way growth first published by Pierre François Verhulst.
that order breaks down into chaos. He calculated The discrete version of the logistic equation is
universal numbers which represent ratios in the known as the “logistic map”. The logistic map is a
scale of transition points that occur during the polynomial mapping, often cited as an archetypal
process of period doubling. These ratios are now example of how complex, chaotic behavior can
called “Feigenbaum numbers” [1-2]. arise from very simple nonlinear dynamical
equations (it is simply a function, f, on the phase
However, the term “chaos” was introduced by space that gives the next state, f (z) (the image), of
Tien-Yien and James A. Yorke in a 1975 paper the system given its current state, z. In the notation
entitled “Period Three Implies Chaos”. Without z' = f (z), the prime means the next point, not the
doubt this paper did much to spread the concept. derivative.) It was popularized in a seminal paper
The main catalyst for the development of chaos by the biologist Robert May [1-2].

3
The logistic map is a non-invertible map i.e., the periodic fixed point becomes unstable and two new
map can be iterated forward in time with each xn stable fixed points emerge. This equation
leading to a unique subsequent value xn+1, the demonstrates how deterministic systems (the stable
reverse is not true. It is also called “iterated map outcomes) can, when pushed, produce
function” as it maps one value of x, say x0 , into unpredictable and chaotic outcomes. At higher
another value of x that we call x1. By repeatedly values of r (3.5-4) the system demonstrates
iterating the logistic map, various kinds of sensitive dependence on initial conditions that is,
behaviors can be observed. The sequence of minor changes in the value of r results in markedly
iterated solutions to the map is called a “trajectory” different outcomes [1].
as well as “orbit” [1].
An interesting feature of this diagram is that as the
B. Bifurcation Diagram of Logistic Map periods go to infinity, r remains finite. When r is
greater than approximately 3.57, the orbits become
A bifurcation is a qualitative change in the chaotic. Hence this bifurcation diagram
dynamics that occurs as a system parameter is demonstrates a nice example of the importance of
changed. A bifurcation diagram shows the possible chaos theory in even very simple nonlinear
long term values a variable of a system can obtain systems. Bifurcation diagram is the basic tool of
as function of a parameter of the system. An studying the change in system behavior in response
example is the bifurcation diagram of the logistic to the variation of system parameters [2].
map. In this case, the parameter r is shown on the
horizontal axis of the plot and the vertical axis V. ATTRACTORS
shows the density of the possible long term
population values of the logistic function [1-2]. The orbit of the logistic map is attracted through
repeated iterations towards the orbit whether it is
periodic or chaotic. The “attractor” is the set of
points approached by the orbit as the number of
iterations increases to infinity i.e., it is the
equilibrium solution to which the system
converges. If the system settles down to a periodic
orbit, then it is said to have a “periodic attractor”
e.g., periodic-1 attractor, periodic-2 attractor or
periodic-4 attractor and so on. If on the other hand
the system behaves chaotically with an aperiodic
orbit, then it is said to have a “chaotic attractor”
more commonly referred to as a “strange attractor”.
A strange attractor contains an infinite number of
points bounded within a definite region of the state
space (an attractor with fractal dimension); the
Fig. 2 Bifurcation Diagram
resulting behavior is called “chaos”. Thus chaos is
a bounded aperiodic behavior of a system. In short,
Fig. 2 above shows that for r less than one, all the
the attractors are the pinnacle and origin of chaos
points are plotted at zero. Zero is the one point
[1-2].
attractor for r less than 1. For r between 1 and 3, we
still have one point attractors, but the 'attracted'
As Lorenz was the first person to chance upon a
value of x increases as r increases, at least to r = 3.
strange attractor, he noticed that for certain ranges
Bifurcations occur at r = 3, r = 3.45, 3.54, 3.564,
of a parameter, the trajectories starting from very
3.569 (approx.), etc., until just beyond 3.57, where
close initial conditions diverge fast and lead to
the multiple unstable periodic oscillations, which
entirely different future states. This is called
means chaotic behavior. A small change in r can
“sensitive dependence on initial conditions” that is
make a stable system chaotic, and vice versa. This
a hallmark of chaos and the key property of chaotic
sequence is called the "period doubling route to
systems [3].
chaos" [1].
This sensitivity has a very important implication.
The period doubling sequence occurred through the
Much of the study of dynamical systems is
bifurcation (splitting into two) of the previous fixed
propelled by the necessity of predicting future
points when they become unstable. It nicely shows
states of the system. But sensitive dependence on
the forking of the possible periods of stable orbits
initial conditions in chaotic systems renders
from 1 to 2 to 4 to 8 etc. This splitting is known as
prediction impossible beyond a short period of
“Pitchfork Bifurcation’. At each period doubling
time. The reason is that initial conditions cannot be
bifurcation point the previously stable attracting
measured or specified with infinite accuracy.

4
Minuscule errors in defining initial conditions do
not matter in stable periodic systems, for orbits
starting from slightly different initial conditions do
not diverge exponentially. But in a chaotic
attractor, arbitrarily close states diverge
exponentially and prediction becomes impossible
unless the initial conditions are known with infinite
information and specified with infinite accuracy
that is impossible. In brief, two nearby starting
points can evolve into two entirely uncorrelated
trajectories. Hence the final state is unpredictable
even though the system is deterministic [5].

VI. CONCLUSIONS

Chaos theory has become a very broad theory that


is used to study everything from the stock market,
to rioting crowds to brain waves during epilepsy. It
rose like a wave and crashed upon the sciences
from physics to meteorology. The availability of
cheaper, more powerful computers has broadened
the applicability of chaos theory. Currently, chaos
theory continues to be a very active area of
research, involving many different disciplines. This
universality has made chaos a truly
interdisciplinary field of study.

REFERENCES
[1] Paul S Addison. Fractals and Chaos. An
illustrated course. IOP Publishing Limited.
1997.
[2] Robert C. Hilborn. Chaos and Nonlinear
Dynamics. An Introduction for Scientists and
Engineers. Oxford University Press. 1994.
[3] D. C. Hamill, S. Banerjee and G. C.
Verghese, “Chapter 1: Introduction,”
Nonlinear Phenomena in Power Electronics,
edited by S. Banerjee and G. C. Verghese,
New York. IEEE Press, 2001. pp. 1-20.
[4] Thomas S. Parker and Leon O. Chua,
“Chaos: A Tutorial for Engineers”, IEEE
Proceedings 75 (8), 1987. pp 982-1008.
[5] S. Banerjee, “Chapter 3: Basics of
Bifurcation and Chaos Theory,” Nonlinear
Phenomena in Power Electronics, edited by
S. Banerjee and G. C. Verghese, New York,
IEEE Press, 2001. . pp. 53-110.
[6] Edward N. Lorenz. The Essence of Chaos.
Washington University Press. 1993.

View publication stats

You might also like