Professional Documents
Culture Documents
Full Download PDF of (Ebook PDF) Handbook of Probability All Chapter
Full Download PDF of (Ebook PDF) Handbook of Probability All Chapter
Full Download PDF of (Ebook PDF) Handbook of Probability All Chapter
http://ebooksecure.com/product/ebook-pdf-translational-medicine-
in-cns-drug-development-volume-29/
https://ebooksecure.com/download/progress-in-heterocyclic-
chemistry-ebook-pdf/
http://ebooksecure.com/product/ebook-pdf-probability-and-
statistics-the-science-of-uncertainty-second-edition/
https://ebooksecure.com/download/schaums-outline-of-
probability-3e-ebook-pdf/
(eBook PDF) Fundamentals of Probability: with
Stochastic Processes, Third Edition 3rd Edition
http://ebooksecure.com/product/ebook-pdf-fundamentals-of-
probability-with-stochastic-processes-third-edition-3rd-edition/
https://ebooksecure.com/download/netter-atlas-of-human-anatomy-
classic-regional-approach-8e-mar-29-2022_0323793738_elsevier-not-
true-pdf-ebook-pdf/
http://ebooksecure.com/product/ebook-pdf-introduction-to-
probability-second-edition/
http://ebooksecure.com/product/ebook-pdf-probability-and-
statistics-for-economists/
http://ebooksecure.com/product/ebook-pdf-the-oxford-handbook-of-
political/
Contents in Brief
1 Probability Space 1
2 Probability Measure 15
3 Random Variables: Generalities 63
4 Random Variables: The Discrete Case 79
5 Random Variables: The Continuous
Case 119
6 Generating Random Variables 177
7 Random Vectors in Rn 210
8 Characteristic Function 255
9 Moment-Generating Function 280
10 Gaussian Random Vectors 300
11 Convergence Types. Almost Sure
Convergence. Lp -Convergence.
Convergence in Probability 338
12 Limit Theorems 372
13 Appendix A: Integration Theory.
General Expectations 421
14 Appendix B: Inequalities Involving
Random Variables and Their
Expectations 434
vii
Contents
List of Figures xv
Preface xvii
Introduction xix
1 Probability Space 1
1.1 Introduction/Purpose of the Chapter, 1
1.2 Vignette/Historical Notes, 2
1.3 Notations and Definitions, 2
1.4 Theory and Applications, 4
1.4.1 Algebras, 4
1.4.2 Sigma Algebras, 5
1.4.3 Measurable Spaces, 7
1.4.4 Examples, 7
1.4.5 The Borel -Algebra, 9
1.5 Summary, 12
Exercises, 12
2 Probability Measure 15
2.1 Introduction/Purpose of the Chapter, 15
2.2 Vignette/Historical Notes, 16
2.3 Theory and Applications, 17
2.3.1 Definition and Basic Properties, 17
2.3.2 Uniqueness of Probability Measures, 22
2.3.3 Monotone Class, 24
2.3.4 Examples, 26
2.3.5 Monotone Convergence Properties of Probability, 28
2.3.6 Conditional Probability, 31
2.3.7 Independence of Events and -Fields, 39
2.3.8 Borel–Cantelli Lemmas, 46
ix
x Contents
Bibliography 445
Index 447
List of Figures
xv
xvi List of Figures
6.5 The resulting histogram of the generated values from the gamma
mixture density. We had to use 100,000 generated values to see the
middle hump. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 192
6.6 Candidate densities for the importance sampling procedure as well
as the target density. . . . . . . . . . . . . . . . . . . . . . . . . . 200
6.7 The evolution of different importance sampling estimators of E[|X |].
The black line is the estimator while the gray lines give the estimated
95% confidence interval for the estimator. . . . . . . . . . . . . . . 201
8.1 A plot of the function g used in Theorem 8.13. . . . . . . . . . . . 262
11.1 Relations between different types of convergence. Solid arrows mean
immediate implication. Dashed arrows mean that there exists a sub-
sequence which is convergent in the stronger type. . . . . . . . . . 347
Preface
Our motivation when we started to write the Handbook was to provide a reference
book easily accessible without needing too much background knowledge, but at
the same time containing the fundamental notions of the probability theory.
We believe the primary audience of the book is split into two main categories
of readers.
The first category consists of students who already completed their graduate
work and are ready to start their thesis research in an area that needs applications
of probability concepts. They will find this book very useful for a quick reminder
of correct derivations using probability. We believe these student should reference
the present handbook frequently as opposed to taking a probability course offered
by an application department. Typically, such preparation courses in application
areas do not have the time or the knowledge to go into the depth provided by the
present handbook.
The second intended audience consists of professionals working in the industry,
particularly in one of the many fields of application of stochastic processes. Both
authors’ research is concentrated in the area of applications to Finance, and thus
some of the chapters contain specific examples from this field. In this rapidly
growing area the most recent trend is to obtain some kind of certification that will
attest the knowledge of essential topics in the field. Chartered Financial Analyst
(CFA) and Financial Risk Manager (FRM) are better known such certifications,
but there are many others (e.g., CFP, CPA, CAIA, CLU, ChFC, CASL, CPCU).
Each such certificate requires completion of several exams, all requiring basic
knowledge of probability and stochastic processes. All individuals attempting these
exams should consult the present book. Furthermore, since the topics tested during
these exams are in fact the primary subject of their future work, the candidates
will find the Handbook very useful long after the exam is passed.
xvii
xviii Preface
This manuscript was developed from lecture notes for several undergraduate
and graduate courses given by the first author at Purdue University and Stevens
Institute of Technology and by the second author at the Université de Paris 1
Panthéon-Sorbonne and at the Université de Lille 1. The authors would like to
thank their colleagues at all these universities with whom they shared the teaching
load during the past years.
The probability theory began in the seventeenth century in France when two great
French mathematicians, Blaise Pascal and Pierre de Fermat, started a correspon-
dence over the games of chance. Today, the probability theory is a well-established
and recognized branch of mathematics with applications in most areas of Science
and Engineering.
The Handbook is designed from an introductory course in probability. How-
ever, as mentioned in the Preface, we tried to make each chapter as independent
as possible from the other chapters. Someone in need of a quick reminder can
easily read the part of the book he/she is concerned about without going through
an entire set of background material.
The present Handbook contains fourteen chapters, the final two being appen-
dices with more advanced material. The sequence of the chapters in the book
is as follows. Chapters 1 and 2 introduce the probability space, sigma algebras,
and the probability measure. Chapters 3, 4, and 5 contain a detailed study of
random variables. After a general discussion of random variables in Chapter 3,
we have chosen to separate the discrete and continuous random variables, which
are analyzed separately in Chapters 4 and 5 respectively. In Chapter 6 we discuss
methods used to generate random variables. In today’s world, where computers
are part of any scientific activity, it is very important to know how to simu-
late a random experiment to find out the expectations one may have about the
results of the random phenomenon. Random vectors are treated in Chapter 7.
We introduce the characteristic function and the moment-generating function
for random variables and vectors in Chapters 8 and 9. Chapter 10 describes the
Gaussian random vectors that are extensively used in practice. Chapters 11 and
12 describe various types of convergence for sequences of random variables and
their relationship (Chapter 11) and some of the most famous limit theorems (the
law of large numbers and the central limit theorems), their versions, and their
applications (Chapter 12). Appendices A and B (Chapters 13 and 14) focus on
the more general integration theory and moments of random variables with any
distribution. In this book, we choose to treat separately the discrete and continu-
ous random variables since in applications one will typically use one of these cases
and a quick consultation of the book will suffice. However, the contents of the
Appendices show that the moments of continuous and discrete random variables
are in fact particular cases of a more general theory.
xix
xx Introduction
• Introduction
• Historical Notes
• Theory and Applications
• Exercises
The Introduction describes the intended purpose of the chapter. The Historical
Notes section provides numerous historical comments, especially dealing with
the development of the theory exposed in the corresponding chapter. We chose
to include an introductory section in each chapter because we believe that in
an introductory text in probability, the main ideas should be closely related to
the fundamental ideas developed by the founding fathers of Probability. The
section Theory and Applications is the core of each chapter. In this section we
introduce the main notion and we state and prove the main results. We tried
to include within this section as many basic examples as was possible. Many of
these examples contain immediate applications of the theory developed within the
chapter. Sometimes, examples are grouped in a special section. Each chapter of the
Handbook ends with the Exercises section containing problems. We divided this
section into two parts. The first part contains solved problems, and the second part
has unsolved problems. We believe that the solved problems will be very useful
for the reader of the respective chapter. The unsolved problems will challenge and
test the knowledge gained through the reading of the chapter.
Chapter One
Probability Space
1
2 CHAPTER 1 Probability Space
Do you know the world’s white roof-tree—do you know that windy rift
Where the baffling mountain-eddies chop and change?
Do you know the long day’s patience, belly-down on frozen drift,
While the head of heads is feeding out of range?
It is there that I am going, where the boulders and the snow lie,
With a trusty, nimble tracker that I know,
I have sworn an oath, to keep it on the Horns of Ovis poli,
And the Red Gods call me out and I must go!
Kipling, The Feet of the Young Men.
Life in the East, more especially away from important centres, lacks
most of the amenities which are taken as a matter of course in the
civilized West. Family life is broken up, society is restricted,
communications are bad, involving few and irregular posts, and health
frequently suffers from the climate and from indifferent food. So much
for the debit side. But fortunately there is a credit side, and for the
Englishman sport is a large item on this side and does much to brighten
the otherwise trying monotony of life in Asia. It also helps him to
maintain his energy and health, and with it that sane outlook which is
one of the main secrets of our success as a world-power.
When appointed to Kashgar I had hopes of fulfilling the ambition of a
life-time by stalking one of Marco Polo’s great sheep, the Ovis poli. As
a youth I had been fascinated by the record of the celebrated Venetian
traveller, and after joining the army had made considerable efforts to
travel in the Pamirs in 1891 and 1892. But the arrest of Younghusband,
mentioned in Chapter XV., closed the “Roof of the World” to the private
traveller, and it seemed as if I were not destined to tread these
mysterious upland valleys. But the fates were kind. On the way to
Kashgar I stopped at Petrograd, where a high Russian official, whose
colleague I had been at Meshed, said that he felt sure I should wish to
shoot an Ovis poli in the Pamirs. I replied emphatically in the
affirmative, and it was speedily arranged that I should receive an
invitation to travel in the regions which for so many years I had longed
to visit.
Before describing the Ovis poli, which confers the blue riband upon the
hunter of big game, both from the magnificence of the trophy and the
inaccessibility of its habitat, I will quote Marco Polo, who wrote: “There
are great numbers of all kinds of wild beasts [in the Pamirs]; among
others, wild sheep of great size, whose horns are good six palms in
length. From these horns the shepherds make great bowls to eat from,
and they use the horns also to enclose folds for their cattle at night.”
The credit of Marco suffered through the ignorance of mankind, and it
was not until the nineteenth century that his character for accuracy was
vindicated by Lieutenant Wood, who, when he reached England in
1838 after his famous journey to a chief source of the Oxus, exhibited
some skulls with horns 4 feet 8 inches long, and on the strength of
these specimens the species was appropriately named Ovis poli or
“The sheep of (Marco) Polo.”
It is the most splendid member of a splendid group, to which belong
also the Ovis ammon of Tibet, with more massive but shorter horns,
and the Ovis karelini of the Tian Shan, which is a smaller sub-species
of the poli, the “record” head, shot by E. W. Dixon, measuring only 58½
inches. In the Ovis poli, the enormous horns are longer and relatively
narrower than in any of the other wild sheep, forming a more open
spiral and much more than one complete circle, with the flat surface
markedly angulated.[18] The summer coat is lightly speckled and the
legs are white, but in the winter the ruff becomes pure white. The height
at the shoulders exceeds 12 hands, and the weight may be about 22
stone. The length of horns is enormous, one specimen, believed to be
the longest on record, measuring 6 feet 3 inches! Marco’s “six palms”
may perhaps be the equivalent of 5 feet; so that his estimate was in no
way exaggerated.
The great distinction of being the first European to shoot an Ovis poli
was won by Captain (the late Sir Henry) Trotter, who describes the
event as follows: “It was during a very tedious and long march of thirty-
seven miles, mostly through snow, that my attention was suddenly
called to the presence of some wild sheep about two hundred yards up
the hillside. My rifle was handy, and in a few seconds one of them
came rolling down. It was the first Ovis poli ever shot by a European
sportsman, but it was unfortunately a very poor specimen.”[19] Since
that date British big-game shots, including the most famous of their
generation, have visited these remote upland valleys in pursuit of this
king of sheep.
When I actually visited the Pamirs I found that some of the descriptions
I had read did not convey a clear impression on all points. Perhaps my
chief disappointment was the aridity of the country, for, travelling in
June and July, I had expected to find rich meadows decked with Alpine
flowers. On the contrary, nowhere did I see anything but the scantiest
pasturage, and it remains a subject of wonder that the huge Ovis poli
can find nourishment in such a barren land. A second point which
struck me was that the Pamirs were for the most part open and easy to
traverse, and the mountains, although actually rising very high above
sea-level, appeared almost insignificant when viewed from the high
altitude at which we were travelling. The one point on which there was
no mistake was the severity of the weather.
Starting from Kashgar in considerable heat on June 7, we crossed the
Katta Dawan twelve days later in equally considerable cold, and from
its crest, at an elevation of 15,250 feet, the Pamirs lay before us. To the
north the Trans-Alai range rose up in snow-covered peaks, while
almost at our feet a corner of the Great Karakul, the largest lake of the
Pamirs, was visible. Descending into the valley from the storm-swept
pass, I felt very happy that I had at last reached the haunt of the Ovis
poli, and my elation was increased by seeing three small herds of
females grazing on the mountain side as we passed down the valley to
our camp near the lake.
The following morning I started off to try for game, feeling as keen and
excited as I had done during my first shooting expedition more than
twenty-five years ago, when everything was “fair and new.” I had
fortunately secured the services of a good shikari, by name Nadir, who
has already been mentioned. He had travelled with other Englishmen
and quite grasped our methods of stalking, which utterly puzzle an
untutored Kirghiz. He was indeed a treasure; for, besides being a good
stalker, he understood how to manage the Kirghiz, who worked willingly
under him.
Followed by some ponies carrying bedding and food, we rode across
the level steppe to the foot-hills. By good luck we sighted a herd of six
or eight four-year old rams, which were grazing about a mile off to our
right, and before very long we saw their horns moving over a low ridge
about 400 yards away. I jumped off and, running up to the ridge, had an
easy shot and bagged my first Ovis poli. Though the head was a small
one, such a start was of good omen for the future.
We afterwards examined the ground for miles, but saw no tracks of big
rams; so we bivouacked in the hills and returned to camp the following
day, satisfied that the local shikari was speaking the truth when he
explained that the veterans visited the range only in winter. There was,
indeed, no chance of a big head anywhere near the Karakul, and as
sport was merely a pleasant incident of the journey, not its object, we
marched on to Pamirsky Post.
Id festival, 229
Iftikhar Ahmad, Khan Sahib, 105, 158, 168, 175, 196, 224
Ilak Khans, 258, 261
Ilohi, native name for Khotan, 212
Ili, 265, 270, 271, 272, 280, 294
Ili Tartar General, 243
India:
trade with, 246;
Yue-chi invade, 249, 252
Indian Empire and Yakub Beg, 286-290
Indians in Chinese Turkestan, 183, 185, 186, 194
Insects of Turkestan, 88-9, 107, 171
Intermarriage, results of, 313
Irkeshtam, 33, 293
Isa Haji, 303-7
Isan Bughs, 265
Ishan Khan Khoja, 273
Islam:
rise of, 256, 260-61, 262;
supplants Buddhism, 266, 269, 293, 310
Issak Boulak, 161