Professional Documents
Culture Documents
(Download PDF) Inequalities in Analysis and Probability 3Rd Edition Odile Pons Ebook Online Full Chapter
(Download PDF) Inequalities in Analysis and Probability 3Rd Edition Odile Pons Ebook Online Full Chapter
https://ebookmeta.com/product/analysis-and-differential-
equations-2nd-edition-odile-pons/
https://ebookmeta.com/product/functional-estimation-for-density-
regression-models-and-processes-2nd-edition-odile-pons/
https://ebookmeta.com/product/geometric-analysis-of-quasilinear-
inequalities-on-complete-manifolds-frontiers-in-mathematics-
bruno-bianchini/
https://ebookmeta.com/product/introduction-to-linear-regression-
analysis-wiley-series-in-probability-and-statistics-6th-edition-
montgomery/
Probability and Statistical Inference 3rd Edition
Magdalena Niewiadomska-Bugaj
https://ebookmeta.com/product/probability-and-statistical-
inference-3rd-edition-magdalena-niewiadomska-bugaj/
https://ebookmeta.com/product/probability-and-statistical-
inference-3rd-edition-magdalena-niewiadomska-bugaj-2/
https://ebookmeta.com/product/probability-schaums-outline-
series-3rd-ed-3rd-edition-seymour-lipschutz/
https://ebookmeta.com/product/women-in-science-and-technology-
confronting-inequalities-first-edition-gupta/
https://ebookmeta.com/product/statistics-for-data-scientists-an-
introduction-to-probability-statistics-and-data-analysis-maurits-
kaptein/
INEQUALITIES IN
ANALYSIS AND
PROBABILITY
Third Edition
B1948 Governing Asia
Odile Pons
National Institute for Agronomical Research, France
World Scientific
NEW JERSEY • LONDON • SINGAPORE • BEIJING • SHANGHAI • HONG KONG • TAIPEI • CHENNAI • TOKYO
Published by
World Scientific Publishing Co. Pte. Ltd.
5 Toh Tuck Link, Singapore 596224
USA office: 27 Warren Street, Suite 401-402, Hackensack, NJ 07601
UK office: 57 Shelton Street, Covent Garden, London WC2H 9HE
For photocopying of material in this volume, please pay a copying fee through the Copyright Clearance
Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, USA. In this case permission to photocopy
is not required from the publisher.
Printed in Singapore
Preface
The third edition proves new inequalities for martingales and their supre-
mum; thus improving the classical inequalities. These are presented in two
different chapters, for discrete and time-continuous martingales. They are
applied to the weak convergence of (local) martingales and semi-martingales
and to Gaussian and point processes. The chapter on stochastic integration
is completed and new results are established for local times.
February 2021
February 2016
v
April 30, 2021 13:24 ws-book9x6 Inequalities in Analysis and Probability (Third Edition) 12135-main page vi
Contents
Preface v
1. Preliminaries 1
1.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.2 Cauchy and Hölder inequalities . . . . . . . . . . . . . . . 2
1.3 Inequalities for transformed series and functions . . . . . . 6
1.4 Applications in probability . . . . . . . . . . . . . . . . . . 9
1.5 Hardy’s inequality . . . . . . . . . . . . . . . . . . . . . . 13
1.6 Inequalities for discrete martingales . . . . . . . . . . . . . 16
1.7 Martingales indexed by continuous parameters . . . . . . 21
1.8 Large deviations and exponential inequalities . . . . . . . 27
1.9 Functional inequalities . . . . . . . . . . . . . . . . . . . . 31
1.10 Content of the book . . . . . . . . . . . . . . . . . . . . . 33
3. Analytic Inequalities 67
3.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . 67
vii
April 30, 2021 13:24 ws-book9x6 Inequalities in Analysis and Probability (Third Edition) 12135-main page viii
Contents ix
Bibliography 351
Index 357
April 30, 2021 13:24 ws-book9x6 Inequalities in Analysis and Probability (Third Edition) 12135-main page 1
Chapter 1
Preliminaries
1.1 Introduction
The origin of the inequalities for convex functions is the inequalities in real
vector spaces which have been extended to functional spaces by limits in
Lebesgue integrals. They are generalized to inequalities for the tail distri-
bution of sums of independent or dependent variables, under conditions for
the convergence of their variance, and to inequalities for the distribution
of martingales indexed by discrete or continuous sets. These inequalities
are the decisive arguments for bounding series, integrals or moments of
transformed variables and for proving other inequalities.
The convergence rate of sums of variables with mean zero is determined
by probability inequalities which prove that a sum of variables normalized
by the exact convergence rate satisfies a compactness property. If the nor-
malization has a smaller order than its convergence rate, the upper bound
of the inequality is one and it tends to zero if the order of the normalization
is larger.
Many probability results are related to the Laplace transform, such
as Chernoff’s large deviations theorem, Bennett’s inequalities and other
exponential inequalities for sums of independent variables. This subject
has been widely explored since the review papers of the Sixth Berkeley
Symposium in Mathematical Statistics and Probability (1972) which covers
many inequalities for martingales, Gaussian and Markov processes and the
related passage problems and sojourn times. Some of them are revisited
and extended after a brief review in this chapter. The upper bounds for the
tail probability of the maximum of n variables depend on n, in the same
way, the tail probability of the supremum of functional sums have upper
bounds depending on the dimension of the functional classes.
1
April 30, 2021 13:24 ws-book9x6 Inequalities in Analysis and Probability (Third Edition) 12135-main page 2
and the space `∞ (Vn ) is the space of vector with a finite uniform norm
kxk∞ = max1≤i≤n |xi |. In `p (V∞ ) and `∞ (V∞ ), the norms are defined
as the limits of the norms of `p (Vn ) as n tends to infinity. The norms
(kxkp )0<p≤∞ are an increasing sequence for every x in a vector space V .
The triangular inequality is kx + yk ≤ kxk + kyk with equality if and
only if < x, y > = 0. Consequently, for all x and y in a vector space
|kxk − kyk| ≤ kx − yk.
April 30, 2021 13:24 ws-book9x6 Inequalities in Analysis and Probability (Third Edition) 12135-main page 3
Preliminaries 3
− p10 − q1 1
+ q10
n kxkq ≤ kxkp ≤ n p kxkq ,
0 0
with p−1 + p −1 = 1 and q −1 + q −1 = 1.
Extensions of Cauchy’s inequality to bilinear series have been studied by
Hilbert, who proved that for positive real series (xn )n≥1 in `p and (ym )m≥1
in `q
X X xn ym π X X
≤ −1
k xi kp k y j k p0
n+m sin(p π)
n≥1 m≥1 i≤n j≤m
0
where p and p0 are conjugates such that p−1 + p −1 = 1. Other examples
are given by Hardy, Littlewood and Pólya (1952).
Cauchy’s inequality is extended to an inequality for integrals with re-
spect to the Lebesgue measure on R. Let f and g be square-integrable
functions in L2 (R), the Cauchy-Schwarz inequality is
Z Z 12 Z 12
f (x)g(x) dx ≤ f 2 (x) dx g 2 (x) dx ,
R R R
with equality under the same R condition. A simple proof for both inequali-
ties relies on the inequality R (tf (x)−g(x))2 w(x) dµ(x) ≥ 0 which develops
April 30, 2021 13:24 ws-book9x6 Inequalities in Analysis and Probability (Third Edition) 12135-main page 4
as an equation
R of the2 second-order with
R respect to t, with a negative dis-
2 2
R
criminant ( wf g dµ) − ( wf dµ)( wg dµ).
It is extended to the Hölder inequalities for Lp -integrable real functions
with a finite or infinite support [a,Rb], where −∞ ≤ a < b ≤ ∞. For every
b 1
real p > 1, let Lp,µ (a, b) = {f : ( a |f |p dµ) p < ∞}, if 1 ≤ p < ∞, and
L∞ (a, b) = {f : sup(a,b) |f | < ∞}. Let p and q be conjugates and let f
in Lp,µ (a, b) and g in Lq,µ (a, b), Hölder inequality is a consequence of the
inequality uv ≤ p−1 up + q −1 v p for (u, v) in R2+ such that kukLp = 1 and
kvkLq = 1
Z Z p1 Z q1
|f g| dµ ≤ |f |p dµ |g|q dµ . (1.4)
R R R
Let r ≥ 1 and let p and q be conjugates such that p−1 + q −1 = r−1 Hölder
inequality generalizes as
Z r1 Z p1 Z q1
|f g|r dµ ≤ |f |p dµ |g|q dµ . (1.5)
R R R
p
The L norms are increasing. This implies Khintchine’s inequality for p ≥ 1:
Let (rk )k≥0 be the Rademacher functions on [0, 1], for every measurable
2
P P
function f = k≥0 ak rk on [0, 1] satisfying k≥0 ak < ∞, there exist
constants Ap > 0 and Bp such that
X 12 X 1
Ap a2k ≤ kf kp ≤ Bp (a2k ) 2 . (1.6)
k≥0 k≥0
Since the constants do not depend on the dimension of the projection of the
function onto the basis, (1.6) implies the equivalence between the norms of
the function, Ap kf k2 ≤ kf kp ≤ Bp kf k2 .
Inequalities for a countable sequence x = (xi )i≥0 in the space `p (R∞ )
are deduced from functional inequalities for Rpiecewise constant integrable
ai
functions of a space Lp,µ or by setting xi = ai−1 f dµ for some function f
p,µ
of L and ∪i≥0 (ai−1 , ai ) = (a, b). Let r < p and let q be the conjugate of
p such that r−1 = p−1 + q −1 , then kxykr ≤ kxkp kykq .
The Cauchy and Hölder inequalities are recursively generalized to more
than two series or functions. Let k ≥ 2 and let p1 , . . . , pk ≥ 1 such that
Pk −1 −1
i=1 pk = r and let f1 , . . . , fk be functions in Lp1 ,µ (a, b), . . . , Lpk ,µ (a, b)
respectively, the Hölder inequality for the functions f1 , . . . , fk is
Z b Y k r1 k
Y
| fi |r dµ ≤ kfi kpi ,µ (1.7)
a i=1 i=1
Preliminaries 5
Preliminaries 7
Most inequalities for bounding finite series are intervals for the error of
their approximation by a Taylor expansion or they are obtained by induc-
tion. For example, Cauchy (1833) defined the exponential function as
ex = lim (1 + α)n = lim (1 − α)−n
n→∞,nα→x n→∞,nα→x
Preliminaries 9
for every real α > 0. This definition entails immediately the main properties
of the exponential. Reciprocally, the unique function φ which satisfies
φ(x + y) = φ(x)φ(y),
for all x and y, is the exponential function φ(x) = {φ(1)}x ≡ ex .
Other classical bounds for functions have been established for the first
n terms of their Taylor expansions. Alzer (1990b) studied a lower bound
of the form In−1 (x)In+1 (x) > cn In2 (x) for the sum In (x) of the first n
terms in the Taylor expansion of the exponential function. More generally,
Darboux’s sums for a function f on an interval [a, b] are defined using a
partition πn = (ak )k=0,...,an of increasing numbers of this interval such that
a = a0 and an = b
Xn
S(f, πn ) = mk (ak − ak−1 ),
k=1
Xn
T (f, πn ) = Mk (ak − ak−1 ),
k=1
with mi = inf ak−1 ≤x<ak f (x) and Mi = supak−1 ≤x<ak f (x) and the con-
vergence
R b of the sum T (f, πn ) implies the convergence of the integral
I = a f (x) dx, conversely the convergence of I implies the convergence
of the sum S(f, πn ). The sum 1 + 3 + · · · + (2k − 1) has then the
Pk−1
bounds k 2 − k − 1 ≤ i=0 (1 + 2i) ≤ k 2 + k − 1 and the product
Pk−1
m2k = 1.3 . . . (2k − 1) = exp{ i=0 log(1 + 2i)} satisfies
k−1
Y 2
(1 + 2i) ≤ (1 + 2k)1+2k e−2k ≤ e(2k) = 2ke2k , (1.12)
i=0
the inequality m2k ≤ k k obtained from (1.9) is therefore better than the
upper bound of (1.12) for m2k . Close approximations by Darboux’s sums
require a thin partition πn .
E(XY ) ≤ kXkp kY kq
The inequalities of Section 1.3 imply the following inequalities for the
sequence of variables. Let (Xi )i=1,...,n be a sequence of random variables
Pn
and let X̄n = n−1 i=1 Xi be their empirical mean, Cauchy’s inequality
implies that for every integer n
n n
X o
E n−1 log(1 + Xi ) < E{X̄n }.
i=1
Pn
Let (αi )i=1,...,n be a real sequence such that i=1 αi = 1. For every positive
concave function f on R+ , inequality (1.9) entails
n
nX o k
X
E αi log f (Xi ) ≤ E log f αi Xi
i=1 i=1
−1
Pn
in particular E{n i=1 log f (Xi )} ≤ E log f (X̄n ). By Jensen’s inequal-
ity, for every convex function ϕ and for every variable X
ϕ(EX) ≤ Eϕ(X).
April 30, 2021 13:24 ws-book9x6 Inequalities in Analysis and Probability (Third Edition) 12135-main page 11
Preliminaries 11
Pn
convergence rate of the mean X̄n = n−1 i=1 Xi to zero is β = 1. For
independent variables with respective means µi , the convergence rate of
n−α Sn to a limit µ is determined by the convergence rates of the mean
Pn
µn = n−α i=1 µi to µ and of the mean variance σn2 = n−β Vn to a limit
σ 2 > 0. For every a > 0
β
P (n 2 |n−α Sn − µ| > a) ≤ n2(β−α) a−2 n−β Vn ,
therefore the convergence rates α and β are equal.
Chow and Lai (1971) proved the following equivalences for a sequence
of independent and identically distributed random variables (Xi )i≥1 with
mean EX1 = 0, for α in ]0, 1[
E exp(t|X1 |α ) < ∞, t > 0,
−1
lim (log n)α Xn = 0, a.s.,
n→∞
n
−1 X
lim (log n)α cn−i Xi = 0, a.s.,
n→∞
i=1
Preliminaries 13
ηj−i determines the convergence rate of this sum through the inequality
E|Xi Xj | ≤ ηj−i σi σj . If there exist constants α > 0 and β > 0 such that
Pn
µn = n−α i=1 µi converges to µ and n−β i=1,...,n j=1,...,n ηj−i σi σj
P P
Inverting the mean and the integrals, its norms satisfy the properties
kfbX kp ≤ kRX kp ,
0
kfbX k1 ≤ kfbX kpp kfbX kpp0 , where p−1 + p0−1 = 1.
Preliminaries 15
Kufner and Persson (2003) and others later proved weighted inequalities of
the Hardy type. Pachpatte (2005) also provided a review of the classical
inequalities
Z xZ y of the same type √ and Zseveral generalizations Z y of the inequality
f (s)g(t) xy n x 0 0
o 21
ds dt ≤ pq (x − s)f 2 (s) ds (y − t)g 2 (t) dt .
0 0 s+t 2 0 0
Let f be a complex function defined on Rd , with the Lebesgue measure
λd and let Br (x) be the ball of Rd , centred at x and with radius r. The
maximum average value of f is Z
1
M f (x) = sup |f | dλd .
r>0 λd (Br (x)) Br (x)
Hardy-Littelwood’s weak inequality for M f is
λd {x ∈ Rd : M f (x) > a} ≤ a−1 Cd kf kL1 (Rd ) , for every a > 0,
where Cd is a constant. A stronger inequality for M f is due to
Marcinkiewicz for every p > 1
kM f kLp (Rd ) ≤ Cd,p kf kLp (Rd )
where Cd,p is a constant.
Another type of analytical inequalities for integrals is the Mean Value
Theorem (Lagrange) and its extensions to higher order approximations.
Hardy, Littlewood and Pólya (1952) proved a bound for the difference be-
tween the integral of the square of a continuously differentiable function f
on [0, 1] and the square of its integral
Z 1 nZ 1 1 1
o2 Z
0
0≤ f 2 (x) dx − f (x) dx ≤ x(1 − x)f 2 (x) dx.
0 0 2 0
Ostrowski’s type inequalities (Sahoo and Riedel, 1998, Mitrinović, Pecarić
and Fink 1957, Dragomir and Sofo 2000, Dragomir and Rassias 2002) have
been written for the approximation of a continuously differentiable function
f defined in an interval (a, b), having a derivative bounded by a constant
M , in the form
1
Z b h 1 {x − 1 (a + b)}2 i
2
f (x) − f (t) dt ≤ (b − a)M + .
b−a a 4 (b − a)2
Gruss’s inequalities are bounds for the difference between the integral of
a product of bounded functions and the product of their integrals. Let
ϕ ≤ f (x) ≤ Φ and γ ≤ g(x) ≤ Γ
Z b
1 n b o 1 nZ b
Z
1 o
f (x)g(x) dx − f (x) dx g(x) dx
b−a a b−a a b−a a
1
≤ (Φ − ϕ)(Γ − γ).
4
These inequalities have been developed for several classes of functions
and extended to inequalities of higher order approximations (Barnett and
Dragomir, 2001, 2002).
April 30, 2021 13:24 ws-book9x6 Inequalities in Analysis and Probability (Third Edition) 12135-main page 16
Preliminaries 17
then (Xen )n≥1 is the unique predictable process such that (Xn − X
en )n≥1 is
a (Fn )n -martingale.
convergent submartingale.
April 30, 2021 13:24 ws-book9x6 Inequalities in Analysis and Probability (Third Edition) 12135-main page 18