Professional Documents
Culture Documents
Gaussian Measures in Hilbert Space Construction and Properties Kukush Full Chapter PDF
Gaussian Measures in Hilbert Space Construction and Properties Kukush Full Chapter PDF
Gaussian Measures in Hilbert Space Construction and Properties Kukush Full Chapter PDF
https://ebookmass.com/product/operator-analysis-hilbert-space-
methods-in-complex-analysis-jim-agler/
https://ebookmass.com/product/space-as-language-the-properties-
of-typographic-space-will-hill/
https://ebookmass.com/product/nonconventional-and-vernacular-
construction-materials%ef%bc%9a-characterisation-properties-and-
applications-kent-a-harries-bhavna-sharma/
https://ebookmass.com/product/electron-correlation-in-molecules-
ab-initio-beyond-gaussian-quantum-chemistry-1st-edition-hoggan/
Humidity and Electronics : Corrosion Reliability Issues
and Preventive Measures Rajan Ambat
https://ebookmass.com/product/humidity-and-electronics-corrosion-
reliability-issues-and-preventive-measures-rajan-ambat/
https://ebookmass.com/product/biobased-polymers-properties-and-
applications-in-packaging-pratima-bajpai/
https://ebookmass.com/product/project-control-integrating-cost-
and-schedule-in-construction/
https://ebookmass.com/product/communication-research-measures-
iii-a-sourcebook-elizabeth-e-graham/
https://ebookmass.com/product/the-bioethics-of-space-exploration-
human-enhancement-and-gene-editing-in-future-space-missions-
konrad-szocik/
Gaussian Measures in Hilbert Space
To the memory of my daughter Ann
Series Editor
Nikolaos Limnios
Gaussian Measures
in Hilbert Space
Alexander Kukush
First published 2019 in Great Britain and the United States by ISTE Ltd and John Wiley & Sons, Inc.
Apart from any fair dealing for the purposes of research or private study, or criticism or review, as
permitted under the Copyright, Designs and Patents Act 1988, this publication may only be reproduced,
stored or transmitted, in any form or by any means, with the prior permission in writing of the publishers,
or in the case of reprographic reproduction in accordance with the terms and licenses issued by the
CLA. Enquiries concerning reproduction outside these terms should be sent to the publishers at the
undermentioned address:
www.iste.co.uk www.wiley.com
Foreword . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . ix
Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xiii
Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xv
References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 239
Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 241
Foreword
Prerequisites for the book are only a basic knowledge of probability theory, linear
algebra, measure theory and functional analysis. The exposition is supplemented with
a bulk of examples and exercises with solutions, which are very useful for unassisted
work and control of studied material.
careful here, as due to the absence of the infinite-dimensional Lebesgue measure, the
Radon–Nikodym density should be written w.r.t. one of the Gaussian measures.
The author of this book, Professor A.G. Kukush, has been working at the Faculty
of Mechanics & Mathematics of Taras Shevchenko National University for 40 years.
He is an excellent teacher and a famous expert in statistics and probability theory. In
particular, he used to give lectures to students of mathematics and statistics on
Measure Theory, Functional Analysis, Statistics and Econometrics. As a student, I
was lucky to attend his fascinating course on infinite-dimensional analysis.
Andrey P ILIPENKO
Leading Researcher at the Institute of Mathematics
of Ukrainian National Academy of Sciences,
Professor of Mathematics at the National Technical University
of Ukraine, “Igor Sikorsky Kyiv Polytechnic Institute”
August 2019
Preface
There are excellent textbooks and monographs on related topics, such as Gaussian
Measures in Banach Spaces [KUO 75], Gaussian Measures [BOG 98] and Probability
Distributions on Banach Spaces [VAK 87]. Why did I write my own textbook?
In 1979, Kuo’s fascinating textbook was translated into Russian. Inspired by this
book, I started to give my lectures on Gaussian measures for graduate students. The
subject seemed highly technical and extremely difficult. I decided to create
something like a comic book on this topic, in particular to divide lengthy proofs into
small understandable steps and explain the ideas behind computations.
Acknowledgments
My wife Mariya deserves the most thanks for her encouragement and patience.
Alexander K UKUSH
Kyiv, Ukraine
September 2019
Introduction
The aim of this book is to explain the construction of Gaussian measure in Hilbert
space, present its main properties and also outline possible applications in statistics.
Chapter 1 deals with Euclidean space, where the invariance of Lebesgue measure
is explained and Gaussian vectors and Gaussian measures are introduced. Their
properties are stated in such a form that (later on) they can be extended to the
infinite-dimensional case. Furthermore, it is shown that on an infinite-dimensional
Hilbert space there is no non-trivial measure, which is invariant under all translations
(the same concerning invariance under all unitary operators); hence on such a space
there is no measure analogous to the Lebesgue one.
Borel probability measures on H and a normed space X are studied with examples.
The boundedness of moment forms of such measures is shown, with simple proof
based on the classical Banach–Steinhaus theorem. Corollary 3.3 and remark 3.8 give
mild conditions for the existence of mean value of a probability measure μ as Pettis
integral, and if the underlying space is a separable Banach space B and μ has a strong
first moment, then its mean value exists as Bochner integral.
A criterion for the weak convergence of Gaussian measures is stated, where (due to
theorem 3.9) we recognize the convergence of correlation operators in nuclear norm.
The famous theorem of Fernique is proven, which states that certain exponential
moments of a Gaussian measure on X are finite. In particular, every Gaussian measure
on a separable Banach space B has mean value as Bochner integral and its correlation
operator is well-defined. Theorem 5.10 derives the convergence of moments of weakly
convergent Gaussian measures.
components are either absolutely continuous or mutually singular. This implies the
dichotomy for Gaussian measures on R∞ : two such measures are either equivalent or
mutually singular. Section 6.3 proves the famous Feldman–Hájek dichotomy for
Gaussian measures on H, and in case of equivalent measures, expressions for
Radon–Nikodym derivatives are provided.
In section 6.4, the results of Chapter 6 are applied in statistics. Based on a single
observation of Gaussian random element in H, we construct unbiased estimators for
its mean and for parameters of its correlation operator; also we check a hypothesis
about the mean and the correlation operator (the latter hypothesis is in the case where
the Gaussian element is centered). In view of example 5.3 with p = 2, these statistical
procedures can be used for a single observation of a Gaussian process on finite time
interval.
The book is aimed for advanced undergraduate students and graduate students in
mathematics and statistics, and also for theoretically interested students from other
disciplines, say physics.
Prerequisites for the book are calculus, algebra, measure theory, basic probability
theory and functional analysis (we do not use generalized functions). In section 6.4,
the knowledge of basic mathematical statistics is required.
Some words about the structure of the book: we present the results in lemmas,
theorems, corollaries and remarks. All statements are proven. Important and
illustrative examples are given. Furthermore, each section ends with a list of
problems. Detailed solutions to the problems are provided in Chapter 7.
The abbreviations and notation used in the book are defined in the corresponding
chapters; an overview of them is given in the following list.
Abbreviations and Notation
λm Lebesgue measure on Rm
Sm sigma-algebra of Lebesgue measurable sets on Rm
IA indicator function, i.e. IA (x) = 1 if x ∈ A, else IA (x) = 0
μT −1 measure induced by measurable transformation T based on
measure μ, i.e. (μT −1 )(A) = μ(T −1 A), for each measurable
set A
L(X, μ) space of Lebesgue integrable functions on X w.r.t. measure μ
f = g (mod μ) functions f and g are equal almost everywhere w.r.t. measure μ
δx Dirac measure at point x, δx (B) = IB (x)
νμ signed measure ν is absolutely continuous w.r.t. measure μ
dν
dμ the Radon–Nikodym derivative of ν w.r.t. μ
ν∼μ measures ν and μ are equivalent
ν⊥μ signed measure ν and measure μ are mutually singular
(x, y) inner product of vectors x and y in Euclidean or Hilbert space
x Euclidean norm of vector x
A Euclidean norm of matrix A, A = sup Ax x
x=0
Im the identity matrix of size m
rk(S) rank of matrix S
Pn
√ projective operator, Pn x = (x1 , . . . , xn ) , x ∈ R∞
A square root of positive semidefinite
√ matrix A, it is positive
semidefinite as well with ( A)2 = A
x, x∗ or x∗ , x value of functional x∗ at vector x
I the identity operator
L(X) space of linear bounded operators on normed space X
R(A) range of operator A, R(A) = {y : ∃x, y = Ax}
L⊥ orthogonal complement to set L
L2 [a, b] Hilbert space of square integrable real functions with inner
b
product (x, y) = a x(t)y(t)dt, the latter is Lebesgue integral
lp space of real sequences x = (xn )∞ 1 with norm x p =
∞ 1/p
( n=1 |xn |p ) if 1 ≤ p < ∞, and x ∞ = supn≥1 |xn |
if p = ∞. Forp = 2, l2 is Hilbert space with inner
∞
product (x, y) = 1 xn yn .
l2,a weighted l2 space
span(M ) span of set M, i.e., set of all finite linear combinations of vectors
from M
Ân cylinder in R∞ with base An ∈ B(Rn )
A = A L(X) operator norm of linear bounded operator A, A = sup Ax x
x=0
∗
√ A 1/2 adjoint operator
B=B square root of self-adjoint positive operator B
|A| modulus of compact operator A, |A| = (A∗ A)1/2
Abbreviations and Notation xxi
∀A ∈ F, T −1 A ∈ S. [1.1]
Hereafter
T −1 A := {x ∈ X : T x ∈ A} [1.2]
T HEOREM 1.1.– (About induced measure) The set of function ν given in [1.3] is a
measure on F .
P ROOF.– The function ν is well defined due to [1.1]. We have to show that it is not
identical to infinity, but it is non-negative and sigma-additive.
∞
∞
∞
−1 −1
ν An =μ T An =μ T An =
n=1 n=1 n=1
∞
∞
= μ T −1 An = ν(An ).
n=1 n=1
D EFINITION 1.1.– The set function ν given in [1.3] is called a measure induced by
transformation T and is denoted as μT −1 .
For any measurable space (Y, F, ν), denote L(F, ν) the space of Lebesgue
integrable functions on Y w.r.t. measure ν.
P ROOF.– Equality [1.4] is shown in a standard way: first for indicators, then for simple
non-negative functions, then for f ≥ 0, and finally, for f ∈ L(Y, μT −1 ).
a) Let A ∈ F ,
1, if y ∈ A
f (y) = IA (y) =
0, otherwise.
Then
1, if T x ∈ A
IA (T x) =
0, otherwise,
1, if x ∈ T −1 A
IA (T x) =
0, otherwise,
Gaussian Measures in Euclidean Space 3
IA (T x) = IT −1 A (x).
Hence
m
f (y) = ak IAk (y), y ∈ Y, [1.5]
k=1
Here, tend n to infinity. By the monotone convergence theorem, [1.6] implies [1.4].
d) Finally, let f ∈ L(Y, μT −1 ),
Problems 1.1
P ROOF.–
a) Let μ be T -invariant and B ∈ S. Because T −1 is measurable, A := T B ∈ S.
It holds B = T −1 A, and μ(T −1 A) = μ(A). Equality [1.9] follows.
b) Conversely, assume [1.9] and take any A ∈ S. Denote B0 = T −1 A, B0 ∈ S.
Then (μT −1 )(A) = μ(B0 ) = μ(T B0 ) = μ(A), and μ is T -invariant.
E XAMPLE 1.1.– (Counting measure) Let X = {1, 2, ..., n}, S = 2X be the sigma-
algebra of all subsets of X, and μ be the counting measure on X, i.e. μ(A) = |A|,
A ∈ S. (Hereafter |A| is number of points in a set A; if A is infinite, |A| = +∞.) Then
Gaussian Measures in Euclidean Space 5
n
Hereafter, Ak stands for Cartesian product of A1 , . . . , An . Evaluate
k=1
The latter integral is Riemann integral over the compact and Jordan measurable set
T −1 [a, b]. The change of variables in the Riemann integral leads to the following:
−1
∂y
λn T −1 [a, b] = dy = mn ([a, b]) = λn ([a, b]) .
| det L| | det L|
[a,b] ∂x
T −1 A = T −1 B ∪ T −1 N , T −1 B ∈ B(Rn ), [1.13]
λn (N0 )
T −1 N ⊂ T −1 N0 , T −1 N0 ∈ B(Rn ), λn T −1 N0 = = 0. [1.14]
| det L|
Here, we used theorem 1.3 and the fact that T is a Borel function. Decompositions
[1.13] and [1.14] show that T −1 A ∈ Sn .
λn
λn T −1 = .
| det L|
λn (B) λn (A)
λn T −1 A = λn T −1 B = = .
| det L| | det L|
Gaussian Measures in Euclidean Space 7
Here, T is dilation along x1 -axis with coefficient 2 and contraction along x2 -axis
with the same coefficient.
Problems 1.2
1
lim |g(y) − g(x)|dλn (y) = 0.
r→0+ λn (B(x, r)) B(x,r)
Hereafter, B(x, r) is an open ball centered at x with radius r. Use the Lebesgue
differentiation theorem [BOG 07] which states that, given any locally Lebesgue
integrable function g on Rn , almost every x is a Lebesgue point of g.
12) Let g : Rn → R be a Lebesgue measurable function such that g(T x) = g(x)
(mod λn ), for all unitary operators T in Rn . Prove that there exists a Borel function
f : [0, +∞) → R, with g(x) = f (||x||) (modλn ).
13) Let α > 0 and f ∈ L(R, λ1 ). Prove that f (n1+α x) → 0 as n → ∞ for almost
all x ∈ R. Extend this statement to functions from L(Rm , λm ).
14) Let f : Rn → R̄, f ∈ L([0, +∞), λ1 ). Prove the following:
a) If f is an even function, then
f dλ1 = 2 f dλ1 .
R [0,+∞)
b) If f is an odd function, then R
f dλ1 = 0.
15) Let f : [−1, 1] → (0, +∞) be a Lebesgue measurable function. Find the
f (x)
integral [−1,1] f (x)+f (−x) dλ1 (x).
Gaussian Measures in Euclidean Space 9
Let H be a real Hilbert space, with Borel sigma-algebra B(H). In this section, we
search for a measure λ on B(H) with the following properties:
i) λ is positive at each non-empty open set;
ii) λ is finite at each bounded Borel set;
iii) λ is invariant under each translation T x = x + c, x ∈ H, with c ∈ H.
But this contradicts property (ii). Therefore, such a measure λ does not exist.
10 Gaussian Measures in Hilbert Space
Problems 1.3
16) Prove that there is no measure λ on B(l∞ ) with properties (i) and (ii) from
section 1.3, where l∞ is the space of real bounded sequences with the supremum
norm.
17) Let X be a real normed space, with dim(X) = ∞. Prove that there is no
measure λ on B(X) with properties (i)–(iii) from section 1.3.
18) A linear bijection V on a normed space X is called isometry if ||V x|| = ||x||,
x ∈ X. Prove that there is no measure λ on B(lp ) with properties (i) and (ii) from
section 1.3 and such that λ is invariant under all isometries on lp , 1 ≤ p < ∞.
19) Let ϕ(t), t ∈ [0, 1] be a continuous increasing function, with ϕ(0) = 0,
ϕ(1) = 1, and ϕ(t) < t, t ∈ (0, 1). In Banach space, X = C[0, 1] introduce a
transformation (T x)(t) = x(ϕ(t)), t ∈ [0, 1], x ∈ X. Prove that there is no measure
λ on B(X) with properties (i) and (ii) from section 1.3 and such that it is T -invariant.
D EFINITION 1.4.– Let X = X(ω) be a r.v. on a probability space (Ω, F, P). The
distribution of X is a probability measure μX defined as follows:
μX (B) = P{ω : X(ω) ∈ B}, B ∈ B(R).
Actually, this means that the distribution μX λ1 , where the Lebesgue measure
λ1 is considered on B(R), and moreover the Radon–Nikodym derivative
dμX
dλ1 = f (t)(modλ1 ).
D EFINITION 1.5.– A r.v. γ is called normal (or normally distributed) if it has a pdf of
the form
1 (x−m)2
ρ(x) = √ e− 2σ2 , x ∈ R,
2πσ
with parameters m ∈ R and σ > 0. This is denoted as follows: γ ∼ N (m, σ 2 ).
ϕξ (t) = E eitξ , t ∈ R.
σ 2 t2
ϕγ (t) = exp{imt − }. [1.17]
2
If γ has degenerate normal distribution N (m, 0), then
ϕγ (t) = exp{imt}.
Thus, relation [1.17] holds true for any Gaussian r.v. γ ∼ N (m, σ 2 ), with σ ≥ 0.
P ROOF.– The statement follows from lemma 1.2 and its proof if to put A = a ∈
R1×n . The random vector a X is just a r.v., and its variance–covariance matrix is just
the variance.
14 Gaussian Measures in Hilbert Space
L EMMA 1.3.– Given a probability measure μ on B(Rn ), there exists a random vector
X, with distribution μX = μ.
P ROOF.– Take the measure space (Rn , B(Rn ), μ) as a probability space (Ω, F, P) and
define X : Ω → Rn as X(ω) = ω. Then
The latter relation can be written in terms of the distribution μX of random vector
X = (Xk )n1 and marginal distributions μXk of its components:
n n
μX ( Bk ) = μXk (Bk ).
1 1
n
Here 1 Bk denotes Cartesian product of the sets Bk .
It is clear that components of random vector X = (Xk )n1 are independent if, and
only if, μX is a product of n probability measures, and in this case
n
μX = μXk .
1
ϕX (t) = E ei(X,t) , t ∈ Rn .
Gaussian Measures in Euclidean Space 15
One can rewrite ϕX (t) using the change of variables formula (see theorem 1.2):
ϕX (t) = e i(X(ω),t)
dP (ω) = ei(z,t) d(P X −1 )(z),
Ω Rn
ϕX (t) = ei(z,t) dμX (z).
Rn
L EMMA 1.4.– (Criterion for independence) Consider a random vector X = (Xk )n1 .
Its components are independent if, and only if, ϕX can be decomposed as follows:
P ROOF.–
a) Let Xk be independent. Then random variables eitk Xk , k = 1, . . . , n are
independent as well, and
n n n
ϕX (t) = E e itk Xk
= Ee itk Xk
= ϕXk (tk ); ϕXk (0) = 1.
1 1 1
16 Gaussian Measures in Hilbert Space
Let Y = (Yk )n1 be a random vector with independent components and the same
marginal distributions:
μ Yk = μ X k , k = 1, . . . , n.
n
(Such Y can be constructed if to apply lemma 1.3 to the measure μ = 1 μXk .)
Then, by part (a) of the proof,
n n
ϕY (t) = ϕYk (tk ) = ϕXk (tk ) = ϕX (t), t ∈ Rn .
1 1
Therefore,
n n
μ X = μY = μY k = μ Xk ,
1 1
D EFINITION 1.11.– Given a probability measure μ on B(Rn ), its mean value mμ and
variance–covariance matrix Cov(μ) = (sij )ni,j=1 are defined as follows:
n
n
mμ = xdμ(x) := xk dμ(x) = (mk )1 ,
Rn Rn k=1
Definition 1.11 is consistent with the corresponding definition of the mean and
variance–covariance matrix of a random vector. Indeed, for a random vector X, it
holds
i.e. expectation and variance–covariance matrix of a random vector are just the mean
and variance–covariance matrix of its distribution.
Gaussian Measures in Euclidean Space 17
(Su, v) = (z − m, u) (z − m, v) dμ(z), u, v ∈ Rn .
Rn
Those expressions are the first and the central second moments of measure μ.
Problems 1.4
ξ ∼ N (m, S)
and say that ξ is a Gaussian random vector with mean m and variance–covariance
matrix S. Here, S is a positive semidefinite n × n real matrix as a variance–covariance
matrix of a random vector in Rn .
P ROOF.– R.v. (ξ, a) is Gaussian according to definition 1.12. Its mean and variance
are evaluated in corollary 1.3.
R EMARK 1.3.– If a random vector ξ has characteristic function given in lemma 1.6,
with certain n × n real and symmetric matrix S, then S is positive semidefinite and
ξ ∼ N (m, S).
Since the absolute value of characteristic function does not exceed 1, matrix S is
positive semidefinite, and moreover (ξ, a) ∼ N (ma , σa2 ), with ma = (a, m),
σa2 = (Sa, a). Hence, ξ is a Gaussian vector, with some parameters m1 ∈ Rn
and S1 ∈ Rn×n , S1 is positive semidefinite. Then lemma 1.5 implies
(ξ, a) ∼ N (m̃a , σ̃a2 ), with m̃a = (a, m1 ), σ̃a2 = (S1 a, a). We get (a, m) = (a, m1 )
and (Sa, a) = (S1 a, a) for all a ∈ Rn . Thus, m1 = m and S1 = S.
P ROOF.–
1) The formula for ϕγ follows from lemma 1.5 with m = 0 and S = In .
Therefore,
n
t2
k
ϕγ (t) = e− 2 .
k=1
R EMARK 1.4.– (About uncorrelated Gaussian variables) Theorem 1.6 can be extended
as follows: jointly Gaussian random variables ξ1 , . . . , ξn are independent if, and only
if, they are uncorrelated. Based on theorem 1.6, this can be proven by consideration of
i −E ξi
normalized random variables ηi = ξ√ Dξ
(before we cancel that ξi are constant a.s.).
i
20 Gaussian Measures in Hilbert Space
Lemma 1.5 can be generalized for any linear transformation of a Gaussian vector.
Aξ ∼ N (Am, ASA ).
Now, we want to show that for any m ∈ Rn and positive semidefinite matrix
S ∈ Rn×n , a random vector ξ ∼ N (m, S) can be obtained as an affine transformation
of standard Gaussian vector.
n
A= λk ek e
k.
1
D EFINITION
√ 1.14.– Let A be a positive semidefinite matrix as described above.
1
A 2 = A is a matrix satisfying
√
n
A= λk e k e
k.
1
√ It is a unique positive semidefinite matrix with its square equal to A. The √ matrix
√ A has the same eigenbasis e 1 , . . . , e n and corresponding eigenvalues λ1 , . . . ,
λn .
L EMMA 1.8.– (Representation of Gaussian vector via standard Gaussian vector) Let
m ∈ Rn , S ∈ Rn×n be a positive semidefinite matrix and γ ∼ N (0, In ). Then
√
ξ := m + Sγ ∼ N (m, S).
1) For ξ ∼ N (m, S), there exist i.i.d. N (0, 1) random variables γ1 , . . . , γr on the
underlying probability space such that
r
ξ =m+ λk γk ek , a.s.
1
— Entä hän?
— Onnea matkallesi!
— Kallion kangastako?
— Niin.
Jaakko kirosi ja lähti hammasta purren menemään metsään, mutta
Emmi juoksi hänen jälkeensä ja tarttui häntä käsipuolesta.
— Möit?
— Minkä?
*****
Ovatko he?
Miehistä se oli hyväkin siitä syystä, että oli kuin toinen toistaan
turvaamassa täällä oudossa ja vieraassa seudussa. Vaimot
tuskittelivat ensin ahtautta, mutta tyytyivät lopulta. Eihän auttanut
valittaminen. Entiset väljemmät liikkuma-alat olivat muistona vain.