Professional Documents
Culture Documents
Math 139 Fourier Analysis Notes PDF
Math 139 Fourier Analysis Notes PDF
1. Riemann integral
Definition 1.1. A bounded real-valued function f : [a, b] → R is called Riemann
integrable if for every > 0 there exists a partition P such that U (P, f )−L(P, f ) < .
Rb
Definition 1.2. For f integrable on [a, b] we define a f (x) dx to be the common
value
Z b
(1) f (x) dx = inf U (P, f ) = sup L(P, f ).
a P P
Remark. The following lemma will prove useful: that any integrable function can
be approximated (in some sense) by continuous functions. The proof also shows
that one can alternatively use step functions.
2. Measure Zero
Remark. A notion of “smallness” for sets.
Definition 2.1. E ⊂ R is said to be of measure 0 if, given any > 0, there exists
a countable family of open intervals {Ik } such that
E ⊂ ∪k Ik
(1) P
∞
(2) k=1 |Ik | <
Theorem 2.3. A bounded function f : [a, b] → R is integrable if and only if its set
of discontinuities is of measure 0.
Remark. The authors did not include the following knowledge in the appendix, but
it is also assumed. You will need to use this knowledge at various points, but not
prove it.
4. Uniform Convergence
Remark. There is a stronger form of convergence, however: so-called uniform con-
vergence, which turns out to preserve at least some of the above properties. (Ref-
erence: Rudin, Principles of Mathematical Analysis, chapter 7)
Definition 4.1 (uniform convergence). Let fn : E → C; n = 1, 2, 3, . . . . and f :
E → C. If, for all > 0, there exists an N such that n > N implies |fn (x)−f (x)| <
for all x ∈ E, then we say {fn } converges to f uniformly.
Remark. Intuition: the tube.
Theorem 4.2 (Cauchy criterion). {fn } converges uniformly to f on E ⇐⇒ for all
> 0, there exists N such that m, n > N implies |fn (x) − fm (x)| < for all x ∈ E.
Proof. ⇒) Fix > 0. Since convergence is uniform on E, we know there exists
N > 0 such that if n > N then |fn (x) − f (x)| < /2 for all x ∈ E.
⇐) Note that for each fixed x ∈ E, {fn (x)} is a Cauchy sequence, and so
converges to some value, f (x). By hypothesis, given > 0, there exists N such
that n > N implies |fn (x) − fm (x)| < 2 for all n, m ≥ N . Let m → ∞; we get
|fn (x) − f (x)| ≤ 2 .
Theorem 4.3 (recharacterization). Say that limn→∞ fn (x) = f (x), and let Mn :=
supx∈E |fn (x)−f (x)|. Then fn → f uniformly on E if and only if limn→∞ Mn = 0.
PRELIMINARY CONCEPTS 3
6. Fubini’s theorem
Remark. One theorem that will come in handy is the following. (Reference: Rudin,
Real and Complex Analysis, pp. 165ff)
Theorem 6.1. If f is a (measurable) function such that
Z Z
(6) |f (x, y)| dx dy < ∞,
R R
R R R R
then R RR fR (x, y) dx dy = R R f (x, y) dy dxthe order of integration in the double
integral R R f (x, y) dx dy may be reversed without changing the value of the inte-
gral.
Remark. Note that this is not true in general; see Rudin, p. 166 for examples.
THE WAVE EQUATION: D’ALEMBERT’S FORMULA
1 ∂ 2u ∂ 2u
(1) = 2,
c2 ∂t2 ∂x
for some constant c > 0.
Changing our units (let X = a1 x, T = 1b t), and letting
U (X, T ) = u(x, t), we get with appropriate choice (a =
L L
π , b = cπ ) of constants that the wave equation (1) above is
∂ ∂
∂T = b ∂t
∂ ∂
equivalent to the following: ∂X = a ∂x
c2 π 2 ∂ 2 u π2 ∂ 2 u
2 2 c2 L2 ∂T 2 = L2 ∂X 2
∂ U ∂ U
(2) 2
=
∂T ∂X 2
where 0 ≤ X ≤ π. That is, without loss of generality, we
may assume that the string is of length π, and that the
constant c = 1, i.e., that
∂ 2u ∂ 2u
(3) = 2 on 0 ≤ x ≤ π, t ≥ 0.
∂t2 ∂x
Goal: find
u(x, t)
Solutions on R are all combinations of satisfying
the above.
traveling waves.
Book gives
two methods
both relevant
one more so
2 THE WAVE EQUATION: D’ALEMBERT’S FORMULA
First observation. Suppose we ignore the initial condi-
tions (that u(0, t) = u(π, t) = 0 for all t > 0). Then, for
any twice differentiable function F , if we define either
(4) u(x, t) = F (x + t) or u(x, t) = F (x − t),
it is an easy calculation that either solves the equation.
Such solutions are called traveling waves, for obvious rea-
sons.
In fact, any twice-differentiable solution u to the
wave equation on R must be a combination of (op-
posing) traveling waves.
For let ξ = x + t, η = x − t, and notate
(5) ν(ξ, η) = u(x, t).
Then, again by the Chain Rule,
∂ ∂ξ ∂ ∂η ∂
(6) = +
∂x ∂x ∂ξ ∂x ∂η
∂ ∂
(7) = +
∂ξ ∂η
and, similarly,
∂ ∂ ∂
(8) = − ,
∂t ∂ξ ∂η
so the wave equation is equivalent to
∂ 2v ∂ 2v ∂ 2v ∂ 2v ∂ 2v ∂ 2v
(9) +2 + = 2 −2 + ,
∂ξ 2 ∂ξ∂η ∂η 2 ∂ξ ∂ξ∂η ∂η 2
i.e.,
∂ 2v
(10) = 0.
∂ξ∂η
Thus
(11) v(ξ, η) = F (ξ) + G(η),
or, switching back to x, t notation,
(12) u(x, t) = F (x + t) + G(x − t),
a sum of two waves in opposite directions, as claimed.
LECTURE 2: D’ALEMBERT’S FORMULA (CONT’D);
STANDING WAVES; HEAT EQUATION
∂ 2 u 1 ∂u 1 ∂ 2u
(25) ∆u = 2 + + = 0,
∂r r ∂r r2 ∂θ2
2
2∂ u ∂u ∂ 2u
(26) i.e., r +r =− 2
Same approach as ∂r2 ∂r ∂θ
before: separation of We take the same “separation” approach as above: let
variables u(r, θ) = F (r)G(θ); then by a similar argument, we get
00
G (θ) + λG(θ) = 0
(27)
r2 F 00 (r) + rF 0 (r) − λF (r) = 0
As before, we obtain a family of solutions,
(28) um (r, θ) = r|m| eimθ ; m ∈ Z
and, supposing that u be some linear combination
X ∞
(29) u(r, θ) = am r|m| eimθ
−∞
Different setting, of those solutions, we see that, in this different setting, we
same question arrive at an identical question. For the boundary value
condition requires that
X∞
(30) u(1, θ) = am eimθ = f (θ),
−∞
so, our question is, again: “Given any reasonable function
f on [0, 2π] with f (0) = f (2π), can we find coefficients am
such that
X∞
(31) f (θ) = am eimθ ?”
−∞
LECTURE 3: INTRODUCTION TO FOURIER SERIES
Question. (dumb) what are the Fourier coefficients of DN ?
Poisson kernel:
arose in heat
Definition 3.3. We define the Poisson kernel Pr (θ) by equation
∞
X
Pr (θ) = r|n| einθ
n=−∞
Draw a picture where > 0 is chosen so small that outside of (−δ, δ), we
still have
|p(θ)| < 1 − .
2
Notice that by continuity of cos θ, we can choose a small
η > 0 such that inside of (−η, η), we have
p(θ) > 1 + .
2
k
Let pk (θ) = [p(θ)] (note that these are all trigonometric
polynomials). Point: powers of
Since the Fourier
P inx coefficients fˆ(n) := hf, e2πinx/L i are all p will (uniformly)
shrink outside of the
0, we have hf, cn e i = 0 for all trigonometric polynomi- δ neighborhood, but
als. However, we have just created a sequence of trigono- grow to infinity uni-
formly inside the η
metric polynomials for which that does not happen....(to neighborhood
be continued) (The Idea)
LECTURE 4: UNIQUENESS, PART II
1. Convolutions
Remark. Now for a seemingly simple, but important no-
tion....
Definition 1.1. Let f, g : R → C be 2π-periodic functions.
The convolution f ∗ g of f and g is the function defined on
[−π, π] by
Z π
1
(f ∗ g)(x) := f (y)g(x − y) dy
2π −π
Remarks.
(1) It is an easy exercise (C.O.V.) to see that f ∗g = g ∗f .
(2) Convolution as weighted average.
(3) Turns out that many important constructs can be
expressed in terms of convolutions. E.g., The Hilbert
Transform
For example, consider f ∗ DN , the Dirichlet kernel : “kernel” = “that
which one convolves
against”
Z π N
1 X
(f ∗ DN )(x) := f (y) ein(x−y) dy
2π −π −N
N Z π
X 1
= f (y)ein(x−y) dy
2π −π
−N
N Z π
X 1
= e inx
f (y)e−iny dy
2π −π
−N
XN
= einx fˆ(n) =: SN (f )(x),
−N
the N th partial sum of the Fourier series. The question about
convergence of
Fourier series can
be thought of as
the convergence
of a sequence of
particular weighted
averages.
2 LECTURE 5: CONVOLUTIONS AND GOOD KERNELS
2. Properties of Convolution
Theorem 2.1 (Basic properties). Let f, g, h be 2π-periodic
1
L (T) a Banach al- integrable functions, and c ∈ C. Then
gebra.
i. (Linearity I) f ∗ (g + h) = (f ∗ g) + (f ∗ h)
ii. (Linearity II) (cf ) ∗ g = c(f ∗ g) = f ∗ (cg)
iii. (Commutative) f ∗ g = g ∗ f
iv. (Associative) (f ∗ g) ∗ h = f ∗ (g ∗ h)
v. (Continuity!) f ∗ g is continuous.
vi. (Interaction with Fourier transform) f[ ∗ g(n) = fˆ(n)ĝ(n)
What is f\ ∗ DN (n)?
ˆ
f (n)χ[−N,N ] (n).
Remark. If one assumes that f, g, h are continuous func-
Obvious if continu- tions, then all of the properties, excluding the fifth, are
ous immediate calculations. E.g., (using Fubini’s theorem) one
can prove (vi) for continuous functions as follows.
Z π
1
f[∗ g(n) := (f ∗ g)(x)e−inx dx
2π −π
Z π Z π
1 1
= f (y)g(x − y) dy e−inx dx
2π −π 2π −π
Z π Z π
1 1
= f (y)e−iny g(x − y)e−in(x−y) dx dy
2π −π 2π
Z π Z−ππ
1 1
= f (y)e−iny g(x)e−inx dx dy
2π −π 2π −π
= fˆ(n)ĝ(n)
Proof of (v), first for
cts. fns. (fairly stan- Proof. We will prove the second-to-last property, initially
dard argument) in the case that f, g are continuous. Then we will show
how one obtains the result for integrable functions by ap-
proximating them with continuous ones.
Step I. Suppose f, g are continuous; we want to show
f ∗ g is also. I.e., we want to show that given any > 0,
there exists a δ such that |x1 − x2 | < δ implies |(f ∗ g)(x1 ) −
(f ∗ g)(x2 )| < . This is actually
uniform continuity;
note [−π, π] is
compact.
LECTURE 5: CONVOLUTIONS AND GOOD KERNELS 3
1. Convolutions, continued
Recall: we were proving certain properties about the con-
volution of two (integrable) functions; more importantly,
we were showing examples of how one extends results on
continuous functions to integrable functions, using the “L1
approximation lemma.”
Second example
Claim: (vi) For integrable f, g, f[∗ g = fˆĝ. of extending a
result from contin-
uous functions to
Proof. Let {fk }, {gk } be sequences of continuous functions integrable ones.
converging to f, g in L1 . In the previous example, we
showed that fk ∗ gk converges to f ∗ g uniformly, so, in- Key: uniform con-
terchanging integral and limit, vergence of fk ∗ gk
A different way of
recovering the func-
tion.
Remark. As we are starting to see, even if the function is
continuous, the Fourier series may not recover the function.
On the other hand, there should be enough information in
the Fourier coefficients to recover the function, especially There should be
for continuous functions: after all, we have the uniqueness enough informa-
tion!
theorem. How can we recover the function from the Fourier
series, if not in the direct way?
1. Cesaro summability
Definition 1.1. Given a sequence {cn }, let sn := nk=0 ck
P
be the sequence of partial sums. We define the N th Cesaro Cesaro sum of the se-
th ries
P∞sequence {sk } (a.k.a. the N Cesaro sum
mean σN of the
of the series k=0 ck ) by
s0 + s1 + · · · + sN −1
σN := .
N
Remark. Convergence implies Cesaro summability.
lim A(r) = s
r→1
P
then we say the series ck is Abel summable to s.
Examples
Example. Consider ∞ k
P
k=0 (−1) = 1 − 1 + 1 − 1 + 1 . . . . It
diverges, but is Abel summable to s = 12 :
∞
X 1
A(r) := (−1)k rk = .
1+r
k=0
Example. (Done in text.) Consider ∞ k
P
k=0 (−1) (k + 1) =
1 − 2 + 3 − 4 + 5 . . . . It diverges, but is Abel summable to
s = 14 :
∞
X 1
A(r) := (−1)k (k + 1)rk = .
(1 + r)2
k=0
function f :
∞
X
f (θ) ∼ an einθ .
n=−∞
4 LECTURE 7: CESARO AND ABEL SUMMABILITY
Remarks.
i. If we let c0 = a0 , cn = an einθ + a−n e−inθ , then the Abel
means of the PFourier series above equals the Abel means
of the series ∞ k=1 ck .
ii. For f integrable, |an | is uniformly bounded in n, so
Ar (f ) converges absolutely, and for each fixed 0 ≤ r <
1, uniformly.
This means can also
be recognized as a
convolution. Lemma 4.2 (Abel means as a convolution).
Ar (f )(θ) = (f ∗ Pr )(θ)
Proof. Recall the Poisson kernel
∞
X
Pr (θ) := r|n| einθ
n=−∞
(We also saw that
2
Then
Pr (θ) = 1−2r1−r ∞
cos θ+r 2 X
for 0 ≤ r < 1.) Ar (f )(θ) := r|n| an einθ
n=−∞
∞ Z π
X 1
= r|n| f (φ)e−inφ dφ einθ
n=−∞
2π −π
∞
!
Z π
1 X
= f (φ) r|n| e−in(φ−θ) dφ
2π −π n=−∞
= (f ∗ Pr )(θ).
(Note we needed
uniform conver-
gence.)
Pr is an approxima-
Lemma 4.3. The Poisson kernel is an approximation of
tion of the identity. the identity (as r ↑ 1).
LECTURE 7: CESARO AND ABEL SUMMABILITY 5
1
For ≤ r ≤ 1 and δ ≤ |θ| ≤ π we see that
2
2
1
1 − 2r cos θ + r2 = 1 − + (1 − cos θ) ≥ cδ > 0;
2
and thus
1 − r2
Pr (θ) ≤
cδ
in δ ≤ |θ| ≤ π; thus
Z
lim Pr (θ) dθ = 0,
r↑1 δ≤|θ|≤π
∞
X 1 0 n2
[a00n (r) + an (r) − 2 an (r)]einθ = 0
n=−∞
r r
and thus
1 0 n2
a00n (r) + an (r) − 2 an (r) = 0
r r
for all n ∈ Z.
The equation above implies (Exercise 11, Chapter 1) that
The coefficient must
be of a certain form
an (r) = An rn + Bn r−n
for some An and Bn . Now, for n ≥ 1, Bn = 0 since
Z π
1
an (r) := v(r, θ)e−inθ dθ
2π −π
is bounded; to find An , take
Z π
1
An = lim an (r) := lim v(r, θ)e−inθ dθ.
r↑1 r↑1 2π −π
an (r) = fˆ(n)rn ;
similarly for n < 0 (and for n = 0). All together, we have
∞
X
v(r, θ) = fˆ(n)r|n| einθ
n=−∞
LECTURE 9: THE FOURIER SERIES
RECOVER THE FUNCTION IN THE L2 SENSE
Now,
t
tDN (t) = sin((N + 1/2)t)
sin(t/2)
t
= [sin(N t) cos(t/2) + cos(N t) sin(t/2)]
sin(t/2)
so we get
Z π
1
F (t)tDN (t) dt
2π −π
Z π
1 t
= F (t) [sin(N t) cos(t/2) + cos(N t) sin(t/2)] dt
2π −π sin(t/2)
which goes to 0 by the Riemann-Lebesgue lemma.
Remark. In fact, the conclusion is true even for f only Lip-
schitz at θ0 .
Alternate proof. (Chernoff, P. The American Mathematical
Monthly, vol. 87, No. 5, May 1980, pp. 399-400.) Even cuter proof
4 L2 RECOVERY OF THE FUNCTION
WLOG assume that x0 = 0 and f (x0 ) = 0. Since f (0) =
0 and f 0 (0) exists, the function g(x) = f (x)/[eix − 1] is
(limit exists by bounded near 0 , and thus is integrable since f is.
L’Hôpital’s rule) Then
fˆ(n) = ĝ(n − 1) − ĝ(n),
a telescoping series, and
XN
SN f (0) = fˆ(n) = ĝ(−N − 1) − ĝ(N );
−N
which tends to 0 by the Riemann-Lebesgue lemma.
Corollary 2.2 (Localization principle of Riemann). Let f
and g be integrable on the circle. Suppose f ≡ g in some
Convergence of neighborhood of a point θ0 . Then
SN (f )(θ0 depends
only on the behavior lim SN (f )(θ0 ) − SN (g)(θ0 ) = 0.
N →∞
of f near θ0 .
(Shocking!?) Remark. Note that neither f nor g need to be differentiable
at θ0 , and that this does not imply that the Fourier series
of either converges at θ0 , only that their convergence or di-
vergence is connected (and, if they converge, they converge
to the same limit).
LECTURE 11: FOURIER SERIES NEED NOT
CONVERGE AT POINTS OF CONTINUITY
Claim:
(i) |f˜N (0)| ≥ c log N
(ii) fN (θ) is uniformly bounded in N and θ
2 L2 RECOVERY OF THE FUNCTION
Recall Tauber’s
P the- (i) is evident. To prove (ii) will require a little machinery:
orem: if cn is
Lemma 1.1. Let ∞
P
Abel summable to
s, then
P
cn actu- n=1 cn be an infinite series. If
(i) the Abel means Ar = ∞ n
P
ally converges to s if n=1 r cn are bounded as r ↑ 1,
cn = o(1/n). and
(ii) cn = O(1/n)
then the partial sum sequence SN = N
P
n=1 is bounded.
einθ
P
Claim: fN (θ) = 1≤|n|≤N n is uniformly bounded in N
follows immediately and θ.
from the lemma
Proof. (of claim (ii)) fN (θ) is the partial sum of the Fourier
inθ
series n6=0 e n , the Fourier series of the sawtooth function
P
f . Since Use the convolution
form of the Abel
(i) The Abel means are expressible as f ∗ Pr (θ), and since means
f is bounded (and ||Pr ||1 ≤ M ) the Abel means are
bounded.
(ii) cn = einθ /n + e−inθ /n, which is certainly O(1/n).
we see SN (f )(θ) is uniformly bounded in N and θ.
1.3. Creating the example: the Heart of the Matter.
http://www.math.uchicago.edu/ may/VIGRE/VIGRE2010/
REUPapers/Stratmann.pdf for an undergraduate’s REU
summary of the argument).
LECTURE 12: FOURIER SERIES AND THE
ISOPERIMETRIC INEQUALITY
1. Number theory:
Weyl’s equidistribution theorem
(Another easily-
1.1. Basic knowledge. attained result)
N
X
#{1 ≤ n ≤ N : hnγi ∈ (a, b)} = χ(a,b) (nγ).
n=1
Proof. (trivial)
Technique: state- i. Case: f ∈ {1, e2πix , . . . , e2πikx , . . . }. R1
ment trivial for
trigonometric
f = 1 is obvious. Otherwise, the integral 0 f = 0, so
polynomials, which we need to see that the average tends to 0. But, since
are L∞ dense in the e2πikγ 6= 1,
continuous periodic
functions. N N
1 X 1 X 2πiknγ
f (nγ) := e
N n=1 N n=1
e2πikγ 1 − e2πikN γ
=
N 1 − e2πikγ
(geometric sum) which goes to 0 as N → ∞.
ii. Case: trigonometric polynomials.
The problem is linear, so the lemma holds for linear
combinations of exponentials.
(by the uniform iii. Case: f a continuous periodic function. We know that
convergence of
the Cesaro means
there exists a trigonometric polynomial P such that
for continuous ||f (x) − P (x)||∞ < /3 and, by step i, that the lemma
functions, i.e,. the
goodness of the
Fejer kernel - here’s
where the Fourier
analysis enters)
WEYL’S EQUIDISTRIBUTION THEOREM 3
1.6. Observations.
Corollary 1.7. In fact, the main lemma holds even if f is
merely Riemann integrable.
Proof. Approximate f such a step function s such that ||f −
s||∞ < /3 (see the proof of the L1 approximation lemma).
Then
N Z 1 N N
1 X 1 X 1 X
f (nγ) − f (x) dx ≤ f (nγ) − s(nγ)
N N N n=1
n=1 0 n=1
N Z 1
1 X Z 1 Z 1
+ s(nγ) − s(x) dx + s(x) dx − f (x) dx
N 0 0 0
n=1
Since s is a finite linear combination of characteristic func-
tions of intervals, the middle term can be made smaller
than /3 by taking N sufficiently large; the other terms are
both also smaller than /3.
Remark. Connection with dynamical systems: the system
is “ergodic”; that is, for all irrational γ, denoting
ρ(θ) = θ + 2πγ mod 2π,
the “time average”
N
1 X
lim f (ρn (θ))
N →∞ N
n=1
exists for each θ, and equals the “space average”
Z 2π
1
f (θ) dθ
2π 0
Remark. Notice that along the way, we proved the forward
direction of the following statement:
Theorem 1.8. Weyl’s criterion: A sequence of real num-
bers {ξi } in (0, 1) is equidistributed if and only if for all
WEYL’S EQUIDISTRIBUTION THEOREM 5
k ∈ Z,
1 X 2πikξn
lim e → 0.
N →∞ N
LECTURE 14: A CONTINUOUS, NOWHERE
DIFFERENTIABLE FUNCTION
1. Cool examples
i. Weierstrass’s example: Let a ∈ N, a > 1; b ∈ (0, 1).
Then if ab > 1 + 3π
2 ,
∞
X
W (x) := bn cos(an x)
n=1
where
1 if |n| ≤ N
D
d N (n) =
0 if |n| > N
Partial sums: trun- (Draw this!) I.e., we “chop off” the Fourier series for the
cation terms with indices |n| > N .
Doing the same thing for the Cesaro sums, we see that
on the Fourier coefficient side one weights them as follows:
Cesaro sums:
weighted truncation
σ\
N (g)(n) := g ∗ FN (n)
\
1 c
= ĝ(n) [D 0 (n) + D1 (n) + · · · + DN −1 (n)]
c \
N 1
ĝ(n) N [N − |n|] for |n| ≤ N
=
0 for |n| > N.
Equivalently,
S0 (g)(x) + S1 (g)(x) + · · · + SN −1 (g)(x)
σN (g)(x) :=
N
N −1
1 XX
= ak eikx
N
`=0 |kl≤`
1 X
= (N − |n|)an einx
N
|n|≤N
X |n|
= 1− an einx
N
|n|≤N
Delayed means: Big On the Fourier coefficient side, it is easy to see that
triangle - little trian-
gle = trapezoid
A CONTINUOUS, NOWHERE DIFFERENTIABLE FUNCTION 3
ĝ(n) if |n| ≤ N
\ |n|
∆N (g)(n) = ĝ(n)2(1 − 2N ) if N ≤ |n| ≤ 2N
0 if |n| > 2N
which 2k ≤ N , then
∆2k (fα ) = SN (fα )
Even though 2k ≤ N , there are no frequencies between 2k We don’t miss any-
and N anyway, because of the lacunary nature of the series. thing, because of the
lacuna.
Dumb observation: If 2N = 2n , then
n
∆2N (f ) − ∆N (f ) = 2−nα ei2 x
(We can catch the
top term in an obvi-
Question. Why not do this using the partial sum operator? ous way.)
Z π
0
|σN (g) (x0 )| ≤ C |FN0 (t)| |t| dt.
−π
Useful estimates
FACTS: Useful estimates on FN0
i. |FN0 (t)| ≤ AN 2
ii. |FN0 (t)| ≤ |t|A2
Break up the inte- Putting it all together, we see
gral
Z π
0
|σN (g) (x0 )| ≤ C |FN0 (t)| |t| dt
Z−π Z
0
≤C |FN (t)| |t| dt + C |FN0 (t)| |t| dt
|t|≥ 1 |t|≤ N1
Z N Z
A 2 1
≤C 2
|t| dt + C AN dt
|t|≥ N1 |t| |t|≤ N1 N
problem
Proof of the second fact. WTS that |FN0 (t)| ≤ A
|t|2 .
Well
1 sin2 (N t/2)
FN (t) = ,
N sin2 (t/2)
sin(N t/2) cos(N t/2) 1 cos(t/2) sin2 (N t/2)
so FN0 (t)= − .
sin2 (t/2) N sin3 (t/2)
1 cos(t/2) sin2 (N t/2)
1 sin(N t/2) cos(N t/2)
= −
sin2 (t/2) 1 N sin(t/2)
Now | sin(N t/2)| ≤ CN |t| and | sin(t/2)| ≤ c|t| for |t| ≤ π
so we get
0 CN |t| cos(N t/2) 1 cos(t/2)C 2 N 2 |t|2
so |FN (t)| ≤ − ....
c2 |t|2 N c3 |t|3
Remark. Something seems wrong here.
LECTURE 15: FINALLY, THE FOURIER TRANSFORM!
...(to be continued).
LECTURE 16: BASIC PROPERTIES
OF THE FOURIER TRANSFORM
We do need the sec- Now, f (x) and xf (x) are both rapidly decreasing, so
ond estimate
Z N ∈ N such that
there exists Z
|f | < and |x||f (x)| dx <
|x|≥N |x|≥N
and, by L’Hôpital’s Rule, for sufficiently small h we have,
For each fixed x0 , for the compact set |x| ≤ N ,
we can find an h. −2πixh
By continuity, that h e − 1 ≤
will will in a small
+ 2πix
neighborhood of x0 .
h N
Cover [−N, N ] with Outside of |x| ≤ N , we have the bound
such neighborhoods; −2πixh
choose the minimum e − 1 2 |sin(−πixh)|
h, which is indepen-
+ 2πix = + 2πix
dent of x.
h h
eix − 1 = 2| sin x2 | ≤ A + 2π|x|
sin h
since his bounded. Thus we have
fˆ(ξ + h) − fˆ(ξ)
\ (ξ)
+ 2πixf
h
Z N −2πixh
f (x)e−2πixξ
e − 1
≤ + 2πix dx +
−N
h
≤ C
Corollary 1.3. f ∈ S(R) implies fˆ ∈ S(R).
BASIC PROPERTIES 3
2πiξ fˆ(ξ))
implies that F (ξ) = Ce−πξR ∞ , −πx
and, plugging in ξ = 0 we
ˆ
see C = F (0) = f (0) = −∞ e
2
dx = 1 by the previous
calculation.
LECTURE 17: FOURIER INVERSION
−πx2
Theorem 1.2. Let f (x) = e . Then fˆ = f .
Proof. We shall show that fˆ satisfies a certain boundary value problem. Let
Z ∞
2
F (ξ) := fˆ(ξ) = e−πx e−2πixξ dx
−∞
Then, by the interaction of dilation and Fourier transform Miraculously (?), di-
lations of this eigen-
function form an ap-
proximation of the
identity.
2 LECTURE 17: FOURIER INVERSION
Z ∞
∗
F (g)(x) = ǧ(x) := g(ξ) e2πixξ dξ
−∞
Note that F(f )(y) =
Thus the Fourier inversion theorem can be written: for F ∗ (f )(−y).
f ∈ S(R),
ˇ
f (x) = fˆ(x).
It is easy to see that for g ∈ S(R), ǧˆ(ξ) = g(ξ) (i.e., F ◦F ∗ =
F ∗ ◦ F = I) and thus the Fourier transform is bijective on
S(R).
3. Plancherel’s theorem
(g ∗ R)(x) = g(t)R(x − t) dt
−M
2
PN0(−π(x−t) /δ0 )n
and R(x−t) = √1δ n=0 n! which is a polynomial
P2N00 n
(of the form n an (t)x ) in x
3. Application to PDEs
3.1. Time-dependent Heat equation on the line.
Remark. Crucial property of Fourier Transform: interchanges
differentiation with multiplication by polynomials.
The problem: given an infinite rod and an initial tem-
perature distribution f (x) at t = 0, what is u(x, t), the
temperature at point x ∈ R at time t > 0? Physical con-
siderations imply that
∂u ∂ 2 u
= 2.
∂t ∂x
The heat equation
∂ û
(ξ, t) = −4π 2 ξ 2 û(ξ, t)
∂t
and thus, fixing ξ, one gets a trivial differential equation,
viz.
4 WEIERSTRASS APPROX’N; HEAT EQUATION
∂ û
∂t (ξ, t)
= −4π 2 ξ 2 ,
û(ξ, t)
2 2
⇒ û(ξ, t) = A(ξ)e−4π ξ t
.
Z Z
|u(x, t)| ≤ |f (x − y)|Ht (y) dy + same
|y|≤ |x|
2 |y|≥ |x|
2
Proof of (iv). (The rest are similar to the proof in the case
of the heat equation on the line, and left as exercises).
We note that if f is any function of moderate decrease,
then we have the following bound (first estimate): First estimate
1 y
|(f ∗ Py )(x)| ≤ C + .
1 + x2 x2 + y 2
proof of first esti-
For mate
Z ∞ Z Z
f (x − t)Py (t) dt = + .
−∞ |t|< |x|
2 |t|> |x|
2
+
its maximum M at some point (x1 , y1 ) ∈ DR . Notice that
Observe: where a u ≤ M throughout R2+ . Now, by the MVP, we know that
max is attained, by Z 2π
the MVP the func- 1
tion must attain that u(x1 , y1 ) = u(x1 + ρ cos θ, y1 + ρ sin θ) dθ
max on every cir- 2π 0
cle centered at that
point. for, in particular, ρ ∈ (0, y1 ). Since u(x1 , y1 ) = M , u ≡ M
on that entire circle. Let ρ → y1 ; we see that then (since u
is continuous on R2+ ) u(x1 , 0) = M also: ※.
Connection between
2. Poisson summation formula
analysis on circle
and R.
Definition 2.1. Let f ∈ S (R). We define the periodiza-
tion of f to be the (continuous) 1-periodic function F1 :
Periodization of a [0, 1] → C defined by
function
∞
X
F1 (x) := f (x + n)
n=−∞
Remark. In particular,
X X
f (n) = fˆ(n).
n∈Z n∈Z
∂t = ∂x2
u(x, 0) = f (x)
4 POISSON SUMMATION FORMULA
Well, consider:
X
Ht (x) = Ht (x + n)
n∈Z
X
= Ht (x) + Ht (x + n) =: Ht (x) + Et (x).
n∈Z∗
For, consider:
1 X −(x+n)2
Et (x) := √ e 4t
4πt n∈Z ∗
C X −cn2
≤ √ e t .
t n∈Z∗
n2
1 1 2
≥ +n
t 2 t
4 POISSON SUMMATION FORMULA
Remarks.
i. Θ(0|is) = ϑ(s).
ii. Θ(x|4πit) = Ht (x)
Digressing even fur-
ther....
Definition 3.4. For s ∈ C such that <(s) > 1, we define
the celebrated Riemann zeta function by The Riemann zeta
∞ function
X 1
ζ(s) =
n=1
ns
Z ∞
1= |ψ(x)|2 dx
−∞
Z ∞
d
=− x |ψ(x)|2 dx
dx
Z−∞
∞
0 0
=− xψ (x)ψ(x) + xψ (x)ψ(x) dx.
−∞
Thus Z
∞
1≤2 |x||ψ(x)||ψ 0 (x)| dx
−∞
Z ∞ 1/2 Z ∞ 1/2
2 2 0 2
≤2 x |ψ(x)| dx |ψ (x)| dx
−∞ −∞
Z ∞ 1/2 Z ∞ 1/2
=2 x2 |ψ(x)|2 dx 4π 2 ξ 2 |ψ̂(ξ)|2 dξ ,
−∞ −∞
using the Plancherel theorem (and the basic properties of Followed by
the Fourier transform) for the equality in the last line. Now, Cauchy-Schwartz
and Plancherel’s
equality can hold only if equality held in the application of theorem
the Cauchy-Schwartz inequality. which implies that the
functions must be scalar multiples of each other:
ψ 0 (x) = βxψ(x)
for some scalar β. Again, elementary ODE theory implies
2
ψ(x) = Aeβx /2 .
To ensure the function is in S (R), we requirep
β = −2B for
2
some positive B; then ||ψ||2 = 1 forces A = 2B/π.
LECTURE 21: THE STEADY-STATE HEAT EQUATION
IN THE UPPER HALF PLANE (END); POISSON
SUMMATION FORMULA
Recall:
Theorem 2.2.
X
Ht (x) = Ht (x + n).
n∈Z
Well, consider:
X
Ht (x) = Ht (x + n)
n∈Z
X
= Ht (x) + Ht (x + n) =: Ht (x) + Et (x).
n∈Z∗
For, consider:
1 X −(x+n)2
Et (x) := √ e 4t
4πt n∈Z ∗
C X −cn2
≤√ e t .
t n∈Z∗
Remarks.
i. Θ(0|is) = ϑ(s).
ii. Θ(x|4πit) = Ht (x)
Digressing even fur-
ther....
POISSON SUMMATION FORMULA 5
Remarks.
i. Θ(0|is) = ϑ(s).
ii. Θ(x|4πit) = Ht (x)
Digressing even fur-
ther....
Definition 3.4. For s ∈ C such that <(s) > 1, we define
The Riemann zeta the celebrated Riemann zeta function by
function ∞
X 1
ζ(s) =
n=1
ns
It can be shewn that ϑ, ζ, and Γ are related by
Z ∞
1 s
π −s/2 Γ(s/2)ζ(s) = t 2 −1 (ϑ(s) − 1) dt.
2 0
Remark. This will become more relevant later (in your life).
LECTURE 23: HEISENBERG UNCERTAINTY;
BACKGROUND FOR F ON Rd
2.1.2. R3 .
In R3 , recall, using spherical coordinates, we can do a
change-of-variables to show that
Z Z 2π Z π Z ∞
f= f (r sin θ cos φ, r sin θ sin φ, r cos θ)r2 dr sin θ dθ dφ.
R3 0 0 0
As above, if we abbreviate (or more honestly, define)
Z Z 2 Z π
g(γ) dσ(γ) = π g(sin θ cos φ, sin θ sin φ, cos θ) sin θ dθ dφ,
S2 0 0
HEISENBERG UNCERTAINTY; F ON Rd 5
As before, we have the following:
Corollary 3.4. F maps S (Rd ) to itself.
3.1. Slight digression: Radial functions.
Definition 3.5. A function f on Rd is called radial if its
value is constant on spheres about the origin, i.e., there
exists f0 : R≥0 → C such that f (x) = f0 (|x|).
Remark. Obviously, f is radial ⇐⇒ f (Rx) = f (x) for all
rotations R.
Corollary 3.6. If f is radial, then fˆ is also.
Proof. WTS fˆ(Rξ) = fˆ(ξ) for all rotations R. By the
above,
fˆ(Rξ) = F [f (Rx)](ξ) = F (f )(ξ) = fˆ(ξ).
3.2. Fourier inversion and Plancherel on Rd .
Theorem 3.7. Let f ∈ S (Rd ). Then the Fourier inver-
sion formula
Z
f (x) = fˆ(ξ)e2πix·ξ dξ
Rd
holds, as does the Plancherel theorem, ||f ||2 = ||fˆ||2 .
HEISENBERG UNCERTAINTY; F ON Rd 7
4. Wave Equation in R3 × R
motivation Recall d’Alembert’s solution to the wave equation:
u(x + t) + u(x − t) 1 x+t
Z
u(x, t) = + g(y) dy.
2 2 x−t
“This suggests a generalization to higher dimensions, where
we might expect to write the solution of our problem as
averages of the initial data.”
Definition 4.1. Let f : R3 → C. We define the spherical
mean of f at x with radius t by spherical mean: first
example of a convo-
Z lution of a function
1 with a measure.
Mt (f )(x) = f (x − tγ)dσ(γ),
4π S 2
that is, the average of f over the sphere of radius t centered
at x.
Some useful lemmata:
Lemma 4.2. Let f ∈ S(R3 ). Then for each fixed t, Mt (f ) ∈
S(R3 ). Further, Mt (f ) is infinitely differentiable in t, and
each t-derivative is in S(R3 ).
Lemma 4.3 (Fourier transform of the surface measure).
Z
1 sin(2π|ξ|)
e−2πiξ·γ dσ(γ) = .
4π S 2 2π|ξ|
Remark. Denote the LHS by dσ(ξ).
c We notice that (it is
the Fourier transform of a radial “function.”): the above
lemma shows that it is then radial.
Proof. We first observe the formula is true for ξ = (0, 0, ρ)
for any ρ > 0 (ρ = 0 is immediate); then we show the left
hand side is a radial function. By definition,
Z Z 2π Z π
1 −2πiξ·γ 1
e dσ(γ) := e−2πiξ·γ sin θ dθ dφ
4π S 2 4π 0 0
6 LECTURE 24: THE WAVE EQUATION ON RD × R
(where γ = (sin θ cos φ, sin θ sin φ, cos θ) in the right-hand
side).
Z 2π Z π
1
= e−2πiρ cos θ sin θ dθ dφ
4π 0 0
Z π
1
= e−2πiρ cos θ sin θ dθ
2 0
1 1 2πiρu
Z
= e du (C.O.V.: u = − cos θ)
2 −1
1 2πiρu 1 sin(2πρ)
= e −1
= ;
4πiρ 2πρ
so the lemma is proven for ξ = (0, 0, ρ) for ρ ≥ 0.
(To be continued....)
LECTURE 25:
THE WAVE EQUATION ON R3 × R
In order to solve the initial value for the wave equation in di-
mensions bigger than one, we shall use the method of spher-
ical means, due to Hadamard. The intuitive grounds for this
methodology lies in our conception of waves as being made
of a superposition of spherically symmetric fronts emanating
from point sources. Huygens was a pioneer of this view of
waves, which he used to show that the laws of optics sug-
gested that light was a wave phenomenon.
(http://www.math.nyu.edu/faculty/tabak/PDEs/WE.pdf)
1. Wave Equation in R3 × R
Recall d’Alembert’s solution to the wave equation: motivation
Lemma 1.4.
\
M ˆ sin(2π|ξ|t) .
t (f )(ξ) = f (ξ)
2π|ξ|t
Fourier transform of
the spherical averag-
Proof. By definition, ing operator: calcu-
lation using the pre-
Z Z vious lemma
1
\
M t (f )(ξ) := e−2πix·ξ f (x − γt) dσ(γ) dx
R3 4π S2
Z Z
1 −2πix·ξ
= f (x − γt)e dx dσ(γ)
4π S 2 R3
Z Z
1
= f (y)e−2πi(y+γt)·ξ dy dσ(γ) (let y = x − γt)
4π S 2 R3
Z
1
= fˆ(ξ) e−2πi(γt)·ξ dσ(γ)
4π S 2
Z
1 sin(2π|ξ|t)
= fˆ(ξ) e−2πiγ·tξ dσ(γ) = fˆ(ξ)
4π S 2 2π|ξ|t
by the previous lemma.
Once we have the above lemmata, the solution becomes
clear:
4 LECTURE 25: THE WAVE EQUATION ON R3 × R
Theorem 1.5. In R3 × R, the solution to the Cauchy prob-
The explicit formula lem for the wave equation is
of the solution
∂
u(x, t) = (tMt (f )(x)) + tMt (g)(x)
∂t
Easy once we have
the above lemmata Proof. We break the problem into two subproblems: the
case when g = 0, and the case when f = 0. Using the
Fourier inversion expression of the solution that we worked
Calculus I trick out before, we see in the first case,
Z h i
u(x, t) = fˆ(ξ) cos(2π|ξ|t) e2πix·ξ dξ
R3
Z
∂ sin(2π|ξ|t)
= t fˆ(ξ) e2πix·ξ
dξ
∂t R 3 2π|ξ|t
∂
= (tMt (f )(x)),
∂t
Elementary school and in the second case,
arithmetic trick Z
sin(2π|ξ|t) 2πix·ξ
u(x, t) = ĝ(ξ) e dξ
R3 2π|ξ|
Z
sin(2π|ξ|t) 2πix·ξ
=t ĝ(ξ) e dξ
R 3 2π|ξ|t
= tMt (g)(x).
The solution to the general problem (for general f, g ∈
S(R3 )) is then the superposition of these two cases.
2. Cool observation about the solution:
Huygen’s Principle
Considering the form of the solution given above, i.e.,
that
∂
u(x, t) = (tMt (f )(x)) + tMt (g)(x)
∂t
Huygen’s Principle we see that the solution at (x, t) depends on the averages of
f and g (that is, data on the boundary t = 0) over spheres
(in R3 ) centered at x of radius t; equivalently, “the data at
a point x0 in the plane t = 0 influences the solution on the
LECTURE 25: THE WAVE EQUATION ON R3 × R 5
boundary of a forward light cone originating at x0 . (See
http://en.wikipedia.org/wiki/Huygens-Fresnel principle)
1.3. Case R2 .
Definition 1.1. For each n ∈ Z, let the nth Bessel function
Bessel function: you Jn (ρ) denote the nth Fourier coefficient of eiρ sin θ ; that is,
might have seen Z 2π
them in ODEs 1
Jn (ρ) = eiρ sin θ e−inθ dθ, or
2π 0
X∞
iρ sin θ
e = Jn (ρ)einθ .
n=−∞
Z
R(f )(P) = f
P
Proof. Trivial.
Lemma 2.6.
!
Z ∞ Z Z
f dt = f (x) dx
−∞ Pt,γ R3
Z Z
f (x) dx = f (Rx) dx
R3 R3
Z
= f (x1 γ + x2 e1 + x3 e2 ) dx1 dx2 dx3
R3 !
Z ∞ Z
= f dt.
−∞ Pt,γ
Definition 2.7 (Alternate definition of Radon Transform).
Let f ∈ S(R3 ). Then for (t, γ) ∈ R × S 2 we define the
Radon Transform of f by
Z
R(f )(t, γ) := f.
Pt,γ
Again, we note
that R(f )(t, γ) =
R(f )(−t, −γ); that We shall need an appropriately-defined Schwartz space.
is, really
Definition 2.8. Let F be a continuous function on R2 ×S 2
Relevant Schwartz that is infinitely differentiable in t. If
class S(R × S 2 ) `
k
∂ F
sup |t| ` (t, γ) < ∞
t∈R,γ∈S 2 ∂t
for all nonnegative k, ` ∈ Z (i.e., F (·, γ) is in S(R) uni-
formly in γ) then we say F ∈ S(R × S 2 ).
Lemma 2.9 (Fourier Slice, or Projection Theorem). If f ∈
THE key lemma: S(R3 ), then R(f )(t, γ) ∈ S(R) for each γ, and
The Fourier Slice
theorem b )(s, γ) = fˆ(sγ)
R(f
where ˆ denotes the one-dimensional Fourier transform in
the first variable in the LHS, and the three-dimensional
Fourier transform on the RHS.
Remark. In other words, if you project f onto the line {tγ}
and then take the 1-D Fourier transform, it’s the same as
taking the slice of the 2-D Fourier transform parallel to γ.
LECTURE 27: FOURIER SLICE THEOREM AND
RADON INVERSION FORMULA
Z
∗
R (F )(x) := F (x · γ, γ) dσ(γ).
S2
Remark. If F (t, γ) is the Radon transform R(f )(t, γ) then What is the dual
Radon transform
F (x · γ, γ) = R(f )(x · γ, γ) of the Radon
transform?
Z
= f,
Px·γ,γ
the integral over the plane with normal vector γ of distance
x · γ from the origin: in other words, the plane passing
through x with normal vector γ. Thus R∗ (F )(x) is the
integral of f over all planes passing through x: the so-called
backprojection of f . The backprojection
operator
2.2. Why is it called the dual? Let V1 = S(R3 ), with
inner product
Z
(f, g)1 = f g;
R3
2
let V2 = S(R × S ) with inner product
Z Z
(F, G)2 = F (t, γ)G(t, γ) dσ(γ) dt.
R S2
Then Duality formula
∗
(R(f ), F )2 = (f, R (F ))1 .
a.k.a. the filtered
2.3. The inversion formula. backprojection
inversion formula
Theorem 2.2. Let f ∈ S(R3 ). Then
∆(R∗ R(f )) = −8π 2 f.
Proof. As we noted earlier, the Fourier slice theorem (plus
the one-dimensional inversion formula) imply 1. Fourier slice theo-
Z ∞ rem
R(f )(t, γ) = fˆ(sγ)e2πits ds;
−∞
so Z Z ∞
∗
R R(f )(x) = fˆ(sγ)e2πix·γs ds dσ(γ).
S2 −∞
4 FOURIER SLICE THEOREM AND RADON TRANSFORM INVERSION
2. differentiation un- Then, differentiation under the integral sign (plus the fact
der the integral sign that γ ∈ S 2 ) imply
Z Z ∞
∗
∆(R R(f ))(x) = fˆ(sγ)(−4π 2 s2 )e2πix·γs ds dσ(γ)
S 2 −∞
Z Z ∞
= −4π 2
fˆ(sγ)e2πix·γs s2 ds dσ(γ)
2
ZS Z−∞ ∞
= −4π 2
fˆ(sγ)e2πix·γs s2 ds dσ(γ)
2
Z SZ 0 0
− 4π 2 fˆ(sγ)e2πix·γs s2 ds dσ(γ)
S 2 −∞
Z Z ∞
= −8π 2 fˆ(sγ)e2πix·γs s2 ds dσ(γ)
S2 0
2
= −8π f (x).
Notes on the above calculation:
invariance under ro- 1. The second-to-last inequality follows since
tation Z Z 0
−4π 2 fˆ(sγ)e2πix·γs s2 ds dσ(γ)
S 2 −∞
Z Z ∞
= −4π 2
fˆ(−sγ)e−2πix·γs s2 ds dσ(γ)
2
ZS Z0 ∞
= −4π 2 fˆ(sγ)e2πix·γs s2 ds dσ(γ)
S2 0
3. polar integration where one rotates γ to −γ in the last step.
2. The last equality follows from (reverting) the polar
integration formula:
Z Z ∞ Z
fˆ(sγ)e2πix·γs 2
s ds dσ(γ) = fˆ(ξ)e2πix·ξ dξ
S2 0 R3
= f (x).
Remark. In general, the reconstruction formula for the Radon
Reconstruction for- transform is as follows:
mula in Rd
FOURIER SLICE THEOREM AND RADON TRANSFORM INVERSION 5
(2π)1−d (d−1)
(−∆) 2 R∗ (R(f )) = f,
2
where the fractional Laplacian is defined by Fractional Lapla-
Z cian, or inverse
(−∆)α f (x) := (2π|ξ|)2α fˆ(ξ)e2πiξ·x dξ Riesz transform
Rd
d
for f ∈ S(R ). Note that the formula is (again) more simple
for the odd dimensions than for the even.
Remark. In using the Schwartz class, we have actually swept
an entire world of details under a rug. For the interested
reader, please see, for example, http://equinto.math.tufts.edu/
research/sc-article.pdf, an introductory article to the field Reference to
Quinto’s
by Todd Quinto of Tufts (whose thesis advisor was Cor- from the workshoparticle
Proof.
N −1
1 X 1
|F (n)|2 =: ||F ||2
N n=0 N
N −1
1 X
= |(F, e∗n )|2
N n=0
N −1 2 N −1
X 1 ∗
X
|an |2 .
= √N (F, en ) =:
n=0 n=0
Noticing that
k(2`) k`
ω2M = ωM and
k(2m+1) 2
mk k mk k
ω2M = ω2M ω2M = ωM ω2M
by the observation in the first paragraph of the proof fin-
ishes the claim.
Remark. Notice that the algorithm is built into the proof
of the lemma. The FFT was discovered by Cooley and
Tukey in 1965; however, in 1984 it was discovered that it
(as usual) had already been known to Gauss around 1805.
LECTURE 30: FINITE FOURIER ANALYSIS:
THE FAST FOURIER TRANSFORM
1. Proof of FFT
Theorem 1.1 (FFT). Given ωN = e−2πi/N (with N = 2n ),
it takes at most Much better ver-
sion.
4 · 2n n = 4N log2 (N ) = O(N log N )
operations to calculate the Fourier coefficients of a function
on Z(N ).
Recall: the key was that calculation of the coefficients
on Z(2M ) could be done by calculating the coefficients of
related functions (the odd and even parts) on Z(M ):
Lemma 1.2 (The key lemma). If we are given ω2M =
e−2πi/(2M ) then
#(2M ) ≤ 2#(M ) + 8M.
Once we have the key lemma, the theorem follows imme-
diately: Proof of theorem fol-
lows from lemma by
Proof of Theorem. Let N = 2n ; we induct on n. In the case induction trivially.
n = 1 (N = 2), by definition
1 1
aN N
0 (F ) = [F (1) + F (−1)] and a1 (f ) = [F (1) − F (−1)],
2 2
which requires 5 < 8 operations; so case n = 1 is verified.
For the inductive step, we assume that the theorem is
true for N = 2n−1 ; i.e., that
#(N ) ≤ 4 · 2n−1 (n − 1).
Then, by the lemma,
#(2N ) ≤ 2 · 4 · 2n−1 (n − 1) + 8 · 2n−1 = 4 · 2n n,
as desired.
1
2 THE FAST FOURIER TRANSFORM
{(g1 , g2 ) : g1 ∈ G1 , g2 ∈ G2 }
with the group law given by
(g1 , g2 ) · (g10 , g20 ) := (g1 · g10 , g2 · g20 ),
with which the set becomes (check) itself a finite abelian
group.
Theorem 2.7 (Structure theorem for finite abelian groups).
Any finite abelian group is isomorphic to a direct product
of groups of the form Z(N ).
Example of struc-
Example. Consider Z∗ (8), the multiplicative group of ture theorem
units of Z/8Z; namely, Z∗ (8) = {1, 3, 5, 7}. Z∗ (8) can
be shown to be isomorphic to Z(2) × Z(2) via, for ex-
ample, the mapping under which {1, 3, 5, 7} correspond to
{(0, 0), (1, 0), (0, 1), (1, 1)} respectively.
3. Characters
Notation 3.1. Let S 1 denote the unit circle in C, equipped
with complex multiplication as the group law.
4 THE FAST FOURIER TRANSFORM
Useful lemma:
Lemma 3.4. Let G be a finite abelian group, and e : G →
Useful lemma: any C\{0}. If e is multiplicative, i.e.,
multiplicative, non-
vanishing map is a e(a · b) = e(a)e(b) for all a, b ∈ G,
character
then e is a character.
Proof. Notice that the function |e| is bounded both above
and below (away from 0) on G (since G is finite). If |e(g)| >
1, then |e(g n )| = |e(g)|n would go to infinity with n: im-
possible. Similarly for |e(g)| < 1. Thus e maps into S 1 and
is a character.
LECTURE 31:
FOURIER ANALYSIS ON FINITE ABELIAN GROUPS
1. Characters
Definition 1.1. Let G be a finite abelian group, and e : G → S 1 . If for all
a, b ∈ G,
e(a · b) = e(a)e(b),
(in other words, if e is a homomorphism) then we call e a character. character
Lemma 1.2. Let G b denote the set of all characters of G. If we define, for
e1 , e2 ∈ G, the product e1 · e2 by
b dual group
then G
b becomes itself an abelian group, called the dual group.
1. G
b is an ONB of V
Theorem 1.1. Let G be a finite abelian group. G b is a
(orthonormal) basis for the vector space of functions on G.
1 X
(Ta f, Ta g) := Ta f (b)Ta g(b)
|G|
b∈G
1 X
= Ta f (b)Ta g(b)
|G|
b∈G
1 X
= f (a · b)g(a · b)
|G|
b∈G
1 X
= f (b)g(b) = (f, g);
|G|
b∈G
i.e., the Ta are all unitary transformations. Further, they
commute (since G is abelian); so by the previous lemma,
The previous corol- they are simultaneously diagonalizable.
lary yields a basis (of Thus we have a basis for V of functions {vb : G → C}b∈G ,
V ) of eigenfunctions.
each of which is an eigenfunction for all of the {Ta }a∈G . We
now
Claim: For each of the {vb : G → C}b∈G , let
vb (x)
wb (x) :=
vb (u)
In fact, those where u denotes the identity element of G. Then
|G| eigenfunctions,
properly normalized,
wb is a character.
are characters; so
we have enough Remark. Why was this the obvious thing to do? Well, think
characters to form a of what a character of G must do: it must, first, preserve
basis.
the group law:
χ(a · x) = χ(a)χ(x);
second, it must preserve the identity:
χ(uG ) = uS1 = 1.
The first statement is equivalent to saying that χ must be
an eigenfunction for the family of translations Ta (for all
a ∈ G); the second forces the normalization required of w
above. Can we get such eigenfunctions? Yes, since the Ta
are unitary and commute.
G
b IS AN ORTHONORMAL BASIS 3
v(a · b)
w(a · b) :=
v(u)
Ta v(b) λa v(b) λa λb v(u)
= = =
v(u) v(u) v(u)
= λa λb = w(a)w(b),
using the fact that
v(x) Tx v(u)
w(x) := = = λx ;
v(u) v(u)
so we’re done. Thus there are in fact dim(V ) = |G| char-
acters, so they do form an ONB of V )
Once we have that the characters form an orthonormal
basis of V , our Fourier analysis of functions on G follows
as follows.
4. Background knowledge:
The Fundamental Theorem of Arithmetic
Theorem 4.1 (Euclid’s algorithm). Let a, b ∈ Z; b > 0.
Then there exists unique integers q and r, with 0 ≤ r < b The basis of long di-
such that a = qb + r. vision.
Proof. Consider
S := {a − qb : q ∈ Z; a − qb ≥ 0}.
S is non-empty; let r = min S. Of course a = qb + r and
r ≥ 0; we need to show r < b.
If r ≥ b, then r = b + s for some s ≥ 0; so Slight error in text:
need not assume s <
b + s = a − qb, r.
and thus 0 ≤ s = a − (q + 1)b < a − qb = r.
But then s ∈ S and s < r; contradiction.
Proving uniqueness: suppose that a = qb + r = q1 b + r1
with 0 ≤ r, r1 < b. Then
(q − q1 )b = r1 − r.
Since |LHS| is (nonnegative) integral multiple of b, and
|RHS| < b, |LHS| = |RHS| = 0b = 0.
LECTURE 33:
ELEMENTARY NUMBER THEORY
1. Background knowledge:
The Fundamental Theorem of Arithmetic
Theorem 1.1 (Euclid’s algorithm). Let a, b ∈ Z; b > 0.
Then there exists unique integers q and r, with 0 ≤ r < b The basis of long di-
such that a = qb + r. vision.
Proof. Consider
S := {a − qb : q ∈ Z; a − qb ≥ 0}.
S is non-empty; let r = min S. Of course a = qb + r and
r ≥ 0; we need to show r < b.
If r ≥ b, then r = b + s for some s ≥ 0; so Slight error in text:
need not assume s <
b + s = a − qb, r.
and thus 0 ≤ s = a − (q + 1)b < a − qb = r.
But then s ∈ S and s < r; contradiction.
Proving uniqueness: suppose that a = qb + r = q1 b + r1
with 0 ≤ r, r1 < b. Then
(q − q1 )b = r1 − r.
Since |LHS| is (nonnegative) integral multiple of b, and
|RHS| < b, |LHS| = |RHS| = 0b = 0.
Definitions. Let a, b ∈ Z. Elementary concepts
from number theory
i. If there exists c ∈ Z such that ac = b, then we say a
divides b (a is a divisor of b) and write a|b.
ii. A prime number is a positive integer, greater than 1,
which has no divisors besides 1 and itself.
iii. Say a, b ∈ N. The greatest common divisor gcd(a, b) of
a and b is the largest integer that divides both a and b.
iv. If gcd(a, b) = 1, we say a and b are relatively prime (i.e., they have no
1 nontrivial common
divisor)
2 ELEMENTARY NUMBER THEORY
Proof of lemma is Lemma 3.3. For |x| < 21 , | ln(1 + x)| ≤ 2|x|.
via power series ex-
pansion of ln(1 + x)
P
around 0
Proof of theorem. Since an converges, WLOG we may
1
assume |an | < 2 for all n. Then
N
Y N
Y
An := eln(1+an )
n=1 n=1
PN
ln(1+an )
=e n=1 .
PN
Here’s where By the lemma, | ln(1 + an )| ≤ 2|an |; so n=1 ln(1 + an )
we use absolute
convergence
ELEMENTARY NUMBER THEORY 5
Remark. That this series converges can be seen via the in-
tegral test: Converges because
of the integral test
∞ ∞ Z n Z ∞
X 1 X dx dx 1
s
≤ 1 + s
= 1 + s
= 1 + .
n=1
n n=2 n−1 x 1 x s − 1
The proof will involve using the Fourier series for functions
on Z∗ (q), the units (invertible elements) of Z(q).
Question. What is Z∗ (q)? a ∈ Z(q) being invertible means
of course that there exists x ∈ Z(q) such that xa ≡ 1
mod q, i.e., that gcd(a, q) = 1. In other words, Z∗ (q) is
precisely the set of (equivalence classes of) numbers rela-
tively prime to q.
minor notation: Eu-
ler phi function
Definition 2.1. Define the Euler ϕ-function by
ϕ(q) := | Z∗ (q)|.
Characteristic func-
Let δ` : Z∗ (q) → R denote the characteristic function χ{`} tions of singletons in
of the singleton ` ∈ Z∗ (q), i.e., Z∗ (q):
1 if n ≡ ` mod q
δ` (n) :=
0 otherwise.
Dumb comment: we extend δ` to all of Z(q) (and thus all Extending δ` to all of
Z - this is just a pe-
of Z) by defining it as 0 on the non-units of Z(q), i.e., riodic extension
χ{`} ([n]) if n and q are relatively prime
δ` (n) =
0 otherwise.
Definition 2.2. Let e ∈ G b be a character. We define the
Dirichlet character modulo q extending e, denoted χ = χ(e) : Extending char-
Z → C by acters to all of Z,
again periodically
e([m]) if m and q are relatively prime
χ(m) :=
0 otherwise.
We denote the extension of the trivial character of G by χ0 .
Remark. Observe that the Dirichlet characters are multi-
plicative on all of Z.
Expressing δ` in
terms of characters
Lemma 2.3.
1 X
δ` (n) := χ(`)χ(n).
ϕ(q)
χ(e) :e∈G
b
6 DIRICHLET CHARACTERS AND REDUCTION OF THEOREM
above equals
1 X χ0 (p) 1 X X χ(p)
= + χ(`)
ϕ(q) p∈℘ ps ϕ(q) p∈℘
ps
χe 6=χ0
1 X 1 1 X X χ(p)
= + χ(`) ,
ϕ(q) ps ϕ(q) p∈℘
p s
p∈℘: p-q χe 6=χ0
Snce
P all but finitely many primes do not divide q, and since
1
p∈℘ p diverges (Euler’s theorem), we see that this sum
diverges as s → 1+ .
Thus to show that the sum diverges, it suffices to show
that
1 X X χ(p)
χ(`) s
, < ∞,
ϕ(q) p∈℘
p
χe 6=χ0
is bounded as s → 1+ .
2. The strategy
The key to proving the reduced problem will be the fol-
lowing.
DIRICHLET CHARACTERS AND REDUCTION OF THEOREM 3
Proof. As before, WLOG assume |an | < 1/2 for all n. Using
the properties of the log1 , and then the exponential function
(note that we use the complex exponential function from
The proof is com- chapter 1 as well)
pletely the same; no
N Y N
point in showing it. 1
elog1 ( 1−an )
Y 1
=
n=1
1 − an n=1
PN
= e n=1 log1 ( 1−an ) .
1
P
Just like in the earlier proof, we note that since |an |
converges, and since
log1 1
≤ 2|an |,
1 − an
the sum in the exponent converges, and thus the limit ex-
ists.
LECTURE 35:
EULER’S PRODUCT FORMULA; FOURIER SERIES
FOR CHARACTERISTIC FUNCTIONS OF POINTS
What’s χ0 ? It the last because χ0 (p) is the extension of the trivial char-
will take the value
1 at numbers rela-
acter (taking 1 on all of Z∗ (q)); i.e., it indicates whether or
tively prime to q; not p ∈ ℘ is relatively prime with q, which is equilvalent to
that is, primes that saying that p does not divide q.
do not divide q.
Observe that almost
Now let’s consider the first sum,
all primes do not di- X 1
vide q
.
ps
p∈℘:p-q
Since P
all but finitely many primes do not divide q, and
since p∈℘ p1 diverges (Euler’s theorem), we see that this
sum diverges as s → 1+ .
Thus to show that the sum diverges, it suffices to show
that
1 X X χ(p)
χ(`) s
, < ∞,
ϕ(q) p∈℘
p
χe 6=χ0
is bounded as s → 1+ .
DIRICHLET CHARACTERS AND REDUCTION OF THEOREM 3
1
elog1 ( 1−z ) =
1
.
1−z
ii. If |z| < 1, then
1
log1 = z + E1 (z),
1−z
for all z. dr k
k=1
" ∞
!0 #
iθ iθ
X (reiθ )k P∞ (reiθ )k
= −e + (1 − re ) e k=1 k
k
k=1
6 DIRICHLET CHARACTERS AND REDUCTION OF THEOREM
Proof. As before, WLOG assume |an | < 1/2 for all n. Using
the properties of the log1 , and then the exponential function
(note that we use the complex exponential function from
The proof is com- chapter 1 as well)
pletely the same;
N Y N
almost no point in 1
elog1 ( 1−an )
Y 1
showing it. =
n=1
1 − an n=1
PN
= e n=1 log1 ( 1−an ) .
1
P
Just like in the earlier proof, we note that since |an |
converges, and since
log1 1
≤ 2|an |,
1 − an
the sum in the exponent converges, and thus the limit ex-
ists.
LECTURE 35: PRODUCT FORMULA FOR THE
L-FUNCTIONS
Proof. By the product formula just proven, Proof: use the prod-
X χ0 (n) Y uct formulae.
1
=
n
ns p∈℘ 1 −
χ0 (p)
s p
and by Euler’s product formula for ζ, χ0 (p) = 0 when p|q.
Y 1
ζ(s) =
p∈℘
1 − p1s
The terms that are missing are those which correspond to
the primes that divide q; i.e., p1 , . . . , pN .
2. Logarithms of L-functions
(Introduce “second reduction” as “corollary” here.) We’d like to be able
to take the log of
Proposition 2.1 (The technical proposition). Let χ be a both sides of the
above product for-
non-trivial Dirichlet character. Then mula. But we’ll need
to do a lot of work
first....
The technical propo-
sition: allowing us to
define the log of L.
Where do we need
0 < s < 1?
4 PROOF OF DIRICHLET’S THEOREM
i.
∞
X χ(n)
L(s, χ) := converges for s > 0.
n=1
ns
Obtain controls on ii. L(s, χ) is continuously differentiable in s.
the growth of L and
d iii. For some constants c, c0 > 0, we have The L(·, χ) functions
ds L
L(s, χ) = 1 + O(e−cs ) as s → ∞ make sense for 0 <
s ≤ 1 - as long as χ
d 0 is non-trivial.
L(s, χ) = O(e−c s ) as s → ∞.
ds
Lemma 2.2 (The key lemma). If χ is a non-trivial Dirich-
Simple but cru- let character modulo q, then
cial observation
k
in demonstrating
X
χ(n) ≤ q for any k.
absolute and uni-
form convergence
n=1
in s > 0
Proof. First recall that since χ is non-trivial,
Xq
χ(n) = 0.
n=1
Q. Why do they Using the Euclidean algorithm, write k = aq + b with
prove this again? 0 ≤ b < q; then
X k aq
X aq+b
X aq+b
X
χ(n) = + χ(n) = χ(n).
n=1 n=1 n=aq+1 n=aq+1
By the triangle inequality (since |χ(n)| ∈ {0, 1}) the last
Characters map into term is less than or equal to q.
S 1 ; Dirichlet charac-
ters can equal 0. 3. Proof of the technical proposition
Proof of the technical proposition. It is easy to see that the
series defining L(s, χ) converges uniformly and absolutely
d
for s > 1 as does the term-by-term derivative ds L(s, χ).
Proof of (i): To show convergence for s > 0, we rewrite the
series as follows. Let Sk denote the partial sum kn=1 χ(n)
P
We use some elemen- (and S0 := 0). Then
tary manipulation to
rewrite the series....
(Note that the book
is incorrect to say
that (p.263) one
uses summation by
parts.)
PROOF OF DIRICHLET’S THEOREM 5
N N
X χ(k) X Sk − Sk−1
=
ks ks
k=1 k=1
N N
X Sk X Sk−1
= − (since S0 = 0)
ks ks
k=1 k=2
N N −1
X Sk X Sk
= −
ks (k + 1)s
k=1 k=1
N −1
X 1 1 SN
= Sk s − +
k (k + 1)s Ns
k=1
N −1
X SN
=: fk (s) +
Ns
k=1
P ...as an absolutely
Consider: the convergence of fk (s): by the key lemma, (and uniformly) con-
verging series! Thus
1 1 the original series
|fk (s)| := Sk s − also converges abso-
k (k + 1)s lutely uniformly.
d
x−s = −sx−s−1
≤ q max
x∈[k,k+1] ds
1
= qs ;
k s+1
P
thus k fk (s) converges absolutely and uniformly for s > 0.
Differentiating the series term-by-term, we see by an ar-
gument similar to that above that the differentiated series
converges uniformly for s > 0, and thus converges to a
continuous function.
Proof of ii: Consider: for s > 1 + (say), Control of the
∞ growth is easy
X χ(n)
|L(s, χ) − 1| :=
n s
n=2
Z ∞
−s −s 2
≤ x dx = 2 ≤ 2−s O(1).
2 s−1
6 PROOF OF DIRICHLET’S THEOREM
1. Recall
Our goal is to prove the following.
N
X X
SN = F (m, n) (vertically)
m=1 1≤n≤N/m
N
X X
= F (m, n) (horizontally).
n=1 1≤m≤N/n
N X
X
= F (m, n) (i.e., along hyperbolae indexed by k)
k=1 nm=k
where
χ(n)
F (m, n) := √ ;
nm
we’ll also show that the sum grows faster than the log N .
Q. Why is it obvi- Precisely,
ous that this hyper-
bolic sum√ approxi- Proposition 3.1. Let χ be a non-trivial real Dirichlet char-
mates 2 N L(1, χ)?
Recall L(1, χ) = acter. With the above definitions,
P χ(n)
n . i. ∃ c > 0 such that SN ≥ c log N .
ii. SN = 2N 1/2 L(1, χ) + O(1).
Remark. The above proposition finishes the theorem for, if
L(1, χ) = 0 then (ii) would imply that SN = O(1), while
Thus if we prove (i) states that SN ≥ c log N ; a contradiction.
the proposition, the
proof of Dirichlet’s To prove the two parts of the proposition we will need
theorem is over!
the following two lemmas.
Analysis of the sum Lemma 3.2. Let k ∈ N. Then
of χ over divisors of
k
PROOF OF DIRICHLET’S THEOREM 3
X 0 for all k
χ(n) ≥
1 if k = `2 for some ` ∈ Z
n|k
Proof of lemma.
Case I: k = pα for some p prime. Then Simple case first: k a
X prime power.
χ(n) = χ(1) + χ(p) + χ(p2 ) + · · · + χ(pα )
n|k
X χ(n)
SN := √
nm
(m,n)∈AN
N X
X χ(n)
= √
nm
k=1 nm=k
N
X 1
X
= √ χ(n).
k=1
k n|k
N
X 1 X
SN = √ χ(n)
k=1
k n|k
X 1 X 1
≥ √ = = log N 1/2 + O(1).
k=`2 ,`≤N 1/2
k `≤N 1/2 `
X χ(n)
SN := √ .
nm
(m,n)∈AN
PROOF OF DIRICHLET’S THEOREM 5
√ √ N
I := {(n, m) ∈ N : 1 ≤ m <N, N < n ≤ }
√ √ m
II := {(n, m) ∈ N : 1 ≤ m ≤ N , 1 ≤ n ≤ N }
√ N √
III := {(n, m) ∈ N : N < m ≤ , 1 ≤ n < N }.
n
X χ(n)
SI := √
√ √ N
nm
1≤m< N , N <n≤ m
X 1 X χ(n)
= √ √
√ m √ N
n
m< N N <n≤ m
X 1 1
= 2M 1/2 + c + O √
1≤n≤M
n1/2 M
we get
1
1/4
SI = 2N + c + O 1/4
O(N −1/4 ) = O(1)
N
as N → ∞.
6 PROOF OF DIRICHLET’S THEOREM
p∈℘
!
Y 1
= χ(p)
= L(s, χ) also.
p∈℘ 1− ps
We’re not done! This only means that ...but not quite.
!
X 1
log2 L(s, χ) − log1 χ(p)
= 2πiM (s)
p∈℘ 1 − ps
PROOF OF DIRICHLET’S THEOREM 3
p∈℘
!
Y 1
= χ(p)
= L(s, χ) also.
p∈℘ 1− ps
We’re not done! This only means that ...but not quite.
!
X 1
log2 L(s, χ) − log1 χ(p)
= 2πiM (s)
p∈℘ 1 − ps
PROOF OF DIRICHLET’S THEOREM 3
1
2 PROOF OF DIRICHLET’S THEOREM
and, further, that the sum grows faster than log N . Pre-
Q. Why is it obvi- cisely:
ous that this hyper-
bolic sum√ approxi- Proposition 2.1. Let χ be a non-trivial real Dirichlet char-
mates 2 N L(1, χ)?
Recall L(1, χ) =
acter. With the above definitions,
P χ(n)
n .
i. ∃ c > 0 such that SN ≥ c log N .
ii. SN = 2N 1/2 L(1, χ) + O(1).
Remark. The above proposition finishes the theorem for, if
L(1, χ) = 0 then (ii) would imply that SN = O(1), while
Thus if we prove (i) states that SN ≥ c log N ; a contradiction.
the proposition, the
proof of Dirichlet’s To prove the two parts of the proposition we will need
theorem is over!
the following two lemmas.
Analysis of the sum ∈ N. Then
Lemma 2.2. Let k
of χ over divisors of X 0 for all k
k χ(n) ≥
1 if k = `2 for some ` ∈ Z
n|k
Proof of lemma.
Simple case first: k a Case I: k = pα for some p prime. Then
prime power. X
χ(n) = χ(1) + χ(p) + χ(p2 ) + · · · + χ(pα )
n|k
As before, the only possibility of getting a 0 out of this is The product can
if one of the αj is odd, in which case k is not a square. equal zero only
when one of the
sums is 0; by the
Lemma 2.3 (Second lemma). Let a, b ∈ N. If a < b then previous case, αj
must be odd
i. bn=a χ(n)
√ = O(a−1/2 ) and
P
n
Pb χ(n)
ii. n=a n = O(a−1 ).
By the first lemma, then, since the term in parentheses is (The pair (m, n)
such that nm = k is
determined by the
first entry.)
4 PROOF OF DIRICHLET’S THEOREM
≥ 1 when k is square,
X 1
SN ≥ √
k=`2 ,`≤N 1/2
k
X 1
= = log N 1/2 + O(1),
1/2
`
`≤N
Break the sum We separate SN into the sum SN = SI + SII + SIII , where
into various regions.
(Draw the hyperbola
the indices for the respective sums lie in the regions
correctly!) √ √ N
I := {(n, m) ∈ N : 1 ≤ m < N , N < n ≤ }
√ √ m
II := {(n, m) ∈ N : 1 ≤ m ≤ N , 1 ≤ n ≤ N }
√ N √
III := {(n, m) ∈ N : N < m ≤ , 1 ≤ n < N }.
n
Consider SI : summing vertically, we get
X χ(n)
SI := √
√ √ N
nm
1≤m< N , N <n≤ m
X 1 X χ(n)
= √ √
√ m √ N
n
m< N N <n≤ m
1
1/4
SI = 2N + c + O 1/4
O(N −1/4 ) = O(1)
N
as N → ∞.
For the other two terms, we sum horizontally. Using the
1
2 -series estimate, SII + SIII : use the
1
2 -series bound again
X χ(n) X 1
SII + SIII = 1/2
√ n N
m1/2
1≤n< N 1≤m≤
( n )
X χ(n) 1/2
N n 1/2
= 1/2
2 + c + O
√ n n N
1≤n< N
X χ(n) X χ(n)
1
X
= 2N 1/2 +c 1/2
+ O 1/2
1 ,
1/2
n 1/2
n N 1/2
1≤n≤N 1≤n≤N 1≤n≤N
∞
X χ(n)
−1/2
=O N ,
1/2
n
n=N
6 PROOF OF DIRICHLET’S THEOREM
we see that
X χ(n)
A := 2N 1/2
n
1≤n≤N 1/2
h i
1/2 −1/2
= 2N L(1, χ) − O N
= 2N 1/2 L(1, χ) + O(1).
giving the desired estimate for SN .