The Saddle Point Method: Brad Klingenberg Complex Variables
The Saddle Point Method: Brad Klingenberg Complex Variables
The Saddle Point Method: Brad Klingenberg Complex Variables
Brad Klingenberg
Complex Variables
April, 2006
Asymptotic Analysis
• Approximate the asymptotic behavior
of integrals
• Example: approximating n! for large n
• Example: integrals such as
Z ∞ Z
enϕ(x)dx and enϕ(z)dz.
−∞ C
Example: Stirling’s approximation
• Approximate n! for large n
• Use the Gamma function,
Z ∞
z−1 −t
Γ(z) = t e dt
0
Example: Stirling’s approximation
• Approximate n! for large n
• Use the Gamma function,
Z ∞
z−1 −t
Γ(z) = t e dt
0
Recall for n ∈ N,
Z ∞
n! = (nz)n e−nz dz
0
Z ∞
n+1
= ... = n exp(n [ln(z) − z])dz.
0
Example: Stirling’s approximation
• ln(z) − z < 0 for z ∈ (0, ∞)
• ln(z) − z has maximum at z = 1
−0.5 ln(z) − z
−1
−1.5
−2
−2.5
−3
0 1 2 3 4
z
Example: Stirling’s approximation
• ln(z) − z largest at z = 1
• exp(n [ln(z) − z]) largest at z = 1
• As n becomes large, the difference is
more extreme
• Expect dominant contribution from
z=1
Example: Stirling’s approximation
1
n=1
0.8 n=5
n = 75
0.6
0.4
0.2
0
0 1 2 3 4 5
with s = z − 1.
Example: Stirling’s approximation
The approximation to the integrand is
very accurate!
−9
x 10 n( ln(z) − z )
2.5
2
n( −1 − (z−1) /2 )
2
1.5
0.5
0
0 0.5 1 1.5 2
z
Approximate as n → ∞.
What have we learned from the example?
Generalization: Laplace’s Method
Stirling’s approximation provides a strategy:
• Find the point x0 where ϕ(x) attains its maximum
• Expand enϕ(x) in a neighborhood of x0
• Argue
Z x0 +ǫ Z
nϕ(x) nϕ(x)
e dx ≈ e dx
x0 −ǫ R
Z s
b
nϕ(x) nϕ(x0 ) 2π
e dx ≈ e
a n|ϕ′′(x0)|
If x0 is an endpoint, then
Z b r
π
enϕ(x)dx ≈ enϕ(x0)
a 2n|ϕ′′(x0)|
Example 6.2.15
Consider
n
X n
I(n) = k!n−k
k
k=0
Notice
Z ∞ Z ∞
−nx k −k−1 −t k
e x dx = n e t dt
0 0
−1−k −k−1
= Γ(k − 1)n = k!n
where t = nx.
Example 6.2.15
n Z ∞
X n
I(n) = n e−nx xk dx
k 0
k=0
Z ∞ n !
−nx
X n k
= e n x dx
0 k
k=0
Z ∞
−nx n
= e n(1 + x) dx
0
Z ∞
= n exp(n [ln(1 + x) − x])dx
0
| {z }
ϕ(x)
Example 6.2.15
Then ϕ(x) = ln(1 + x) − x,
′ 1
ϕ (x) = −1
1+x
such that x0 = 0 (an endpoint).
ϕ(0) = ln(1) − 0 = 0
′′
−1
|ϕ (0)| = = | − 1| = 1.
(1 + 0)2
Example 6.2.15
So using Laplace’s method,
n
X n
−k
I(n) = k!n
k
k=0
r
nϕ(x0 ) π
≈ ne
2n|ϕ′′(x0)|
r r
π nπ
= n =
2n 2
Extending to the complex plane
Now consider
Z Z
enϕ(z)dz = enReϕ(z)eniImϕ(z)dz
C C
∇v = (∂v/∂x, ∂v/∂y)
= (−∂u/∂y, ∂u/∂x)
(∂u/∂x, ∂u/∂y) = ∇u
- the steepest descent in u!
Example
Consider the asymptotics of
Z
1 1 −z t
= t e dt
Γ(z) 2πi C
Example
Z
1 1 −z t
= t e dt
Γ(z) 2πi C
Z
1
= exp(t − z ln(t))dt
2πi C
Z
1
= z
exp(z [s − ln(s)])ds
2πiz C | {z }
ϕ(s)
where t = sz.
Example
• Note that
′ 1
ϕ (s) = 1 −
s
such that ϕ′(1) = 0.
• If we deform C to pass through z = 1
and hold Imϕ(z) constant then the
dominant contribution will be around
z = 1.
Example
Close-up of Reg(z).
Example
• Vary ϕ(z) only in the imaginary
direction
• Let z = 1 + iv, then
where
α π α 3π
θ=− + , − +
2 2 2 2
is the direction of steepest descent, and
′′ ′′ iα
ϕ (z0 ) = |ϕ (z0 )|e .
Conclusions
Laplace’s method is
• General
• Accurate
• Intuitive
• Extended to the complex plane