BA3202-L1 Bayesian
BA3202-L1 Bayesian
Actuarial Statistics
Actuarial Statistics
Course opening
Instructor:
Wenjun Zhu, PhD, FSA, CERA
Assistant Professor
Email: wjzhu@ntu.edu.sg
Office: S3-B1B-71
Tel: (65)6592-1859
BA3202
L1
Actuarial Statistics
• All course material posting on NTULearn
• KEY READING:
• Lecture slides for each week will be uploaded on NTULearn
BA3202
L1
Course assessment
Actuarial Statistics
Components Marks
Coursework: Participation) 10
Total 100
BA3202
L1
Tutorial presentations
Actuarial Statistics
• Group presentation (10 marks)
• Timing: 30 - 45 min
• Material for presentation
• A simple case study, applying previous lecture
concepts/knowledge/methodologies/formulae into real economic/actuarial
scenarios.
Actuarial Statistics
• Catch up with material that’s left behind after each lecture
• Do practice questions after each lecture
• Let me know WHENEVER you have any trouble with my
teaching (speaking too fast/slow, slides or notes not clear
BA3202
L1
Expectations of me
Actuarial Statistics
• You are welcome of expressing any of your expectations of me
in terms of:
• Style of class
• Length of the seminars
BA3202
L1
BA3202
Actuarial Statistics
Actuarial Statistics
Lecture 1:
- Decision Theory
- Bayesian Statistics
BA3202
L1
Objectives
Actuarial Statistics
• Decision theory
1. Define the 2 player zero sum games.
2. Determine optimum strategies under the theory of games.
3. Explain what is meant by a decision function and a risk function.
L1
BA3202
Game Theory
Actuarial Statistics
• Zero-sum two-person games
• A game is said to be zero-sum when there are two
players in conflict and whenever one player loses,
the other player wins.
• The net change in benefit/wealth is zero
BA3202
L1
Game Theory
Actuarial Statistics
• Represent the game with Loss Matrix
• Player A’s options: I, II, III ...
• Player B’s options: 1, 2, 3 etc.
• L(I, 1), L(II, 1), L(I, 2) and L(II, 2) are the values of the loss function
12
BA3202
L1
Domination
Actuarial Statistics
• Strategy I dominates II if Player A (LOSSES)
• I is at least as good as II I II III IV
• I is better in some cases 1 2 0 < 1 4
Player B
2 1 2 < 2 3
Actuarial Statistics
• Each player chooses strategy that has the Player A (LOSSES)
lowest “maximum-loss” I II III
• Player A’s maximum losses:
1 6 2 2
• I: 6; II:3; III: 5 Player B
2 4 3 5
• 3 is the lowest of all (GAINS)
3 -3 1 0
Actuarial Statistics
• Alternative strategy: minimize the “maximum expected loss”
• Example: determine the optimum strategy for Player A
• No saddle point
• 𝑝: Probability of strategy I for player A Player A
L1 L2
BA3202
L1
Statistical games
Actuarial Statistics
• Purpose of all statistical inference:
• learn more about the population
• Process: study a collected sample
• 2 person game: player A is the Statistician; player B is the
Nature.
Actuarial Statistics
• A coin either has 1 head or 1 tail (Normal) or 2 heads (Biased).
• The statistician cannot inspect the coin, but can make a
decision based on one single sample toss.
• 2×2 matrix of available strategy
• 𝜃! : coin is two-headed (i.e., biased, denoted as B)
BA3202
L1
Example (Cont’d)
Actuarial Statistics
• If the statistician makes the wrong decision, there is a penalty
of $1.
Statistician
𝑎! 𝑎"
Statistician
𝑎! 𝑎"
𝜃! 0 1
Nature
𝜃" 1 0 18
BA3202
L1
Example (Cont’d)
Actuarial Statistics
0, ℎ𝑒𝑎𝑑
• Sample random variable : 𝑥 = %
1, 𝑡𝑎𝑖𝑙
• 𝑥 is what the statistician observes based on one sample toss
• 𝑑# (𝑥): decision functions based on observation of 𝑥
19
BA3202
L1
Example (Cont’d)
Actuarial Statistics
• 𝑅(𝑑# , 𝜃$ ): expected loss under 𝜃$ nature using decision function 𝑑#
𝑅 𝑑# , 𝜃$ = 𝐸(𝐿(𝑑# 𝑥 , 𝜃$ ))
where 𝐿(𝑑# 𝑥 , 𝜃$ ) is the loss function under decision function 𝑑# and
the nature is 𝜃$ .
Actuarial Statistics
• Write into an expected payoff Statistician
matrix: 𝑑! 𝑑" 𝑑% 𝑑$
• 𝑑! dominates 𝑑" 𝜃! 0 0 1 1
• 𝑑# dominates 𝑑$ Nature
𝜃" 0.5 1 0 0.5
• Reduce to a new 2×2 payoff matrix
BA3202
L1
Example (Cont’d)
Actuarial Statistics
• Minimax Criterion
• Under the minimax criterion, the optimal strategy is 𝑑!
• Bayes criterion:
• Bayes risk: 𝐸[𝑅(𝑑, 𝜣)]
𝜃! 0 1
Nature 22
𝜃" 0.5 0
BA3202
L1
Bayesian Statistics
L1
BA3202
Intro
Actuarial Statistics
• In classical statistics the parameter values (𝜃, or 𝛼, or 𝜆…any
notations) are considered to be fixed but unknown
• In Bayesian statistics the parameter values (𝜃, or 𝛼, or 𝜆…any
notations) are considered to be random numbers
Bayes Theorem:
If 𝐵! , 𝐵" , … , 𝐵% constitute a partition of a sample space 𝑆 and 𝑃 𝐵# ≠
0 for 𝑖 = 1, 2, … , 𝑘, then for any event 𝐴 in 𝑆 such that 𝑃 𝐴 ≠ 0,
𝑃 𝐴 𝐵& 𝑃 𝐵&
𝑃 𝐵& 𝐴 =
𝑃 𝐴
where 𝑃 𝐴 = ∑%#'! 𝑃 𝐴 𝐵# 𝑃 𝐵# for 𝑖 = 1, 2, … , 𝑘.
24
• We use this theorem to find 𝑃 𝐵 𝐴 if we know 𝑃(𝐴|𝐵)
BA3202
L1
Bayes Theorem
Actuarial Statistics
Example:
3 manufacturers supply clothing to a retailer.
• 60% stock comes from manufacturer 1, 30% from manufacturer 2
and 10% from manufacturer 3.
• 10% of the clothing from manufacturer 1 is faulty, 5% from
Solution:
• Let 𝐴 be the event that a garment is faulty. Let 𝐵# be the event that
the garment comes from manufacturer 𝑖.
) *! ∩, ) ,|*! ) *!
• 𝑃 𝐵( 𝐴 = = =
) , ) ,|*" ) *" .) ,|*# ) *# .) ,|*! ) *!
/.!1∗/.!
= 0.167 25
/.!∗/.3././1∗/.(./.!1∗/.!
BA3202
L1
Prior/Posterior distributions
Actuarial Statistics
Suppose we have a random variable 𝑋 with known pdf 𝑓(𝑥|𝜃)
• Study target: 𝜃, unknown parameter that needs to be estimated
• Prior distribution of 𝜃: assume 𝜃 is known to have a pdf of 𝑓 𝜃
• The prior distribution comes from some other information known
about 𝜃 before drawing any sample from the population
• In the previous clothing example, the proportion of different
BA3202
L1
Example
Actuarial Statistics
If 𝑋~𝐸𝑥𝑝 𝜆 where 𝜆 is the unknown parameter that needs to be
estimated, and 𝑥! , 𝑥" , … , 𝑥4 is a random sample from 𝑋. Suppose
the prior distribution of 𝜆 is 𝐸𝑥𝑝 𝛼 , where 𝛼 is a known parameter.
Find the posterior distribution 𝑓 𝜆 𝑥 of 𝜆.
Solution:
• 𝑓 𝜆 = 𝛼𝑒 89: is the prior pdf of 𝜆
#'!
∑&
• Hence, 𝑓 𝜆 𝑥 ∝ 𝑓 𝑥 𝜆 𝑓 𝜆 = 𝛼𝜆4 𝑒 8 $%" ;$ .9 :
BA3202
L1
Prior/Posterior distributions
Actuarial Statistics
• Step 1:
• Write down prior pdf of the unknown parameter 𝜃: 𝑓 𝜃
• Write down the conditional pdf of 𝑋: 𝑓 𝑥 𝜃 (i.e., the likelihood)
• Step 2:
BA3202
L1
Special cases
Actuarial Statistics
• Conjugate priors
• When the posterior and the prior distribution belong to the same
“general” family of distributions, this prior distribution is called
the conjugate prior.
• Conjugate distributions can be found by selecting a family of
BA3202
L1
The loss function
Actuarial Statistics
• Objective: To obtain the estimator of 𝜃
• Definitions:
• 𝑔 𝑥 : the estimator of 𝜃
BA3202
L1
Common loss functions
Actuarial Statistics
#
• Quadratic loss: 𝐿 𝑔 𝑥 , 𝜃 = 𝑔 𝑥 − 𝜃
• Bayesian estimator: 𝑔 = 𝐸(𝜃|𝑋), mean of posterior
31
BA3202
L1
Quadratic loss function
Actuarial Statistics
• Bayesian estimator of quadratic loss function is the posterior
mean, 𝑔 = 𝐸(𝜃|𝑋).
• Scratch of proof:
"
• 𝐿 𝑔 𝑥 ,𝜃 = 𝑔 𝑥 − 𝜃
Actuarial Statistics
• Bayesian estimator under the absolute loss function is the median of the posterior.
• Scratch of proof:
• 𝐿 𝑔 𝑥 ,𝜃 = 𝑔 𝑥 − 𝜃
• 𝐸𝑃𝐿 = ∫ 𝐿 𝑔 𝑥 , 𝜃 𝑓 𝜃 𝑥 𝑑𝜃 = ∫ 𝑔 𝑥 − 𝜃 𝑓 𝜃 𝑥 𝑑𝜃
# "
= 9 (𝑔 − 𝜃)𝑓 𝜃 𝑥 𝑑𝜃 + 9 𝜃 − 𝑔 𝑓 𝜃 𝑥 𝑑𝜃
!" #
• First order condition: take partial differentiation w.r.t. 𝑔
Actuarial Statistics
• Bayesian estimator under the All-or-nothing loss function is the
mode of the posterior.
• Scratch of proof:
0, 𝑖𝑓𝑔 𝑥 = 𝜃
• 𝐿 𝑔 𝑥 ,𝜃 = ?
1, 𝑖𝑓𝑔 𝑥 ≠ 𝜃
𝐸𝑃𝐿 = ∫ 𝐿 𝑔 𝑥 , 𝜃 𝑓 𝜃 𝑥 𝑑𝜃
FHG
= 1 − ∫F+G 𝑓 𝜃 𝑥)𝑑𝜃 = 1 − 2𝜀𝑓(𝑔|𝑥) for small 𝜀
• EPL is minimized when 𝑓(𝑔|𝑥) is maximized 34
• Hence, 𝑔 𝑥 is the posterior mode.
BA3202
L1
L1
Actuarial Statistics
BA3202