Radar Based Nowcasting
Radar Based Nowcasting
Radar Based Nowcasting
What is Nowcasting?
Area-Based Nowcasting
AI-Based Nowcasting
What is Nowcasting?
Definition of Nowcasting
What is Nowcasting?
• K. A. Browning (father of nowcasting)
- “Nowcasting is defined strictly as a detailed description of
the current weather together with forecasts obtained
by extrapolation up to 2 hours ahead.”
(Proceedings of the 2nd international Symposium on Nowcasting, 1986) 1982.10.1
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Classification of Weather Forecasts by Lead Time
Type Lead-Time
Medium Forecasts within a periods from 3 days to 10 days (+7days: twice a day, +8~10 days: once a day)
• 1month forecasts: Weekly outlook for 2nd to 5th week (4 weeks) after the release date (every Thursday)
Long
• 3month forecasts: Monthly outlook for three months from the release month (every month)
• Seasonal Outlook
Climate - Temperature, Rainfall, and El Nino (or La Nina) outlook for Spring, Summer, Autumn, and Winter
Outlook - Summer/ Autumn / Winter / Spring Climate Outlook (Release date : 2.23/5.23/8.23/11.23)
• Annual Outlook : Temperature and Rainfall (every 23rd December )
Concept of Radar-Based Precipitation Nowcasting
In 1953, Ligda first proposed the concept of Nowcasting by extrapolation of radar echo
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Classification of Radar-Based Nowcasting
Centroid Tracking method: Cell-based method
: Identifying individual storm in 3D, providing motion vector
and physical properties
(e.g. Bjerkass and Forsyth 1979; Rosenfeld 1987;
Dixon and Wiener 1993; Johnson et al. 1998;
Handwerker 2002, Han et al. 2009, Jung and Lee. 2015).
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Radar-Based Nowcasting Model
구분 약어 ( 명칭 ) 출처
TITAN (Thunderstorm Identification Tracking Analysis and Nowcasting) Dixon and Wiener (1993)
MAPLE (McGill Algorithm for Precipitation nowcasting by Lagrangian Ex- Germann and Zawadzki (2002)
Area trapolation) Laroche and Zawadzki (1994)
Tracker
Optical flow in GANDOLF (Generating Advanced Nowcasts for Deployment Bowler et al.(2004)
in Operational Land-based Flood Forecasts) system
CASA (Collaborative Adaptive Sensing of the Atmosphere radar network) Ruzanski et al.(2011)
(e.g. Bjerkass and Forsyth 1979; Rosenfeld 1987; Dixon and Wiener 1993;
Johnson et al. 1998; Handwerker 2002, Han et al. 2009, Jung and Lee. 2015).
t1 t2
• Well-Known algorithm :
Fuzzy logic Algorithm for Storm Tracking (FAST, Jung and Lee. 2015)
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Well-Known Algorithm : TITAN
https://github.com/NCAR/lrose-titan
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Tracking algorithm of TITAN [1]
TITAN (Thunderstorm Identification, Tracking, Analysis, and Nowcasting)
• Proposed by Dixon and Wiener (1993)
• const function consisting of cube root of the geometric distance and volume difference
Cij sij vij Sij ( xi x j ) 2 ( yi y j ) 2 vij 3 | vi v j |
• The combination of the two storms with the slowest movement speed (s) and the small-
est volume change (v) according to time change is tracked with the same storm.
• Generate an optimal Storm trace using the Hungarian method
cost function Final tracking of storm
time t2
t1 t2
ID #1 #2 #3
Cell #1 -- Cell #1
#1 10 23 21 Sum=32 Cell #2 -- Cell #3
t1
#2 7 23 9
Cell #3 -- Cell #2
#3 9 13 12
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Tracking algorithm of TITAN [1]
TITAN (Thunderstorm Identification, Tracking, Analysis, and Nowcasting)
• Proposed by Dixon and Wiener (1993)
• const function consisting of cube root of the geometric distance and volume difference
Cij sij vij Sij ( xi x j ) 2 ( yi y j ) 2 vij 3 | vi v j |
• The combination of the two storms with the slowest movement speed (s) and the small-
est volume change (v) according to time change is tracked with the same storm.
• Generate an optimal Storm trace using the Hungarian method
cost function Final tracking of storm
time t2
t1 t2
ID #1 #2 #3 #4
Cell #1 -- Cell #4
#1 10 23 21 11 Sum=29 Cell #2 -- Cell #3
t1
#2 7 23 9 8
Cell #3 -- Cell #1
#3 9 13 12 14
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
SCAN algorithm (SCIT)
SCIT (Storm Cell Identification and Tracking)
• Proposed by Johnson et al.(1998) from National Severe Storm Laboratory
• Single-radar based algorithm in polar-coordinate system Cartesian coordinate (x, y, x)
• Multiple reflectivity threshold (30, 35, 40, 45, 50, 55, 60dBZ) storm cell identification
• Tracking of a convective cell using the overlap area and distance between the predicted
convective cell and the observed cells in the next time
subjective determination of initial speed and direction of cells
• Providing various hail information within individual convective cell
: POSH(Probability of Severe Hail), SHI (Severe Hail Index)
MESH(Maximum Expected Size of Hail)
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Machine learning algorithm for Storm Tracking
FAST (Fuzzy logic Algorithm for Storm Tracking)
• consisting of three membership functions(MFs) and weights (Ws)
• MFs and Ws are objectively determined based on storm statistics
Speed (SPD)
MVtot
MV W
W
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Development of FAST [1]
Radar data
• Training data set : 2,326 reference storm tracks (2009~2011)
• Validation data set : 2,456 reference storm track (2012)
0920~1110UTC 13 Jun 2010 1820~2030UTC 13 Aug 2010
Parameters Values
Horizontal dimensions 721 x 721 (180km)
(range)
Vertical dimensions (range) 40 (up to 20km)
Horizontal resolution 0.5km
Vertical resolution 0.5km
Base height 0.5km
Storm Identification
• three-dimensional grouping of consecutive grid points greater 35dBZ (> 50km 3)
Element Segment Component Storm3D Storm2D
A grid point (x, y, z) Group of consecutive Group of consecutive
Group of consecutive Projected Storm3D
above reflectivity
Elements along x-axis onto x-y surface
threshold (e.g. Segments along y- Components along z-
35dBZ) axis on each x-y axis of 3D CAPPI
Storm is represented
plane of 3D CAPPI filter out small storm
by best-fit ellipse
using volume thresh-
old (e.g. 50km3)
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Development of FAST [2]
Determination of Membership functions and Weights
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Development of FAST [3] – Feature parameters
Speed(SPD)
: Distance difference between the two-dimensional centroids of current and past
convective cells | ( xtn xtm t ) 2 ( ytn ytm t ) 2 |
SPD t
mn
t
Area Change Ratio (ACR)
: The ratio of area change between two storms to the two-dimensional average area
of current and past storms
| Apresent Apast | Apast = Apresent , ARC = 0
ACR Range : 0 to 2
avg ( Apresent , Apast ) Apast >> Apresent , ARC 2
: The ratio of change in major and minor axis to the average major and minor axis of
current and past convective cells
Rpast = Rpresent , ATR = 0
major
| R present R past
major
| min or
| R present R past
min or
|
ATR 0.5 0.5 Rpast >> Rpresent , ATR 2
major major min or min or
avg ( R present ,R past ) avg ( R present ,R past )
Rpast << Rpresent , ATR 2
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Development of FAST [4] – NFD
Normalized Frequency Distribution for feature parameters
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Development of FAST [5] – Weights
Calculation of Membership functions
Normalized frequency distribution
Fmatched ( ACRi )
Fmismatched (ACR i )
Fmatched ( ACRi )
MFmatched ( ACRi )
Fmis matched ( ACRi ) Fmatched ( ACRi )
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Development of FAST [6] – Membership function
Determination of Membership functions
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Development of FAST [7] – Weights
Determination of weights
A1 A2 A3
1 3 1
Wi /
Ai i 1 Ai
H F
• Probability Of Detection : POD= FAR=
False Alarm Rate : H+F
H+M
H
• Critical Success Index : CSI=
H+M+F
Reference track
YES NO
H F
YES
Track by (hit) (false alarm)
FAST M C
NO
(miss) (correct rejection)
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Performance evaluation of FAST [2]
Sensitivity to MVthreshold
0.89
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Performance evaluation of FAST [3]
Comparison to other machine learning techniques
• Training set : 25 cases, validation set : 5 cases
• k-fold cross-validation (100 times repeats)
: Linear discrimination analysis(LDA), Quadratic discrimination analysis(QDA),
Support Vector machine (SVM), Logistic regression (LR), Decision Tree (DT)
• Performance evaluation
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Comparison to TITAN [1]
TITAN FAST
TITAN (16.7m/s) Fuzzy (16.7m/s) TITAN (25.0m/s) Fuzzy (25.0m/s)
1.0
0.97
0.93 0.95
0.92
0.90 0.89 0.89
0.8 0.82
0.71
0.6
Scores
0.60
0.54
0.49
0.4
0.2
0.050.050.090.06
0.0
POD FAR CSI ETS
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Comparison to TITAN [2]
Sensitivity to limitation of storm speed
FAST
TITAN
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Comparison to TITAN [3]
Performance evaluation according to cases
# of convective cells
# of convective cells
0.91 0.91
CSI (threshold = 0.4)
0.69
100 100
0.70 0.70
50 50
0.65 0.65 0 0
1 3 5 7 9 11 13 15 17 19 21 23 25 1 3 5 7 9 11 13 15 17 19 21 23 25
Case ID Case ID
CSI TITAN FAST
CSI ≤ 0.80 16% (04/25) 00% (00/25)
0.80 < CSI ≤ 0.85 28% (07/25) 24% (06/25)
0.85 < CSI ≤ 0.90 20% (05/25) 20% (05/25)
0.90 < CSI 36% (09/25) 56% (14/25)
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Comparison to TITAN [4]
Sensitivity to number of storms
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Example of FAST
0335KST ~ 0435KST 20th July 2020 1305KST ~ 1430KST 8th August 2020
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Reference papers
TITAN FAST
SCIT
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Area-Based Radar Nowcasting
- SWIRLS, MAPLE, and MOTION -
Area-Based Tracking Method
Area-based method : cross-correlation method
: Calculate the motion vector by spatial correlation of two consecutive images in time
(Rinehart and Garvey, 1978)
• Providing motion vectors for all grid points within the region of interest
• Does not identify individual storms does not providing physical information of individual cells
(e.g., Bellon and Austin 1978; Rinehart and Garvey 1978; Austin and Bellon 1982;
Tuttle and Foote 1990; Klingle-Wilson et al. 1993; Li et al. 1995; Lai 1999;
Germann and Zawadzki 2002; Li et al. 2004).
• Well-known algirithms
Tracking Radar Echoes by Correlation (TREC) (Rinehart and Garvey 1978)
SWIRLS(HKO), ROVER (HKO), MOTION(KMA)
Variational Echo Tracking (VET) : Laroche and Zawadzki (1994, 1995)
MAPLE (EC, KMA)
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Tracking algorithm of SWIRLS : TREC
TREC(Tracking of Radar Echoes by Correlation)
: Calculate the motion vector by spatial correlation of two consecutive images in time
(Rinehart and Garvey, 1978)
Searching radius
Searching radius
T + 0min T – 6min
1
Z (k ) Z
1 2
N k
Z1 (k )k Z 2 (k )
(k ) -
R k
2 2
Z1 (k ) - N Z1 Z 2 (k ) - N Z 2
2 2
k k
Courtesy of Dr. Ping-Wha Li from HKO
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Motion vector of TREC in SWIRLS
Typhoon Maria on 31st August 2000 Typhoon Imbudo on 24th July 2003
(Motion vector on CAPPI at 3km height) (Motion vector on CAPPI at 3km height)
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
https://docs.com-swirls.org/swirlspy.html
https://rsmc.hko.gov.hk/nowcast/downloadSWIRLS.html
MAPLE
= McGill Algorithm for Precipitation
nowcasting by Lagrangian Extrapolation
Germann and Zawadzki, MWR 2002
Germann and Zawadzki, JAM 2004
Turner, Zawadzki, and Germann, JAM 2004
Germann, Zawadzki, and Turner, JAS 2006
Other similar methods by: Alan Seed, Marc Berenguer, and others
R3D
Semi-Lagrangian
backward scheme
QPF
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
MAPLE algorithm in KMA [2]
VET (Variational Echo Tracking) Forecast Products
0~6h
t-2 t-1 t
∆𝑡 ∆𝑡
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Calculation of motion vector [1]
Variational Echo Tracking (VET)
• Determination of motion vector that minimizes the cost function over radar echo field in a variational
approach using consecutive three radar data in time
: Cost function
: Reflectivity constraint
: Smoothness penalty
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Extrapolation: Semi-Lagrangian backward scheme
Advection schemes
• CVF (constant vector forward advection)
- Fixed motion vector straight movement
(rotation x)
- Numerical diffusion occurs d
ar
• CVB (constant vector backward advection) o rw
f
- Fixed motion vector straight movement
(rotation x) d
ar
ckw
• SLF (semi-lagrangian forward advection) ba
- Synoptic-scale rotational movement OK
- Echo diffusion occurs artificial echo void area
OBS FCST
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Example of MAPLE forecasts [2]
OBS FCST
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Performance evaluation of MAPLE [1]
Evaluation
• Data set : MAPLE 10 min., 60min accumulated rainfall
• Methodology : Comparison of forecasted radar rainfall field to radar observational fields
(threshold : 0.1mm/h)
- Skill score: POD, FAR, BIAS, CSI
• Cases : May to October 2018 (51days)
Rainfall Field
Forecast Period
(10 minutes interval)
Rainfall Field
(1 hour accumulation) …
∆𝑡 ∆𝑡 𝒎𝒎
+𝟏𝟎+𝟐𝟎+𝟑𝟎 𝒎
+𝟒𝟎+𝟓𝟎 +𝟏 𝒉𝒓
𝒎 𝒎
+𝟐
𝒉𝒓
… +𝟔
𝒉𝒓
+𝟏 𝒉𝒓 +𝟐 𝒉𝒓 … +𝟔 𝒉𝒓
Verification Period
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Performance evaluation of MAPLE [2]
2x2 Contingency table
Forecasts
Yes No
Yes H (Hit) M (Miss)
Observation
No F (False Alarm) C (Correctional reject)
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Performance evaluation of MAPLE [3]
Performance evaluation of MAPLE [4]
• Critical Success Index (CSI)
0 +1h +2h +3h +4h +5h +6h
10 min. 1.000 0.558 0.450 0.380 0.327 0.283 0.246
1 hour 1.000 0.628 0.505 0.427 0.368 0.319 0.278
- [STEP #1] Derivation of motion vector for different spatial scale using modified TREC technique
- [STEP #2] Synthesis of multiple-motion vector for forecasting lead-time using variation approach
- [STEP #3] Extrapolation of echo with multiple-motion vector based on Semi-Lagrangian backward
scheme + growth and decay map of precipitation
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Development of new technique (MOTION) [3]
Calculation of multi-motion vector
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Development of new technique (MOTION) [4]
Spatial correction of motion vector by variational approach
59
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Development of new technique (MOTION) [5]
60
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Development of new technique (MOTION) [7]
Growth and decay map of rainfall intensity
• [STEP 1] Tracking of past radar echo by semi-lagrangian backward scheme at every grid points
• [STEP 2] Convert rainfall intensity to radar reflectivity factor (mm/h → dBZ → Z (mm-6m-3))
• [STEP 4] Calculate the change of averaged reflectivity factor within 10 min time window
• [STEP 5] Produce growth and decay map using the temporal change at each grids
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Development of new technique (MOTION) [8]
Centroid of
Centroid of
meso-cyclone
meso-cyclone
(variable)
(fixed)
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Blending with NWP model
Forecasting performance
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Blending with NWP model (Hongkong) [1]
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Blending with NWP model (KMA)
w(t) =
(α=3.0, β=6.0)
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
AI-Based Radar Nowcasting
Background [1]
spatial properties
New model
influence-based
weights
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Background [2]
Abroad Google
U-Net CNN(2019) + SegNet(2016) = RainNet(2019) (DeepMind)
DGMR(based on cGAN)(2021)
ConvLSTM(2019)
KISTI
Korea RainNet(2020)
NIMR
Modified U-Net CNN (based on ConvLSTM) (2021)
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Background [3]
MAPLE KLAPS
growth decay
BLEND OBS
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Development of AI-technique
Set-up for forecast area and lead-time set-up radar nowcasting model
Deep learning
(optimization of parameters)
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Machine Learning of AI-based Nowcasting
No. grids 256 X 256 Input data -1hour (7 snapshot, 10min. interval)
min min
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Conv-ConvLSTM vs DGMR (DeepMind)
Institute DeepMind & Met Office (UK) Weather Radar Center, KMA
Max. Forecasting
90 minutes 60 minutes
time
Training set Radar data of Met-Office from 2016 to 2018 Radar data of KMA from 2016 to 2018
Validation set Radar data of Met-Office for 2019 Radar data of KMA for 20120
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Preliminary results [2]
①
②
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Preliminary results [2]
A: ConvLSTM
B: ConvGRU
C: TrajGRU
D: Conv-ConvLSTM
Weather Radar Center 2021 Radar Training Course for Foreign Specialist
Thank you for your attention