03 KPI Definition
03 KPI Definition
03 KPI Definition
Chapter 3
KPI Definition
Page 1
WCDMA RF Optimization: KPI Definition
Contents
Page 3
WCDMA RF Optimization: KPI Definition
Introduction
With the development of the third generation wireless communication, WCDMA is coming
into the commercial phase in Europe, North America, Asia and Africa. Nowadays, dozens
of large-scale WCDMA networks are being operated in the world. Thousands of WCDMA
Node Bs have been deployed and installed. SO the WCDMA become the most widely
accepted standard of the third generation wireless communication in the world. As the
central issues for network operation, administration, maintenance, supervising of the
network performance and optimization should be comprehensive and scientific measured
and evaluated under a set of performance indicators.
As result in response to this demands Key Performance Indicators (KPI) are introduced
as a significant assessing criteria for network performance of wireless communication.
In order to specify and quantify the network performance and QoS for services, the TMF
(Tele Management Forum) introduce the KQI ((key Quality Indicator) / KPI (Key
Performance Indicator) architecture.
KPIs are defined through the definition and measurement of key parameters of input and
output of internal network system and/or maintenance & operation progress of enterprise.
The purpose of this document is to specify the RAN KPI definition as well as KPIs
classification.
Page 4
WCDMA RF Optimization: KPI Definition
To be able to fully utilize the resources and to focus on the service provision rather than
trouble shooting, advanced analysis methods to for optimization process are required.
The high level description of the optimization cycle is depicted in the Figure below.
Page 5
WCDMA RF Optimization: KPI Definition
The process starts with the quality definition. The thresholds are then set for each related
key performance indicator (KPI). It is important to note that when setting the KPI targets,
the operator provides the tools for capacity-quality trade-off management.
Network performance data can be gathered from Network Management Systems (NMS),
drive tests, protocol analyzers and/or customer complaints. Network reporting tools
provide statistical and pre-analyzed information about the quality.
Based on the network configuration and status of the network, quality in detail is analyzed
and individual corrections are done iteratively by solving the individual parameters
affecting the reported quality. Finally, in addition to tuning single parameters, the general
solution has to be found.
Page 6
WCDMA RF Optimization: KPI Definition
After the corrections have been implemented to the network, the quality cycle starts from
the beginning.
The selection of the data for performance analysis consists of two aspects. Firstly the
data is selected based on functional area (accessibility, reliability, traffic performance and
distributions), to mention a few examples. All these functional areas are targeted to offer
a picture of the end user perceived quality.
For getting an overall performance evaluation of the network the selection of the counters
and other performance indicators is different from those one would choose for
optimization or trouble shooting cases.
The optimization case is more focused and thus more problem specific indicators are
required. In addition, uplink and downlink are often analyzed separately. After the
optimization has been performed and the changes implemented in the network, it is
essential to check the function of the optimization target, but equally important it is to
derive the overall performance distribution and compare it to the pre-optimization case.
This is done to avoid the phenomenon, that optimization improves one subset of a
functional area, but drastically decreases the performance of some of the others.
The counters are triggered for each specific object according to well defined rules.
Page 7
WCDMA RF Optimization: KPI Definition
The gauge counters are in fact internal variables which value is constantly updated
by events or measurements. A typical example is the counter for the number of
active connections: it is constantly incremented by one for each new connection
establishment and decreased by one for each connection release. At the end of
Page 8
WCDMA RF Optimization: KPI Definition
the ROP the gauge counter will contain the number of the active connection as a
final account of the situation.
Page 9
WCDMA RF Optimization: KPI Definition
Number of Events:
Simple events:
Rates
Page 10
WCDMA RF Optimization: KPI Definition
Cell availability.
Call Setup Success Rate CSSR.
Packet session setup success rate (NRT, HSDPA, and HSUPA).
Call Drop rate.
SHO / ISHO / HSPA serving cell change success rate.
Blocking rate (for RRC 0.5%, RT RAB 1%, and NRT RAB 0.1%, and PS session
5%).
Call drop rate (for RT RAB 0.5%, NRT RAB 2%).
Handover success rate (for SHO 95%, for ISHO 80%).
The network performances affected by many factors and network elements among them:
Quality of network equipment, both hardware and software (BTS, RNC, PS and
CS core, transmission equipment).
Page 11
WCDMA RF Optimization: KPI Definition
Page 12
WCDMA RF Optimization: KPI Definition
2. KPI Classification
The Radio Access Network (RAN) Key Performance Indicators (KPIs) can be divided into
following classes, according to the IUT standard.
Retain-ability (Drop): The probability that a service, once obtained, will continue
to be provided under given conditions for a given time duration.
The main Key Performances indicators related to retainability class are the
following:
Mobility: user capability to move through the network during the service utilization. The
main Key Performances indicators related to mobility class are the following:
Figure: UE Mobility
Page 14
WCDMA RF Optimization: KPI Definition
The main Key Performances indicators related to integrity class are the following:
Availability: capability to keep network nodes working during the time. The
availability KPIs counts Cell Availability from network point of view. The main Key
Performances indicators related to availability class are the following:
Page 15
WCDMA RF Optimization: KPI Definition
Usage: Average number of used resources (radio links, RF power, codes …). The
main Key Performances indicators related to usage class are the following:
CS Equivalent Erlang
Average UL load.
Average DL load.
PS UL Throughput
PS DL Throughput
UL Traffic of Typical Radio Bearers
DL Traffic of Typical Radio Bearers
HSDPA Mean UE Number
HSUPA Mean UE Number
Page 16
WCDMA RF Optimization: KPI Definition
The accessibility KPI is the ability of a user to obtain the requested service from the
system.
RRC connection and RAB setup are the main procedures of accessibility. These items
can be calculated per cell and per RNC, and the RNC level KPI is calculated by
aggregating all the cell counters that belong to the RNC.
RAB setup
After the successful authentication and security procedures, the UE sends a call
control setup message to the MSC. The MSC verifies that the UE is authorized for the
requested services. If yes, the MSC starts a process to set up a bearer for the user
data (speech in this case). This is achieved by the MSC by sending an RAB
assignment request to the RNC. The MSC includes the RAB ID and the QoS
parameters to be set up. The RNC, on receiving this message, checks the resources
and sets up a bearer at Iu.
The actual bearers are set up by using the ALCAP in the Network Transport Layer.
The ALCAP procedures are not shown in the figure. The RNC in turn sets up a radio
bearer between the RNC and the UE by sending a radio bearer setup message. This
message contains the information on bearer allocation such as radio bearer identifier.
The UE responds with the radio bearer setup complete message. The RNC then
sends an RAB assignment response to the MSC. With this procedure successfully
executed, there exists a bearer to transport used data from the UE to the MSC.
Page 17
WCDMA RF Optimization: KPI Definition
The RAB establishment success rate KPI describes the ratio of all successful RAB
(Radio Access Radio) establishments to RAB establishment attempts for UTRAN network
and is used to evaluate service accessibility across UTRAN.
This KPI is obtained by the number of all successful RAB establishments divided by the
total number of attempted RAB establishments.
Page 18
WCDMA RF Optimization: KPI Definition
Note: The RAB Establishment Success Rate Typical values > 99.6 %.
The following Figure illustrates the interaction within UTRAN to establish an RRC
connection between the UE and the RNC. The process to set up a call begins with the
UE sending an RRC connection request over a CCCH (which is a RACH in the uplink
direction). This message contains several information elements, including IMSI or
TMSI, LAI, RAI, and the reason for requesting the RRC connection.
Page 19
WCDMA RF Optimization: KPI Definition
The RRC connection establishment success rate KPI describes the ratio of all
successful RRC establishments to RRC establishment attempts for UTRAN network, and
is used to evaluate UTRAN and RNC or cell admission capacity for UE and/or system
load.
This KPI is obtained by the number of all successful RRC establishments divided by the
total number of attempted RRC establishments.
Page 20
WCDMA RF Optimization: KPI Definition
The Call Setup Success Rate KPI was typically calculated by considering just 2 steps in
Call Establishment: RRC Connection Setup and RAB Establishment.
They are assumed to be independent processes, and therefore CSSR was hence
calculated as product of the Success Rates of each of these 2 phases.
Page 21
WCDMA RF Optimization: KPI Definition
The following figure illustrates the definition of call setup success rate definition (RRC
Setup success rate * RAB Setup success rate).
The Call Setup Success Rate PS (CSSR PS) is defined as the ratio of successful call
setups, divided by the total number of call setup attempts for packet calls. It is the
probability of successfully initiating a packet connection from an end user perspective and
includes the PDP context activation and bearer setup for the R99 service.
Page 22
WCDMA RF Optimization: KPI Definition
CSSR PS measured by Drive tests, presents the proportion of packet interactive calls
which are successfully setup by the initiating party.
This KPI can be used to evaluate the RAB setup success ratio of the PS service carried by HSDPA.
This KPI can be used to evaluate the RAB setup success ratio of the HSUPA service.
Page 23
WCDMA RF Optimization: KPI Definition
2.2. Retainability
Retainability is defined as the ability of a user to retain its requested service for the desired
duration once connected. These items can be calculated per cell and per RNC. The RNC
level KPIs can be calculated by aggregating all the cell counters and Iur counters.
The RAB abnormal release rate KPI describes the ratio of number of RAB release
requests to number of the successful RAB establishments. This KPI reflects service
retainability across UTRAN.
This KPI is obtained by the number of RAB release requests divided by the number of
successful RAB establishments.
Page 24
WCDMA RF Optimization: KPI Definition
This KPI can be used to evaluate the call drop ratio of the CS service in one RNC. The
call drop occurs due to RNC abnormal release trigged by RAB RELEASE REQUEST or
IU RELEASE REQUEST messages.
The Drop Call Rate Speech (DCR Speech) is defined as the ratio of abnormal call
disconnections, divided by the total number of successful call setups for speech calls. It
is the probability of successfully holding and terminating a call once it has been
successfully initiated.
DCR Speech measured by Drive tests, presents the proportion of speech calls which are
successfully released after a specified holding time from when the call was successfully
setup.
Calculated with Counter Statistics, DCR Speech is the ratio of abnormally released calls
divided by the sum of the abnormally and normal released Speech RABs within a cell or
RNC.
Page 25
WCDMA RF Optimization: KPI Definition
The following figure illustrates the different types of drop (soft and hard drop).
Lack of coverage.
Interference.
SHO failure.
Missing neighbor.
Relocation failure.
Page 26
WCDMA RF Optimization: KPI Definition
The Drop Call Rate PS (DCR PS) is defined as the ratio of abnormal call
disconnections, divided by the total number of successful call setups for packet
connections. It is the probability of successfully holding and then terminating a
packet connection from an end user perspective.
Calculated with Counter Statistics, DCR PS is the ratio of abnormally released calls
divided by the sum of the abnormally released and normal released for Packet
RABs within a cell or RNC.
Page 27
WCDMA RF Optimization: KPI Definition
Note:
PS call drop rate usually higher than CS one due to higher RSCP
requirements and lower SHO overhead
The Drop Call Rate PS HSDPA (DCR PS HSDPA) is defined as the ratio of
abnormal call disconnections, divided by the total number of successful call setups
for packet connections using a HSDPA radio bearer. It is the probability of
successfully holding and then terminating a R99 packet connection from an end
user perspective.
Page 28
WCDMA RF Optimization: KPI Definition
DCR PS HSDPA measured by Drive tests, presents the proportion of HSDPA radio
bearers which are held and normally released by the initiating party.
Note:
This KPI can be used to evaluate the call drop ratio of the PS service carried by HSUPA
in one cell. The call drop occurs due to RNC abnormal release trigged by RAB RELEASE
REQUEST or Iu RELEASE REQUEST messages.
Page 29
WCDMA RF Optimization: KPI Definition
2.3. Mobility
The following Figure illustrates the interaction within UTRAN to update the Active Set List
during the Soft Handover process. The process begins with the UE sending an RRC
Measurement Report to the SRNC. This message contains several information, such as
the trigger events (Event 1A/1B/1C).
The Soft Handover Success Rate KPI describes the ratio of number of successful radio
link additions to the total number of radio link addition attempts.
This KPI is obtained by the number of successful radio link additions divided by the total
number of radio link addition attempts.
Page 30
WCDMA RF Optimization: KPI Definition
Note:
Typical target for SHO success rate 95%.
CS more robust against low coverage & quality at cell edge than PS.
Page 31
WCDMA RF Optimization: KPI Definition
The Softer Handover Success Rate KPI can be used to evaluate the softer handover
success ratio in one RNC.
The following Figure illustrates the interaction within UTRAN during the Inter-Radio
Access technology process. The process begins with the UE sending an RRC
Measurement Report to the SRNC (Event 1F).
After that the User Equipment put into compressed mode, measuring the neighbor’s cells
Rxlev (RSSI) and sending measurement report to the SRNC. The SRNC verifies the cell
BSIC. If all conditions are fulfilled the SRNC triggers the relocation procedure.
Page 32
WCDMA RF Optimization: KPI Definition
The Inter Radio Access Technology Handover Success Rate for Speech (IRAT
Speech) is defined as the ratio of successful handovers to GSM over the number
of attempted handovers to GSM. It is the probability of successfully performing a
handover from WCDMA to GSM and continuing the call without end user
interruption.
IRAT Speech Handovers can be measured either by Drive tests or Statistics data
although due to difficulties in drive test collection, Statistics is recommended. In
the case of a drive test, a normal drive within the coverage area may not have
sufficient number of samples where IRAT handover is performed and it is
recommended that a separate drive route along the borders of the coverage be
covered.
Page 33
WCDMA RF Optimization: KPI Definition
Note:
Typical target for IRAT success rate 90%/for RT and 80% for NRT.
CS more robust against low coverage & quality at cell edge than PS.
This KPI can be used to evaluate the intra-frequency hard handover success ratio in one
RNC.
Page 34
WCDMA RF Optimization: KPI Definition
This KPI can be used to evaluate the inter-frequency hard handover success ratio in one
RNC.
2.4. Integrity
The most accurate method to measure User Throughput R99 is by Drive tests. The
download file size divided by the time to complete the download and then taken as
the indicator of user throughput. For high target throughput values, static tests are
preferred.
Page 35
WCDMA RF Optimization: KPI Definition
Calculated with Counter Statistics, User Throughput R99 is a ratio of the sampled
RLC throughput measurements (including user data but excluding
retransmissions, padding bits, data PDU headers and RLC control PDU's) in
kbits/s divided by the number of times data was transmitted in the cell.
The most accurate method to measure User Throughput HSDPA is by Drive tests.
The download file size divided by the time to complete the download and taken as
the indicator of user throughput. For high target throughput values, static tests are
preferred.
Page 36
WCDMA RF Optimization: KPI Definition
2.5. Availability
This KPI can be used to evaluate the consumption of PCCH bandwidth on busy hour
within Iu interface.
Page 37
WCDMA RF Optimization: KPI Definition
This KPI can be used to evaluate the admission refused ratio of radio network at busy
hour in a cell.
This KPI can be used to evaluate the utility ratio of radio network resources at busy hour
in one RNC.
2.6. Usage
This grouped KPIs can be used to evaluate the average DL traffic of the HSDPA service
at busy hour in one cell.
Page 38
WCDMA RF Optimization: KPI Definition
This KPI can be used to evaluate the average UL traffic of the HSUPA service at busy
hour in one cell.
This grouped KPIs can be used to evaluate the average UL traffic of typical radio bearers
at busy hour in one RNC, which means the traffics from different services are different
although they are in the same unit.
This grouped KPIs can be used to evaluate the average DL traffic of typical radio bearers
at busy hour in one RNC, which means the traffics from different services are different
although they are in the same unit.
Page 39