5G NR Optimization Overview

Module Objective
After completing this learning element, the participant should be able to:

Discuss Pre- and Post-Launch Optimization Steps

Define Performance Management Architecture Part 1
Explain Performance Management Architecture Part 2
Name Counters Definition and Structure
Recall Key Performance Indicators KPI
Express Logging and Reporting Suite Examples
Repeat Quiz/Exercise
Index

Pre- and Post-Launch Optimization Steps

Performance Management Architecture Part 1
Performance Management Architecture Part 2
Counters Definition and Structure
Key Performance Indicators KPI
Logging and Reporting Suite Examples
Quiz/Exercise
Index

Pre- and Post-Launch Optimization Steps

Performance Management Architecture Part 1
Performance Management Architecture Part 2
Counters Definition and Structure
Key Performance Indicators KPI
Logging and Reporting Suite Examples
Quiz/Exercise
Pre- and Post-Launch Optimization Steps
Introduction
• Radio Network Optimization ensures the quality of the network in terms of performance
• Performance is quantified using Key Performance Indicators (KPIs) agreed with customers
• KPIs can be based on network statistics (OSS KPIs) or drive testing (field KPIs)
• The usage of one or the other (or both) will depend on the metrics to be improved and project
characteristics

Field tests KPIs OSS KPIs

The end-user experience is directly measured Difficult to combine counters to show end-user experience

Tests are only done at certain locations during certain times Covers all the users all the time

Performance in very specific locations can be measured Performance is typically averaged over a cell

The performance of a specific UE is measured Average performance of all UEs

Can be done even before network is launched Certain traffic level required to have statistical validity
Pre- and Post-Launch Optimization Steps
KPIs Sets

• Key Performance Indicators are grouped in sets according to different areas that may require optimization
• Following areas are covered within this training portfolio:
• Accessibility: Ability of the network to provide a connection when requested by the user
• Retainability: Ability of the network to maintain a connection during the expected service time
• Usage: Throughput and network usage (traffic volumes, users, attempts)
• Integrity: Latencies
• Mobility: Related to handover and cell change procedures
Pre- and Post-Launch Optimization Steps
Pre-launch Optimization
• Done before the ‘launch’ of the network
• Low network traffic due to lack/little users
• Optimization relies mainly in field KPIs
• Optimization focuses in verifying the RF design and identify coverage and quality problems
• Optimization usually done in groups (clusters) and overall network acceptance is passed after the cluster
acceptance tests are passed
Pre- and Post-Launch Optimization Steps
Post-launch Optimization Overview

• Network carries user’s

traffic
• OSS KPIs are
statistically relevant and
provide information on
different levels
(network, site, cell)
• Optimization is not
necessarily limited to a
certain area (e.g.
cluster)
Pre- and Post-Launch Optimization Steps
Post-launch Optimization Activities

After the initial general performance check to set the baseline, the optimization steps are:
• Configuration and parameter analysis to verify that the network is implemented as planned, with the
desired features, that there is consistency in the parameter settings
• Performance assessment looks at OSS statistics to investigate the important aspects like accessibility,
retainability, usage and integrity
• RF Analysis and mobility optimization is based on network and drive test data to make improvement
proposals for the antenna configurations
• End-user throughput and latency performance normally investigated as dedicated items and specific
optimization methodologies apply
• Root Cause Analysis to find solutions for unresolved issues left in previous.
• Finally, system changes are proposed and implemented. These changes can include parameter
changes, feature activations, HW expansions or others
Pre- and Post-Launch Optimization Steps
Post-launch Optimization Steps 1a, 1b and 1c

1b. Analysis of cell level parameters (i.e. 1c. Check if planned parameters are
1a. Analysis of network level parameters implemented on the network
those different across the cells)
• Verification that the planned
Network level parameters do not /intended parameters are
change across cells • Validate the PCI plan implemented by comparing a
• Validate the RSI plan network raml xml file or SCF if a
• Compare planned parameters few sites with planned ones
against recommended values from • Validate the Neighbor plan for 4G-
Product Line or Global NPO 5G and 5G-5G neighbors • Tools: LTEPAT or an xml parser
• Understand deviations and their • Possible tools: MUSA, EdenNET ,
impact in performance should be 9955, 5G inspector
understood
Pre- and Post-Launch Optimization Steps
Post-launch Optimization Steps 2 and 3

2. Performance Assessment
• High level idea of the network performance by checking the most important KPIs agreed with customer
• Check sites are on air and with no alarms
• Use either drive or OSS KPIs. If using drive testing procedure is similar to pre-launch optimization except for the need for a detailed
analysis. Enough to drive a single cluster to get a rough idea of the performance

3. RF and mobility Optimization

• Maximizing coverage and dominance areas making physical antenna changes (e.g. tilts, azimuths)
Pre- and Post-Launch Optimization Steps
Post-launch optimization Step 4

4. End-user performance optimization

• Mainly involves optimization through parameterization and feature usage. The aim of this step is to:
• Maximize the end-user performance by changing parameter values
• Optimize the antenna beam patterns also using parameterization
Index

Pre- and Post-Launch Optimization Steps

Performance Management Architecture Part 1
Performance Management Architecture Part 2
Counters Definition and Structure
Key Performance Indicators KPI
Logging and Reporting Suite Examples
Quiz/Exercise
Performance Management Architecture Part 1
Overview
High-level performance
KPIs reporting
End-user • Main performance metrics providing information of the different
• Based on counters and
KPIs
perception performance areas • Information provided is
Performance • KPIs are based on counters closer to the user
Reports perception
• Basis for wide network
optimization
Counters
• Describe individual values that can be collected into
measurements
gNB • Counters are incremented for example when certain event
measurements occurs
• Each counter belongs only to one measurement type
Low-level performance
reporting
• Based on gNB traces
• Provide detailed info on
the system behavior
• Used for troubleshooting
Procedures of specific cases
Observations

System
characteristics
Performance Management Architecture Part 1
Overview

• PM counters are measurements categorized in groups related to a similar function

• Each group is a measurement type
• Measurement types are administrative units for activating/deactivating the counters as a set
• Different measurement types can be activated per gNB
• Measurements can be identified either by:
• Measurement ID (e.g. M55316) or
• Measurement name (e.g. NR Carrier Aggregation Distributed Unit (gNB-DU) or
• Measurement abbreviation (e.g. NCADU)
• Each Measurement ID has a uniquely associated name and abbreviation
Performance Management Architecture Part 1
5G NR Measurement Types (1/2)

M513xx: Common transport plane M557xx: Radio Cloud Platform

measurements load measurements
• Not specific to 5G Counters related to:
• Usage (CPU, Memory, Disk…)

M551xx: Control plane

measurements
M556xx: O&M measurements
Counters related to:
Counters related to:
• Interfaces (S1, F1AP, X2-C)
• Modules (SMOD, BBMOD,
• Admission Control (Central RMOD)
and Distributed Unit)
• Cell availability
• Bearers (EPS, Radio)
• UE State
Performance Management Architecture Part 1
5G NR Measurement Types (2/2)

M40xxx Miscellaneous M553xx: User plane

counters M559xx: Measurements for
measurements (*)
spare counters
• These are counters which Counters related to:
are not specific for 5G but • allows a quick
also used for other RATs introduction of new • Interfaces ( X2-U, F1-U)
counters in the BTS • Procedures (DL/UL
software HARQ, RACH Usage…)
• Layers (MAC, PDCP..)

M558xx: Other measurements

• NR GNSS

All counters available for Classical and Cloud BTS except M557xx: Radio Cloud Platform only available in the Cloud BTS
(*) User plane measurements are the largest group of measurements followed by the control plane ones
Index

Pre- and Post-Launch Optimization Steps

Performance Management Architecture Part 1
Performance Management Architecture Part 2
Counters Definition and Structure
Key Performance Indicators KPI
Logging and Reporting Suite Examples
Quiz/Exercise
Performance Management Architecture Part 2
Measurement Interval
• Measurement interval or granularity period (GP) is the length of the interval during which data is
collected for the counters in a measurement
• Each measurement type can have a different measurement interval
• Measurement intervals are aligned within the hour at 00:00h and repeated periodically
• Supported measurement intervals: 0 (disabled), 5, 15, 30, 60 min or 6, 12, 24 hours. Default 15
minutes
Performance Management Architecture Part 2
Reporting Interval
• Reporting interval is the time interval at which the PM data is reported/sent from gNB to the
NMS (NetAct)
• A gNB can have only one reporting interval and it is configured at NRBTS level
• Like the measurement interval, it is aligned with the hour at 00:00h
• Supported reporting intervals: 5, 15, 30, 60 min. Default 60 min
Performance Management Architecture Part 2
Counter Collection Process
• Counters are collected in the CU and in the DU of the gNB using PM providers
• After being collected, they are forwarded to the PM collector in the central unit
• Upon reporting interval
timer expiration, gNB CU
merges all files containing
counters, compress them
and sends them to NMS
(NetAct)

Timer: PMCADM/reportingIntervalPm
default 1h
Index

Pre- and Post-Launch Optimization Steps

Performance Management Architecture Part 1
Performance Management Architecture Part 2
Counters Definition and Structure
Key Performance Indicators KPI
Logging and Reporting Suite Examples
Quiz/Exercise
Counters Definition and Structure
Measurement Groups
• PM Counters are measurements categorized in groups related to a similar area or function
• Each of those groups are the measurement types
Counters Definition and Structure
Counter Naming Convention

Final Counter ID Counters ID can be divided into two parts:

• Measurement ID
- First part of counter represent
M55312C00001 Measurement ID and starts with letter ‘M’
– Every counter can be simply connected
to proper measurement
Measurement ID Counter Number • Counter Number
in measurement - Second part of counter stands for Counter
Number and starts with letter ‘C’ – This is
How to read counter ID (above): Index for every counter
• It is User Plane counter (M553xx)
• It’s ID within M55312 measurement is C00001
Counters Definition and Structure
Radio measurement target levels (1/2)
• Counters have different collection levels
• All counters in a measurement group have
the same managed object class (MOC) or
target level for collection
• Example object levels:
• NRBTS: New Radio Base Station
• NRCELL: New Radio Cell
• NRDU: New Radio Distributed Unit.
Similar to LNBTS level in LTE
• NRCUUP: New Radio CU-UP
• MNLENT: Management Layer Entity
• MRBTS/EQM: Equipment
Counters Definition and Structure
Radio measurement target levels (2/2)

• There is no NRCELLGRP (sector) level for

PM counters collection
• For postprocessing purposes, it can be
derived by aggregating the counters on
the NRCELLs under each NRCELLGRP
Counters Definition and Structure
Counter Aggregation
• Counters can be aggregated to objects that are ‘above’
MRBTS
them in the MOC hierarchy
• Example: NRCELL counters an be aggregated to NRBTS
NRBTS, cluster (multiple NRBSs) or PLMN level
NRCELL

• Depending on the counter the aggregation can be sum, NRCELLGRP

average…etc.
NRPMRNL

• Counters have also their own aggregation level. NRSCTP

• Raw counters can have e.g. 15 minutes aggregation NRDU

level giving the possibility of further aggregating
LTEENB
them to 30 min, 1h, 6 h…
NRCUUP
Index

Pre- and Post-Launch Optimization Steps

Performance Management Architecture Part 1
Performance Management Architecture Part 2
Counters Definition and Structure
Key Performance Indicators KPI
Logging and Reporting Suite Examples
Quiz/Exercise
Key Performance Indicators KPI
Overview
• KPIs reflect the quality of a network by measuring the network performance, including trends
in the performance.
• KPIs are logical formulas based on counters:

• KPIs are uniquely identified by:

• KPI ID (e.g. NR_5010a)
• KPI Name (e.g. 5G Contention free RACH setup attempts)
Key Performance Indicators KPI
Naming Convention

Overall KPI ID
Official KPIs ID can be divided in to three parts:
• Prefix
• Prefix is saying that KPI belongs to 5G (to

•
differentiate among other technologies)
KPI Number NR_5010a
- Number is uniquely identifying certain KPI among
other
- KPI Version Version
constant prefix
- Third part of KPI ID allows to maintain versions (e.g.
when KPI formula is changed from release to release)
KPI number
Key Performance Indicators KPI
Use Cases (1/2)
• 5G network usage Examples:
• 5G RACH
• Cell & BTS Throughput • Numbers of users
• User Throughput • Data Volume
• Latency • Number of access attempts
• Capacity
• Cell availability • Packet delays within gNB
• NSA/SA accessibility • PDCP SDU discards
• NSA/SA retainability
• VoNR • Admission control
• High priority calls • PRACH utilization
• Radio link quality • PDSCH/PUSCH utilization
• Beamforming • CCE load
• Mobility NSA/SA • Co-scheduled UEs
• Packet discards and losses • CPU load (gNB-CU)
• 5G carrier aggregation
• Specific profile performance • Histograms of beam usage for preambles, PDSCH, PUSCH
• Interface performance (S1, NG, X2, Xn, F1, E1, front-haul) • RSRP difference between best and second-best beam
• BTS energy consumption
• UE capabilities
Key Performance Indicators KPI
Use Cases (1/2)
• 5G network usage Examples:
• 5G RACH
• Cell & BTS Throughput
• User Throughput
• Latency
• Capacity
• Cell availability
• NSA/SA accessibility
• NSA/SA retainability
• VoNR • UL & DL MCS distribution
• High priority calls • UL & DL HARQ success ratio
• Radio link quality • DL CQI histogram
• Beamforming • PUSCH SINR, RSSI, Rx signal power
• Mobility NSA/SA • PUCCH SINR
• Packet discards and losses • RLC PDU retransmissions / discards
• 5G carrier aggregation • Radio link failures
• Specific profile performance • Beam recovery failures
• Interface performance (S1, NG, X2, Xn, F1, E1, front-haul)
• BTS energy consumption
• UE capabilities
Key Performance Indicators KPI
Relevant 3GPP Specifications

• TS28.550: Performance assurance. Describes the performance management framework in general terms. Also, some
requirements on file formats etc.

• TS28.552: 5G performance measurements. Describes the required counters in the 5G RAN as well as in the 5G core
network elements (AMF / SMF / UPF / PCF / UDM)

• TS28.554: 5G end to end Key Performance Indicators. Uses the counters described in TS28.552 to build KPI formulas

• TS32.425: E-UTRAN Performance Measurements For NSA option 3, the legacy RRC measurements described on it
also apply for EN-DC connections

• TR38.913: Study on scenarios and requirements for next generation access technologies. Technical Report. It contains
requirements for the 5G RAN
Key Performance Indicators KPI
Nokia Internal

• NIDD: Nokia Integrated Data Dictionary: Repository for counters for all network elements and preliminary
information for coming releases.

• JUMP or NOPS (Network Operations Portal): All Nokia official KPI definitions for most network elements.

• Specific training (NetEng) Performance Management Framework

• NPO 5G Radio Wiki: Counters and KPIs section: Links to relevant counters/KPI material including how to export
information from NIDD, JUMP for a specific 5G release

• Performance Benchmarker 2.0: KPI database for all RAN technologies containing values from real customer
networks.
Key Performance Indicators KPI
Nokia Internal

• NetEng MIND Parameter database

• NetEng WebNEI material and product trainings: Describe Nokia products providing the background information to
understand how counters are triggered

• 5G performance hub contains information on 5G parameters, optimization and feature assessments

• NPO 5G wiki pages information hub for 5G containing NPO guidelines, performance reports for NPO teams and
collection of links for other material (counters, parameters, KPIs…)
Key Performance Indicators KPI
Operating Documentation: Monitoring and Troubleshooting
Related documents
available through
Discovery Center
Key Performance Indicators KPI
Network Logging
• Emil: Signalling procedures from the BTS perspective.

• Wireshark: Captures X2 and S1 control plane and user plane content.

• gNBMACTTI (TTI trace): Captures L1 information at the BTS

• LTEPAT: processes BTS Snapshot data including counters and parameter configuration. It also allows the parameter
comparison between 2 gNBs.

• L1 GUI Tool: The tool provides information on uplink signal quality and other relevant information to help debugging
the uplink performance.

• Tools section within the 5G Radio Wiki

• 9955 RNP planning tool that can be used also to validate the PCI plan and the neighbor plan

• Radar tool for radio assessments report (e.g. HW assessment, parameter consistency checks…)
Index

Pre- and Post-Launch Optimization Steps

Performance Management Architecture Part 1
Performance Management Architecture Part 2
Counters Definition and Structure
Key Performance Indicators KPI
Logging and Reporting Suite Examples
Quiz/Exercise
Logging and Reporting Suite Examples
Introduction
Reporting Suite Nokia Radio 5G is designed to provide information for Service & Network Planning, Service Creation, Service &
Network Monitoring and Business Management.
Connecting
people
Performance KPIs are used by different operational areas for:
• Network Dimensioning and Optimization
• Troubleshooting
• Traffic Trend analysis for Long term planning
• Network Performance
• Service Usage
Connecting
things

Pre-defined reports are available off-the-shelf and are grouped in various 5G reporting categories, offering
1000+ KPIs and around 46 pre-defined reports.

Reporting Suite Nokia 5G runs on top of Nokia Assurance Center (NAC).

Logging and Reporting Suite Examples
Reports Overview (1/2)

System Program Mobility

• 5G000 - System Program • 5G005 - Mobility
• 5G001 - System program (NRCEL level) • 5G024 - LTE side mobility at gNB
• 5G036 - Mobility per NR cell relation
Accessibility • 5G032 - IRAT HO to E-UTRAN per target cell
• 5G002 - Accessibility • 5G034 - Mobility in RAN sharing
• 5G021 - Accessibility at NRBTS level
• 5G012 - UE context setup at DU level
• 5G027 - Xn setup Integrity
• 5G011 - X2 setup at NRBTS level • 5G006 - Packet integrity
• 5G018 – F1 Interface setup • 5G007 - Packet delay
• 5G022 - E1 interface setup • 5G008 - Signal level
• 5G019 - Modulation and coding scheme
Retainability
• 5G003 - Retainability
• 5G033 - Retainability at NRBTS level
• 5G013 - UE context retainability at DU level
Logging and Reporting Suite Examples
Reports Overview (2/2)
Usage
• 5G004 - Data volume Sleeping Cells
• 5G015 - Data volume - NRCEL level • 5G228 - Sleeping cell detection
• 5G009 - Throughput • 5G046 - Sleeping cell recovery algorithm
• 5G016 - F1-U throughput
• 5G037 - NG-U throughput
• 5G029 - S1-U throughput
• 5G020 - X2-U throughput
• 5G014 - Resource utilization
• 5G042 – Carrier Aggregation
• 5G010 - Users
• 5G017 - Timing advance
• 5G026 - Beamforming
• 5G039 - EIRP
• 5G025 - RAN Sharing
• 5G048 – Resource utilization per PLMN
• 5G035 - Slice performance
• 5G040 – VoNR
• 5G041 – VoNR (NRCEL)
• 5G043 – Capacity
• 5G044 – Capacity (NRCEL)
• 5G045 – Network performance per PMQAP profile
• 5G047 – RAN Intelligent Controller
• 5G049 - MIMO
Logging and Reporting Suite Examples
Pre-defined Reports – System Program
System Program provides a general view of the network status. With these reports the user has a high-level overview of the network
performance and can easily spot any performance degradation. These reports should be used to benchmark the network.

These reports include Nokia 5G most important

KPIs, such as:
• Cell availability
• RACH setup
• RRC setup
• SgNB addition/reconfiguration
• UE releases
• SgNB releases
• SA / NSA handover
• BLER
• Packet delay
• CQI
• SINR / RSSI
• VoNR
• Data volume and throughput
• Number of NEs
Logging and Reporting Suite Examples
Pre-defined Reports – Example Accessibility
Accessibility subset provides detailed analysis and root failure causes for problems when trying to access the network or service.
These reports should be used to understand why connections are not being established.

These reports include metrics for monitoring accessibility related procedures:

• SgNB addition/reconfiguration • X2, F1, E1 setup

• RACH setup • PDU session setup and modification
• RRC setup • AMF selection
• Radio bearer setup • Paging
• UE context setup/modification
Index

Pre- and Post-Launch Optimization Steps

Performance Management Architecture Part 1
Performance Management Architecture Part 2
Counters Definition and Structure
Key Performance Indicators KPI
Logging and Reporting Suite Examples