Presented to:
•
•
•
LTE
•
•
Codec SIP
RTP/RTCP TCP/IP
Codec RTP/RTCP TCP/IP
SIP
Voice Quality/MOS (POLQA) SIP protocol based analysis : setup related performance RTP/RTCP protocol based analysis : throughput, jitter, delay, packet loss, etc.
KPI reports – drop, setup failure, etc. LTE Metrics, RRC/NAS protocol messages in parallel
XCAL-Mobile
XCAL-Solo
XCAL-MPm
XCAL-S+
XCAL-M
Handheld
Yes
Yes
No
No
No
Voice MOS (POLQA)
DL/UL
DL/UL
DL/UL
DL/UL
No
SIP Analysis
Yes
Yes
Yes
Yes
Yes
RTP/RTCP Analysis
Yes
Yes
Yes
Yes
Yes
RRC/NAS/LTE PHY
Yes
Yes
Yes
Yes
Yes
User Interface
Phone GUI
Phone GUI
PC
PC
PC
XCAL-M License Required
No
No
Yes
Yes
Yes
Number of Phone
1
1
4
2 (two S+ required)
4
•
VoLTE ready
•
Smartphone based measurement solution
•
Runs on Android (Galaxy S2,3,4, HTC One XL, etc.)
•
Supports GSM/ GPRS/EDGE/ WCDMA/ HSDPA/ HSUPA/ HSPA+/DC-HSDPA/LTE and WiFi
•
Auto call feature for VoLTE, Youtube, iPerf, etc.
•
Indoor measurement
•
•
•
•
VoLTE ready Smartphone provides user interface A micro PC with CPU, OS, phone driver installed, SD memory, Sound card, Bluetooth and WiFi with Battery. XCAL-Solo software on the device interfaces with Smartphone to take LTE, VoLTE traces
•
VoLTE ready
•
Connected to PC with XCAL-M installed
•
•
•
•
4 UE interface with 4 sound cards embedded -> 4 simultaneous MOS (POLQA) measurement configurable External power supply required to XCAL-MPm hardware Existing XCAL-M license can be used as it is with no additional upgrade cost
Call control through Bluetooth available
•
•
•
•
•
VoLTE ready Connected to PC with XCAL-M installed
One UE interface with one sound card embedded Two XCAL-S+ can be connected to one XCAL-M license -> two MOS (POLQA) measurement configurable Existing XCAL-M license can be used as it is with no additional upgrade cost
USB to Phone & Audio Jack
•
VoLTE ready
•
RTP/SIP full analysis available
•
Suitable for typical VoLTE performance measurement where no voice MOS (POLQA) is required
•
Four VoLTE calls can be traced at the same time
•
Call control through ADB interface
: The number of lost packets.
•
•
•
•
Throughput : Interval between received RTP packets : Average Trend of dynamic change of Delay of RTP Packet : Jitter on Packet Delay
•
•
: Time Delay from Sender part to Receiver Part
: Total Packet count received.
•
: Round Trip Time of sender
•
packet •
•
: An Audio Quality based on VoIP (VoLTE) Packet. : Conversion Value of R-Factor on General PESQ MOS Mapping Table.
• •
•
POLQA is ITU-T.863 recommended voice MOS algorithm Calculates voice objective MOS values by comparing received audio waves with the reference waves
•
EUTRAN /IMS
•
•
Sends audio samples Calculates downlink MOS and other POLQA measurements
Sends audio samples Calculates downlink MOS and other POLQA measurements
Ethernet
•
•
•
Compatible with IMS Sends audio samples Calculates uplink MOS and other POLQA measurements
VoLTE Call Flow & Event Definition
VoLTE Call Flow VoLTE Call Event Definition SIP Status Code VoLTE Event – RTP Drop
UE(MO)
EUTRAN / IMS
Idle start Setup start Call start
UE(MT) Idle start
Dialing Start INVITE Service request Rrc Connection Reqeust Rrc Connection setup Rrc connection setup complete Security Mode Command Security Mode Complete Rrc connection reconfiguration Rrc connection reconfig. comp
UE(MO)
EUTRAN / IMS
UE(MT)
Service request Rrc Connection Reqeust Rrc Connection setup Rrc connection setup complete Security Mode Command Security Mode Complete Rrc Connection reconfiguration Rrc Connection reconfig. comp
Setup start Send Pick up
UE(MO)
EUTRAN / IMS
UE(MT)
Pick Up
Rrc Connection reconfig. Dedicated bearer context req(QCI1)
Rrc Connection reconfig. Dedicated bearer context req(QCI1)
Rrc Connection reconfig. Comp. Dedicated bearer context accept Ulinformation Transfer
Rrc Connection reconfig. Comp. Dedicated bearer context accept Ulinformation Transfer
RTP(Voice or Video)
Traffic start
UE(MO)
EUTRAN / IMS
UE(MT) Pick Up
Rrc Connection reconfig. Dedicated bearer context req(QCI1)
Rrc Connection reconfig. Dedicated bearer context req(QCI1)
Rrc Connection reconfig. Comp. Dedicated bearer context accept Ulinformation Transfer
Rrc Connection reconfig. Comp. Dedicated bearer context accept Ulinformation Transfer
RTP(Voice or Video)
Traffic start
1
Idle
No ‘Rx INVITE’ from MT
Dial error 2
Error
Setup No Traffic
3
Setup fail – timeout
4
Call Drop
5
RTP Drop – BYE
6
RTP Drop
–
Time out
• •
MO : When Request URI of Tx INVITE is different from MIN MT : When Tx INVITE exists after Rx INVITE
MO : no Tx INVITE even though SEND was sent MT : no Tx 200 OK even though SEND was sent after 180 RING Not the cases above but Setup timer is expired : SIM Resppomse code shall be indicated (4##, 6##) When there are no Rx IP Packets during the Dormant time duration after the following L3/NAS messages LTE- RRC Connection Reestablishment Request LTE- RRC Connection Reestablishment Reject LTE- RRC Connection Reject LTE- EPS MM Tracking area update reject LTE- EPS MM Authentication reject LTE- EPS MM Authentication failure LTE- EPS MM Security mode reject LTE- EPS SM Reject BYE Method occurs during Traffic status No Rx RTP Packets during the predefined time duration
180 Ringing 183 Progress 200 OK – requested successful 302 Moved Temporarily – location update of the user 400 Bad Request - wrong Syntax indicator 401 Unauthorized – user authentication indicator 480 Temporarily not available 486 Busy Here 500 Internal Server Error 501 Not Implemented 603 Decline 606 Not Acceptable
•
RTP Drop – BYE : BYE Method occurs during the traffic status
•
RTP Drop – Time out : Rx RTP does not exist during the traffic status
•
Call Drop – Air interface Drop
VoLTE Call Statistics
SIP Column SIP Setup Time Examples Sig setup time Examples RTP Analysis Examples HO DATA Interruption Time
•
SIP Setup Time(Invite)
•
SIP Setup Time(100Trying)
•
SIP Setup Time(180Ringing)
•
SIP Setup Time(200OK)
•
SIP Setup Time(1st Rx Packet)
•
LTE RRC Setup Time
•
LTE QoS Setup Time
•
Paging Ind(LTE)
•
LTE QoS Setup Try Ind(LTE)
•
IP Address
SIP Setup Time(Invite) SIP Setup Time(100Trying) SIP Setup Time(180Ringing) SIP Setup Time(Virtual 180Ringing) SIP Setup Time(200OK) SIP Setup Time(1st Rx Packet) LTE RRC Setup Time LTE QoS Setup Time Paging Ind(LTE) LTE QoS Setup Try Ind(LTE) IP AddresIs
x Paging ~ Invite Invite ~ 100Trying Paging ~ 100Trying Invite ~ 180Ringing(Real) Paging ~ 180Ringing(Real) Invite ~ 180Ringing(Virtual) x Invite ~ 200OK Paging ~ 200OK Invite ~ Traffic Start Paging ~ Traffic Start rrcConnectionRequest ~ rrcConnectionReconfigurationComplete QCI 1,2(8) setup time (VoLTE is for QCI 1) rrc connectionReconfiguration ~ Ul information Transfer NAS Message(Activqte dedicated EPS bearer context request ~ Activqte dedicated EPS bearer context accept) Indication information for its own Paging in case of MT Indication for LTE QoS Setup attempt IP address of SIP Connecting (its own)
•
Audio Packet Loss(Tx/Rx)
•
•
Video Packet Loss(Tx/Rx)
•
•
Audio Delta Delay
•
Video Delta Delay
•
Audio Jitter
•
Video Jitter
•
Audio One Way Delay(Min/Max/Avg)
•
Video One Way Delay(Min/Max/Avg) HO Data Interruption Time(Tx/Rx Audio)(Min/Max/Avg) HO Data Interruption Time(Tx/Rx Video)(Min/Max/Avg)
•
HO Audio Packet Loss(Rx)
•
HO Video Packet Loss(Rx)
•
Intra eNB HO Data Interruption Time(Tx/Rx Audio)(Min/Max/Avg)
•
Percentage of Packet Loss during the traffic time
•
Packet Loss =
•
D(i, j) = (Rj – Ri) – (Sj – Si) = (Rj – Sj) – (Ri – Si)
•
Delta Delay(t) = Delay(t) – Delay(t-1)
•
J = J + ( |D(i-1, i)| - J ) / 16
Sent regularly Received irregularly
Time difference between the packets before and after the handover. The detail algorithm to take this metrics is explained in the next page.
V
Takes maximum time difference between RTP packets within the time window (currently 500ms before and after) centered on the RRC Connection Reconfiguration Request message (Handover attempt)
Intra LTE-HO Attempt + - 500ms
RTP HO Data Interruption Time Algorithm
RTP Analysis
HO DATA Interruption Time & Pack Loss HO Audio/Video Packet Loss Packet Loss Throughput Delay & Delta Delay RTT & One Way Delay
Displays RTP HO Data Interruption Time for each Hand Over Event •
Supports both Tx and Rx HO data interruption time.
•
D(i, j) = (Rj – Ri) – (Sj – Si) = (Rj – Sj) – (Ri – Si)
Time = Timestamp / 16000
T1 RTP1
R1
T2 •
•
Average of RTP Packet Delay variations Delta Delay(t) = Delay(t) – Delay(t-1)
T3
T4
T5
RTP2
RTP3
RTP4
R2
R3
R4
RTP5
R5 •
•
Distribution of RTP Packet Delays J = J(i-1) + ( |Delay(i)| - J(i-1) ) / 16
Same duration
Various delays
•
•
•
•
Defines based in SR (Sender Report) and RR (Receiver Report) in RTCP RTT = TS2 – TS1 – DLSR Assumes one way delay as RTT/2 RTCP occurs every 3 seconds so compensates based on Delta Delay
VoLTE Event Analysis
RTP Drop – Time out
RTP Drop – BYE Bluetooth Call - Setup Fail Bluetooth Call - Drop Success - CBQ
Setup Success
No Rx Packets for 10 seconds
Setup Success
BYE occurs in SIP Packet
