PAC_JPS_SS_4G_B_019.docx

LTE NEW SITE PAC DOCUMENT Prepared Rendhita/ Jhon P/Wick/Anang Approved Checked Waqas/ Kiki Candra

No.

1 (43)

Program JPS batch 2-2017 Rev

Date

Cluster Name JPS_SS_4G_B_019 JPS_SS_4G_B_019 Reference

PROVISIONAL ACCEPTANCE CERTIFICATE (PAC) LTE JPS PROJECT Area

South Sumatera

City

Kayu Agung

Cluster Name

JPS_SS_4G_B_019

Abstract This document is to provide report for XL Axiata on Provisional Acceptance Cluster based for commercial LTE launch.

PT.HUAWEI TECH INVESTMENT

PT. HUAWEI SERVICE

RND PT. XL AXIATA AXIATA Tbk Tbk

SOM PT. XL AXIATA AXIATA Tbk Tbk

PMO PT. XL AXIATA AXIATA Tbk Tbk

Name :

Name :

Name :

Name :

Name :

Date :

Date :

Date :

Date :

Date :


No. Date


2 (43) Cluster Name JPS_SS_4G_B_019 JPS_SS_4G_B_019 Reference

TABLE OF CONTENTS 1. 1.1

INTRODUCTION Introduction

5 5

1.2 General Site Information

5

1.2.1 New Site

5

1.2.2 Drive Test Methodology “Mobility Assessment”

6

1.3 Drive Test Methodology Methodology “Stationary Assessment”

6

1.4

FTP Server Information

6

1.5

Drive Test tool and Detail

7

2.

MAP INFORMATION

7

2.1 Google Earth Snapshot

7

2.2

8

3. 3.1

Drive test route, cluster border and coverage prediction Performance Result NMS KPI LTE

9 9

3.1.1 Availabi 3.1.1 Availability lity

9

3.1.2 Accessibili 3.1.2 Accessibility ty

9

3.1.3 Retainability

9

3.1.4 Integrity

10

3.1.5 Mobility

10

3.1.6 Utilization

10

3.1.7 CSFB

10

3.1.8 Traffic and Capacity

11

3.2

13

Drive Test KPI

3.2.1 Coverage Map Accuracy

13

3.2.2 Retainability

21


21

3.2.4 CSFB

21

3.2.5 Integrity

22

3.2.6 Mobility

22

3.2.7 Functional

22

3.2.8 PCI Plot

23

3.2.9 RSRQ

24

3.2.10 CQI

25

3.2.11 PS DL Throughput

26

3.2.12 PS UL Throughput

27

3.2.13 Transmission Modes Plot (MIMO)

28


No. Date



TABLE OF CONTENTS 1. 1.1

INTRODUCTION Introduction

5 5

1.2 General Site Information

5

1.2.1 New Site

5

1.2.2 Drive Test Methodology “Mobility Assessment”

6

1.3 Drive Test Methodology Methodology “Stationary Assessment”

6

1.4

FTP Server Information

6

1.5


7

2.

MAP INFORMATION

7

2.1 Google Earth Snapshot

7

2.2

8

3. 3.1

Drive test route, cluster border and coverage prediction Performance Result NMS KPI LTE

9 9

3.1.1 Availabi 3.1.1 Availability lity

9


9

3.1.3 Retainability

9

3.1.4 Integrity

10

3.1.5 Mobility

10

3.1.6 Utilization

10

3.1.7 CSFB

10

3.1.8 Traffic and Capacity

11

3.2

13

Drive Test KPI

3.2.1 Coverage Map Accuracy

13

3.2.2 Retainability

21


21

3.2.4 CSFB

21

3.2.5 Integrity

22

3.2.6 Mobility

22

3.2.7 Functional

22

3.2.8 PCI Plot

23

3.2.9 RSRQ

24

3.2.10 CQI

25

3.2.11 PS DL Throughput

26

3.2.12 PS UL Throughput

27

3.2.13 Transmission Modes Plot (MIMO)

28


No. Date



3.2.14 Channel Bandwidth Plot

29

3.2.15 Event Failed

29

3.2.16 Sleeping Cell Identification Identification

29

3.2.17 External Interference Identification

30

3.2.18 Cell Overshooting

30

3.2.19 Bad Spot analysis and Improvement

30

3.2.20 Physical Tuning Summary

32

3.2.21 Parameter Tuning Summary

32

4.

NMS KPI RAN LTE TREND

33

5.

KPI 2G & 3G

35

5.1

List of 2G, 3G & LTE sites inside LTE Polygon

35

5.2

NMS 2G

35

5.3

NMS 3G

36

5.4

MRR 3G

36

6.

FEATURE

37

7.

Issues, Recommendation Recommendation and Exclusion:

39

7.1 KPI RAN LTE

39

7.2

40

DT KPI LTE

7.3 KPI 2G & 3G

43

8.

43

Conclusion


No. Date



Table of Figure Figure 1: Cluster Map Information at Google Earth ............................. .............................................................. ....... 7 Figure 2: Drive Test Route at Google Earth .......................................................................... ..................................... 8 Figure 3: Coverage Prediction using Planning Tools & DT Route ............................................................................... 8 Figure 4: RSRP Coverage Prediction overlaid by Drive Test ................................................................................ ..... 13 13 Figure 5: RSRP Coverage MR Data ........................................................ .............................................................. ..... 15 Figure 6: RSRP IDLE Drive Test Result ........................................................................ .............................................. 16 Figure 7: RSRP CDF Distribution ............................................................ .............................................................. ..... 17 Figure 8: SINR-DL Dedicated Drive Test Result ..................................................................... ................................... 17 Figure 9: CDF Plot on SINR-DL Drive Test ............................................................................................................ ..... 18 18 Figure 10: Cell Edge Location ................................................................ ................................................................ ... 19 Figure 11: Open Signal & Ookla result on Cell Edge Spot 1 .................. .............................................................. ..... 20 20 Figure 12: Open Signal & Ookla result on Cell Edge Spot 2 .................. .............................................................. ..... 20 20 Figure 13: Open Signal & Ookla result on Cell Edge Spot 3 .................. .............................................................. ..... 21 21 Figure 14: Downlink QoS Test ............................................................... ................................................................. .. 23 23 Figure 15: PCI Plot ........................................................... ................................................................. ........................ 23 Figure 16: RSRQ Drive Test Result ......................................................... .............................................................. ..... 24 Figure 17: CQI Distribution Result ......................................................... .............................................................. ..... 25 Figure 18: PS DL Throughput Drive Test Result .......................................................... .............................................. 26 Figure 19: PS UL Throughput Drive Test Result .......................................................... .............................................. 27 Figure 20: Transmission Transmission Mode Plot ................................ ................................................................ ......................... 28 Figure 21: Channel Bandwidth Plot ......................................................................................................................... 29 Figure 22 : NMS KPI Trend .................................................................................................... ................................... 34


No.


Date

1.

INTRODUCTION

1.1

Introduction

5 (43) Cluster Name JPS_SS_4G_B_019 Reference

Provisional Acceptance shall be conducted after all the sites on air within cluster. If there are some issues that halt the RFS e.g. due to delayed community case, tower strengthening, etc, PAC can be conducted when at least 85% of sites are on air within a cluster. In the case of mushroom site where there is only 1 new site only with existing neighbor sites SSO is conducted for PAC. This document presents the result of Cluster Drive test and Network Performance KPI based on active measurement and OSS data collection for JPS_SS_4G_B_019. The drive-test KPIs are evaluated by drive-test coverage and statistic according to the predefined drive-test route that is mutually agreed by both parties. The results of the measurements are then compared with the passing criteria agreed upon by XL and HUAWEI.

1.2

General Site Information General Site Information

1.2.1

Cluster Name

JPS_SS_4G_B_019

Area

South Sumatera

Total number of cluster sites

2 Site

Total number of planned sites

2 Site

Total number of On-Air Macro sites:

2 Site

Total number of Pico Site

0 Site

Total number of pending On-Air Macro Sites

0 Site

Total number of pending On-Air Pico Sites

0 Site

New Site

eNB ID 275110 275110 275110 275137 275137 275137

LTE Site Name LTE_INDRALAYA LTE_INDRALAYA LTE_INDRALAYA LTE_PASARINDRALAYA LTE_PASARINDRALAYA LTE_PASARINDRALAYA

CellID 4 5 6 4 5 6

Longitude 104.6457 104.6457 104.6457 104.674 104.674 104.674

Latitude -3.20967 -3.20967 -3.20967 -3.25047 -3.25047 -3.25047

TAC 27007 27007 27007 27007 27007 27007

PCI 315 316 317 99 100 101

Status Integrated Integrated Integrated Integrated Integrated Integrated

OA Date 1-June-17 1-June-17 1-June-17 2-June-17 2-June-17 2-June-17


1.2.2

No.

6 (43)


Date

Cluster Name JPS_SS_4G_B_019 Reference

Drive Test Methodology “Mobility Assessment”

Drive test shall be performed under below circumstances: 

Cluster is barred / reserved to ensure only single user camp in the cluster using USIM class 11



HotRod Prioritas profile to be used LTE

Mobile KPI Measured

No.

UE

Handset1

Method

Idle

Lock LTE

RAT

BAND

LTE

1800

RSRP, RSRQ, PCI Plot

Round 1

Round

HUAWEI

Dedicated,

E392

continues

(Modem)

download

HUAWEI

Dedicated,

E392

continues

(Modem)

Upload

1 laptop, separated round between UL & DL Test to

Lock LTE

LTE

1800

Lock LTE

LTE

1800

PDCP DL THP,

guarantee single

SINR

user

PDCP UL THP

1 laptop, separated round between UL & DL Test to

2

Dedicated, Handset 1

continues download

1.3

Remark

Automatic

WCDMA /

1800/

(Unlocked)

LTE

2100

IRAT HO on

guarantee single

edge 4G

user

coverage

Drive Test Methodology “Stationary Assessment”

Stationary KPI’s will be tested based on the agreed -on methodology with XL team. Cell Edge

Performance for Link Budget Verification will be tested on the spot where the RSRP reaches between 115dBm to -120dBm at the edge of a cluster.

1.4

FTP Server Information Location : Sumatera FTP Server information IP: 112.215.125.194


1.5

2. 2.1

No. Date



DT Tools

Samsung Galaxy S5 GENEX Probe v3.16 MSISDN UE : 085922936735 MSISDN MODEM : 085922936734

Date of DT

10 June 2017

DT Team

Syariful Anam

MAP INFORMATION Google Earth Snapshot

Figure 1: Cluster Map Information at Google Earth 

1st tier neighbor of surrounding site distance 10 km away.



2.2

No.

8 (43)


Date


Drive test route, cluster border and coverage prediction

Figure 2: Drive Test Route at Google Earth

Figure 3: Coverage Prediction using Planning Tools & DT Route Item Site List, Polygon Border, DT Route and Coverage Prediction match with agreed design

Result Match

Target Must be matched with agreed design

PAC Ref Pass


3.

Performance Result

3.1

NMS KPI LTE

No.

9 (43)


Date


Cell KPI Aggregate for 7 days, taken at cell busy hours except for Availability. Availability is measured within 24 hours in a day. Cell busy hour is defined as the hour when downlink and uplink payload reach the peak value. Measurement period: Date (Start - End)

3.1.1

3.1.2

3.1.3

to

8 June 2017

14 June 2017

Availability No

Name

Target

PAC Result

1

Cell Availability

> 99%

97.26 %

Status Pass with justification

Accessibility No

Name

Target

PAC Result

Status

1

Session Setup Success Rate

> 99%

99.89%

Pass

2

RRC Setup Success Rate

> 98%

99.95%

Pass

Retainability No

Name

Target

PAC Result

Status

1

Session Abnormal Release Rate

< 1.4%

0.15%

Pass


3.1.4

No.

10 (43)


Date


Integrity No 1 2

Name UL Packet Loss (PDCP ) DL Packet Loss (PDCP )

3

Downlink User Throughput (Peak)*

4

Uplink User Throughput (Peak)*

5

Downlink User Throughput (Average)*

6

Uplink User Throughput (Average)*

7

DL Uu Latency

Target < 1e-3 < 1e-3 > 15 Mbps (3 MHz) > 50 Mbps (10 MHz) > 75 Mbps (15 MHz) > 4.5 Mbps (3 MHz) > 20 Mbps (10 MHz) > 33 Mbps (15 MHz) > 5.1 Mbps (3 MHz) > 17 Mbps (10 MHz) > 25.5 Mbps (15 MHz) > 3 Mbps (3 MHz) > 10 Mbps (10 MHz) > 15 Mbps (15 MHz) < 8 ms

PAC Result 0.0000 0.0000

Status Pass Pass

17.69 Mbps

Info only*

1.78 Mbps

Info only*

8.45 Mbps

Info only*

1.28 Mbps

Info only*

3.71 ms

Pass

* Depend on user behavior

3.1.5

Mobility No

3.1.6

Name

PAC Result

Status

99.90%

Pass

1

Handover Success Rate IntraFrequency

2

Handover Success Rate InterFrequency

> 98%

N/A

3

Handover Success Rate Inter-RAT (PSHO, not RwR)

> 95%

99.75 %

> 98%

Applicable whereby LTE 900/2300 are installed Pass

Utilization No 1

3.1.7

Target

Name

Target

PAC Result

Status

Maximum eNodeB CPU Utilization

< 70%

33 %

Pass

PAC Result

Status

CSFB No

Name

Target

1

Voice - Outgoing Call Setup Time*

<5s

2.36 s

Pass

2

Voice - Outgoing Call Setup Success Rate

> 97%

100%

Pass

3

Voice - Incoming Call Setup Time*

< 3.5 s

2.64 s

Pass

4

Voice - Incoming Call Setup Success Rate

> 97%

100 %

Pass

5

Voice - Time to Return to LTE*

<5s

3.32 s

Pass

6

Voice - Return to LTE Success Rate*

> 97%

100 %

Pass

* Measured using probe (Smart Care or Anritsu)


3.1.8

No.

11 (43)


Date


Traffic and Capacity 3.1.8.1

Payload Name

PAC Result*

UL Volume (Gigabyte)

165.91 Gb

DL Volume (Gigabyte)

1581.12 Gb

*Calculation: Daily (summing all hour in a day for all cell within cluster). Weekly (summing 7 days in a week on each UL & DL). Provided for information only.

3.1.8.2

PRB Utilization

Site ID LTE

LTE Site Name

CellID

DL PRB

UL PRB

DL PRB

UL PRB

Utilization

Utilization

Utilization

Utilization

(%)

(%)

(%)

(%)

(BH Daily

(BH Daily

Max

Max

averaged in

averaged

a week)

in a week)

4274666E

LTE_INDRALAYA

4

84.36

54.36

61.60

44.97

4274666E

LTE_INDRALAYA

5

72.13

56.49

48.43

42.04

4274666E

LTE_INDRALAYA

6

41.95

25.94

27.77

21.95

427D681E

LTE_PASARINDRALAYA

4

61.04

44.80

53.34

35.40

427D681E

LTE_PASARINDRALAYA

5

43.29

40.25

34.45

30.76

427D681E

LTE_PASARINDRALAYA

6

30.51

15.55

23.05

13.27

*Calculation: 

Busy hour is defined as the hour in which sum DL & UL payload reach the highest value



Daily : on busy hour, UL/DL PRB utilization is averaged for each cell on each site



Weekly : averaging daily value



Provided for information only


3.1.8.3

No.

12 (43)


Date


Number of RRC Connected User

Site ID

RRC Connected User

RRC Connected User

(Average Week, Daily Max)

(Average Week, Daily Sum)

LTE Site Name

LTE 4274666E

LTE_INDRALAYA

194

3064

427D681E

LTE_PASARINDRALAYA

136

2417

*Calculation: 

Busy hour is defined as the hour in which sum DL & UL payload reach the highest value




3.1.8.4

Number of IRAT HO Attempt

LTE SITE ID

IRAT HO Attempt Preparation LTE NODE B NAME

CellID

(Sum daily, summing on a week)

4274666E

LTE_INDRALAYA

4

6656

4274666E

LTE_INDRALAYA

5

767

4274666E

LTE_INDRALAYA

6

924

427D681E

LTE_PASARINDRALAYA

4

2374

427D681E

LTE_PASARINDRALAYA

5

838

427D681E

LTE_PASARINDRALAYA

6

822

*Calculation: 

Busy hour is defined as the hour in w hich sum DL & UL payload reach the highest value



Daily : on busy hour, I RAT HO Attempt is summed for each cell toward its relation



Weekly : summing daily value




Note: Attached xls showing cell relation below:

IRAT ATTEMPT JPS_SS_4G_B_019.xlsx


3.2

Drive Test KPI

3.2.1

Coverage Map Accuracy

No

Name


Date

prediction overlaid by drive test results


PAC

Target

RSRP plot from coverage 1

No.

13 (43)

Result

Must match for 90% of sample. The difference shall not greater than ± 3 dB

2 dB

2

RSRP (Idle) ≥ -105 dBm

> 95% area on the cluster

81.96%

2

SINR-DL (Dedicated) ≥ 3 dB

> 85% area on the cluster

92.26%

3.2.1.1 RSRP Coverage Prediction

Figure 4: RSRP Coverage Prediction overlaid by Drive Test RSRP Criteria (dBm) RSRP >=-85 -90 <= RSRP <-85 -100 <= RSRP <-90 -105 <= RSRP <-100 -115<= DL RSRP <-105 RSRP <-115

Legend

Status

Pass

Pass with Justification Pass


No.


Date

Prediction

Drive Test

PAC

(90% Sample)

(90% Sample)

Deviation

-100

-98

2 dB

14 (43)

Target

Result

Accurate within 90% of area with deviation of ± 3dB

Pass

Cluster JPS_SS_4G_B_019 -100.5

-100 -100

-99.5

-99

-98.5

-98 -98

-97.5

Prediction (90% Sample) -97


Drive Test (90% Sample)


No. Date

15 (43)



3.2.1.2 RSRP Coverage MR Data

Figure 5: RSRP Coverage MR Data

MR Collection time start from 19:00 to 21:00 12th May. Only for Information. MR RSRP

Legend

Percentage

MR Number 39

DL RSRP (dBm)<-115

2.15% 7.10% 30.78% 40.69% 14.04% 5.23%

Total

100.00%

DL RSRP (dBm)>=-85 -90<=DL RSRP (dBm)<-85 -100<=DL RSRP (dBm)<-90 -105<=DL RSRP (dBm)<-100 -115<=DL RSRP (dBm)<-105

Reference RSRP ≥ -105 dBm

MR Number 1466

PAC Result 80.72%

129 559 739 255 95 1816

Status Only for Information


3.2.1.3

No.

16 (43)


Date


RSRP IDLE Drive Test

Figure 6: RSRP IDLE Drive Test Result Min Value (dBm)

RSRP Criteria (dBm)

Max Value (dBm)

Percentage (%)

-85

DL RSRP (dBm)>=-85

Infinity

27.26%

-90

-90<=DL RSRP (dBm)<-85

-85

11.87%

-100

-100<=DL RSRP (dBm)<-90

-90

27.23%

-105

-105<=DL RSRP (dBm)<-100

-100

15.60%

-115

-115<=DL RSRP (dBm)<-105

-105

17.24%

-Infinity

DL RSRP (dBm)<-115

-115

0.80%

Target

PAC Result

In 95% of cluster, the RSRP must be ≥ -105 dBm

-105 dBm @ 51%

No low RSRP ( < -105 dBm ) is found near site ± 300m)

Not found

Legend

Status Pass With Justification Pass


No. Date


CDF Plot:

Figure 7: RSRP CDF Distribution

3.2.1.4 SINR-DL Dedicated Drive Test

Figure 8: SINR-DL Dedicated Drive Test Result



No.

18 (43)


Date


Min Value (dB)

SINR Criteria (dB)

Max Value (dB)

Percentage (%)

20

SINR (dB)>=20

Infinity

17.98%

10

10<=SINR (dB)<20

20

46.37%

3

3<=SINR (dB)<10

10

27.91%

0

0<=SINR (dB)<3

3

4.88%

-5

-5<=SINR (dB)<0

0

2.26%

-Infinity

SINR (dB)<-5

-5

0.60%

SINR ≥ 3

92.26%

Legend

Pass

Target

PAC Result

Status

In 85% of cluster, SINR-DL must be > 3 dB

3dB @ 95%

Pass

No Low SINR (<3 dB) is found near site (± 300m)

Not found

Pass

CDF Plot :

Figure 9: CDF Plot on SINR-DL Drive Test


3.2.1.5

No.

19 (43)


Date


Cell Edge Verification No

eNB ID

CellID

1

275110

5

2

275137

4

3

275137

5

RSRP

-116 dBm -116 dBm -125 dBm

longitude

latitude

PCI

Cell LTE throughput

Target

Status

104.64867

-3.324266

316

10.64 Mbps

> 1 Mbps

Pass

104.66902

-3.242666

99

18.31 Mbps

> 1 Mbps

Pass

104.69606

-3.238175

100

6.00 Mbps

> 1 Mbps

Pass

Note: Speed test is required at bad spot area (<-115 dBm) which is detected from MR or DT with maximum 3 spots.

Figure 10: Cell Edge Location


No. Date


OOKLA and OpenSignal Cell Edge verification:

Figure 11: Open Signal & Ookla result on Cell Edge Spot 1




No.

21 (43)


Date



3.2.2

Retainability No 1

3.2.3

Name Session Abnormal Release Rate

Target

PAC Result

Status

Remark

< 1.4%

0.40%

Pass

In PAC, value is measured on mobility or stationary on each PCI

Accessibility No

Name

Target

PAC Result

Status

1


> 99%

100%

Pass

2


> 98%

100%

Pass

3.2.4

CSFB

No

Name

1

Voice - Outgoing Call Setup Time

Remark In PAC, value is measured on mobility or stationary on each PCI

Target

PAC Result

Status

≤5s

2.66s

Pass

Remark In PAC,

Voice - Outgoing Call S etup Success 2

Rate

> 97%

3

Voice - Incoming Call Setup Time

≤ 3.5 s

Voice - Incoming Call Setup Success

100% 2.94s 100%

Pass Pass

4

Rate

> 97%

Pass

5

Voice - Time to Return to LTE

≤5s

3.69s

Pass

6

Voice - Return to LTE Success Rate

> 97%

100%

Pass

value is measured on mobility or stationary on each PCI


3.2.5

No.

22 (43)


Date


Integrity No

Name

Target

PAC Result

Status

1

RTT Packet Delay (ping) 32/1000 bytes

<= 20 ms / 30 ms

18.20ms/ 27.90ms

Pass

2

UL Packet Loss (PDCP )

< 1e-3

0.0000

Pass

3

DL Packet Loss (PDCP )

< 1e-3

0.0000

Pass

46.53 Mbps

Info only*

23.25 Mbps

Info only*

19.92 Mbps

Pass

11.90 Mbps

Pass

5.21 ms

Pass

> 15 Mbps (3 MHz) Downlink Peak User Throughput*

4

> 50 Mbps (10 MHz)MIMO >25 Mbps (10Mhz) SIMO > 75 Mbps (15 MHz) > 4.5 Mbps (3 MHz)

Uplink Peak User Throughput*

> 20 Mbps (10 MHz)MIMO >15 Mbps (10Mhz) SIMO > 33 Mbps (15 MHz)

5

> 4 Mbps (3 MHz) > 15 Mbps (10 MHz)

Downlink Average User Throughput

> 22.5 Mbps (15 MHz)

6

> 3 Mbps (3 MHz) > 10 Mbps (10 MHz)

Uplink Average User Throughput

> 15 Mbps (15 MHz)

7 Jitter (Uplink and Downlink)

8

< 50 ms

Note: all above values are measured on mobility or stationary on each PCI *Depends on single user scenario and Transmission Capacity

3.2.6

Mobility No

Handover Success Rate Intra-

1

Frequency Handover Success Rate Inter-

2

Frequency Handover Success Rate Inter-

3

3.2.7

Name

RAT (PSHO, not RwR)

Ref

PAC Result

Status

Remark

> 98%

100%

Pass

98.5%

> 98%

N/A

N/A

> 95%

100%

Pass

Applicable if L900/L2300 are deployed 98.5%

Functional No

Name

Method

PAC Result

Status

One UE in excellent, one UE in medium, and one 1

Downlink QoS

UE in bad positions, all with same priority. One

Test

additional UE with higher priority is inserted, under different conditions

Cluster

Pass


No. Date



3.2.7.1 Downlink QoS Test

Figure 14: Downlink QoS Test Target HotRod Priority speed (higher QoS) is higher than Super Hotrod (lower QoS)

3.2.8

PCI Plot

Figure 15: PCI Plot

PAC Status Pass


3.2.9

No.

24 (43)


Date


Target

PAC Result

Status

No partial / full cross feeder is detected

Information only

Pass

RSRQ RSRQ is provided for information only.

Figure 16: RSRQ Drive Test Result Min Value (dB)

RSRQ Criteria (dB)

Max Value (dB)

Percentage (%)

-6

RSRQ (dB)>=-6

Infinity

10.64%

-9

-9<=RSRQ (dB)<-6

-6

64.91%

-11

-11<=RSRQ (dB)<-9

-9

18.76%

-14

-14<=RSRQ (dB)<-11

-11

4.90%

-Infinity

RSRQ (dB)<-14

-14

0.78%

Legend


3.2.10

No. Date



CQI

Figure 17: CQI Distribution Result Min Value

CQI

Max Value

Percentage (%)

10

10 <= CQI Value < 15

15

53.29%

5

5<= CQI Value < 10

10

46.01%

3

3 <= CQI Value < 5

5

0.70%

0

0 <= CQI Value < 3

3

0.00 %

Item

Status

CQI Distribution*

Info Only


3.2.11

No.

26 (43)


Date


PS DL Throughput

Figure 18: PS DL Throughput Drive Test Result Min Value (Mbps)

DL Throughput (Mbps)

Max Value (Mbps)

Percentage (%)

30

DL Throughput (Mbps)>=30

Infinity

18.22%

10

10<=DL Throughput (Mbps)<30

30

61.63%

5


10

11.65%

3


5

3.03%

0

0

3

5.47%

Legend

PS DL Drive Test Target

PAC Result

Status

No low DL throughput ( < 3 Mbps) near site ( ± 300m)

Yes

Pass

*PS DL Throughput test do in normal mode without cell bar.


3.2.12

No.

27 (43)


Date


PS UL Throughput

Figure 19: PS UL Throughput Drive Test Result Min Value (Mbps)

UL Throughput (Mbps)

Max Value (Mbps)

Percentage (%)

15

UL Throughput (Mbps)>=15

Infinity

14.65%

10

10<=UL Throughput (Mbps)<15

15

38.33%

5


10

25.26%

3


5

7.57%

0

0

3

14.18%

PS UL Drive Test Target

PAC Result

Status

No low DL throughput ( < 3 Mbps) near site ( ± 300m)

Yes

Pass

*PS UL Throughput test do in normal mode without cell bar.

Legend


3.2.13

No.

28 (43)


Date


Transmission Modes Plot (MIMO) Note: provided for information only

Figure 20: Transmission Mode Plot

eNB ID

eNB Name

Cell ID

275110 275110 275110 275137 275137 275137

4274666E_LTE_INDRALAYA 4274666E_LTE_INDRALAYA 4274666E_LTE_INDRALAYA 427D681E_LTE_PASARINDRALAYA 427D681E_LTE_PASARINDRALAYA 427D681E_LTE_PASARINDRALAYA

4 5 6 4 5 6

MIMO Check Result Design

Implementation

MIMO MIMO MIMO MIMO MIMO MIMO

MIMO MIMO MIMO MIMO MIMO MIMO


3.2.14

No.

29 (43)


Date


Channel Bandwidth Plot Note: provided for information only

Figure 21: Channel Bandwidth Plot

3.2.15

Event Failed Item

Target

Test Result

Status

Found event failed report

No event failed is detected

Not Found

Pass

Event_FTP.csv

3.2.16

Sleeping Cell Identification Target

PAC Result

Status

No sleeping cell is found

Not found

Pass

NMS JPS_SS_4G_B_019.xlsx


3.2.17

No.

30 (43)


Date


External Interference Identification Target

PAC Result

Status

No external interference is found

Not found

Information only

External_Interference JPS_SS_4G_B_019.xlsx

3.2.18

Cell Overshooting Not found site overshooting

Site name

Cell name

Inter Site Distance (KM)

Target

Overshooting Factor

Remark

LTE_INDRALAYA

PG4G18_4274666E_4

N/A

>=80%

N/A

Open Area

LTE_INDRALAYA

PG4G18_4274666E_5

N/A

>=80%

N/A

Open Area

LTE_INDRALAYA

PG4G18_4274666E_6

N/A

>=80%

N/A

Open Area

LTE_PASARINDRALAYA

PG4G18_427D681E_4

N/A

>=80%

N/A

Open Area

LTE_PASARINDRALAYA

PG4G18_427D681E_5

N/A

>=80%

N/A

Open Area

LTE_PASARINDRALAYA

PG4G18_427D681E_6

N/A

>=80%

N/A

Open Area

CELL OVERSHOOTING JPS_

3.2.19

Bad Spot analysis and Improvement Target

PAC Result

Status

All bad spots are improved

No more bad spot is detected

Pass


3.2.19.1

No.

31 (43)


Date


Bad spot on RSRP/ SINR RSRP

-

Before

After

Spot

Spot Type

1

Bad Coverage

Bad Spot Description Bad spot due to weak coverage from site

Action Taken Adjust MT from 2 to 5

LTE_INDRALAYA Sec 3. Distance around 1.58

2

Bad Coverage

Km and located on cell edge

Adjust ET from 4 to 0

Bad spot due to weak coverage from site

Adjust MT from 2 to 5

LTE_INDRALAYA Sec 2. Distance around 1.2 Km and located on cell edge 3

Bad Coverage

Bad spot due to weak coverage from site LTE_PASARINDRALAYA Sec 3. Distance around 1.8 Km and located on cell edge

4

Bad Coverage

Bad spot due to weak coverage from site LTE_INDRALAYA Sec 1. Distance around 2 Km and located on cell edge

Adjust ET from 4 to 0

Adjust MT from -2 to 2 Adjust ET from 2 to 3

Adjust MT from 2 to 5 Adjust ET from 4 to 0


3.2.20

3.2.21

No.

32 (43)


Date


Physical Tuning Summary Site Name

CellID

Height

LTE_INDRALAYA

4

LTE_INDRALAYA

Before

After

Ant Type

RET

0

AAU

-

5

0

AAU

-

255

5

0

AAU

-

2

60

2

3

AAU

-

2

2

120

2

3

AAU

-

-2

2

330

2

3

AAU

-

Dir

Mech

Elec

Dir

Mech

Elec

55

40

2

4

40

5

5

55

155

2

4

155

LTE_INDRALAYA

6

55

255

2

4

LTE_PASARINDRALAYA

4

38

60

0

LTE_PASARINDRALAYA

5

38

120

LTE_PASARINDRALAYA

6

38

330

Parameter Tuning Summary

-

No Parameter tuning or optimization done since the coverage already follow RF design & parameter standard (CDD) already implemented successfully.


4.

No.

33 (43)


Date


NMS KPI RAN LTE TREND Availability


Cell Availability (%)

Session Setup Success Rate (%)

100

100

99

99.5

98

99

97

98.5

96

98

95

97.5

94

97

93

96.5

92

96

91

95.5

90

95 8- Ju n- 17

9- Ju n- 17

10 -J un -17

11 -J un -17

Average of Cell Availability

1 2- Ju n- 17

13 -J un -17

14 -J un -1 7

8- Jun-17

9-Jun-17

10-Jun-17

11-Jun-17

Average of Session Setup Success Rate

Average of Target

12-Jun-17

13-Jun-17

14-Jun-17

Average of Target Session Setup Sucess Rate

Availability is maintained above reference value 99%

Session Setup Success Rate is maintained above reference value 99%


Session Abnormal Release Rate

RRC Setup Success Rate (%)

Session Abnormal Release Rate (%)

100

1.6

99

1.4

98

1.2

97 96

1

95

0.8

94

0.6

93

0.4

92

0.2

91

0

90 8- Jun-17

9- Jun-1 7

10-Jun-17

11-Jun-17

A ve ra ge of RR C Se tu p S uc ce ss R at e

12-Jun -17

13 -Ju n-17

8-Jun-17

14-Ju n-17

9-Jun-17

10-Jun-17

Average of Session Abnormal Release Rate

A ve ra ge o f R RC Ta rg et

11-Jun-17

12-Jun-17

13-Jun-17

14-Jun-17

Average of Target SessionAbnormal Release Rate

RRC Setup Success Rate is maintained above reference value 98 %

Session Abnormal Release Rate is maintained below reference value 1.4 %

UL/DL PDCP Packet Loss

Downlink Vs Uplink Average Cell Throughput Downlink vs Uplink Cell Throughput (Average) (Mbps)

UL vs DL Packet Loss PDCP (%) 25 0.001401 0.001201

20

0.001001

15

0.000801 10 0.000601 0.000401

5

0.000201

0 8- Jun-17

0.000001 8-Jun-17

9-Jun-17

ULPacket Loss_PDCP

10-Jun-17

11-Jun-17

DL Packet Loss_PDCP

12-Jun-17

13-Jun-17

14-Jun-17

Average of Target UL & DL Packet Loss PDCP

PDPCP UL/DL Packet Loss performance is below reference value 1e-3.

9-Jun-17

10-Jun-17

11-Jun-17

12-Jun-17

13-Jun-17

14-Jun-17

Average of Downlink Cell Throughput (Mbps) Average of Uplink Cell Throughput (Mbps)

Cell DL Throughput Average is 16.55 Mbps, Cell UL Throughput Average is 2.12Mbps.(Only for Information)


No.

34 (43)


Date


IRAT-HO SR

HOSR Intra-frequency

Handover Success Rate Inter-RAT IRAT-HO not RwR (%)

HO Intra Success Rate (%)

100

100

99 98

98 97

96

96 95

94

94 92

93 92

90

91

8-Jun-17

90 8-Jun-17

9-Jun-17

10-Jun-17

11-Jun-17

12-Jun-17

13-Jun-17

9-Jun-17

14-Jun-17

10-Jun-17

11-Jun-17

12-Jun-17

13-Jun-17

14-Jun-17

HO Success Rate Intra-Frequency

Average of Handover Success Rate Inter-RAT IRAT-HO not RwR

HO Success Rate Inter-Frequency

Average of Target Handover Success Rate Inter-RAT IRAT-HO not RwR

Average of Target Handover Success Rate Inter-Frequency

Handover Success Rate Inter RAT Frequency is maintained above reference value 95.00%

Handover Success Rate Intra Frequency is maintained above reference value 98.00%

Processor Load

3G vs LTE User Number

Maximum eNodeB CPU Utilization (%)

LTE RRC User VS 3G HSDPA User

80

1400

70

1200

60

1000

50 40

800

30

600

20

400

10

200

0 8-Jun-17

9-Jun-17

10-Jun-17

11-Jun-17

12-Jun-17

13-Jun-17

0

14-Jun-17

8-Jun-17

Average of Maximum eNodeB CPU Utilization

9-Jun-17

10-Jun-17

11-Jun-17

Average of HSDPA UE Mean Cell

Average of Target Maximum eNodeB CPU Utilization

12-Jun-17

13-Jun-17

14-Jun-17

Average of LTrafficUserAvg

eNodeB processor load maximum is lower below reference value 70.00 %.

3G and LTE User Number actually no issue. (Only for Information)

3G vs LTE Payload Trend (Daily sum in GB)

3G User throughput vs 4G User throughput (busy hour cluster level)

DL and UL Volume (GB)

Throughput 3G vs 4G (Mbps)

900

0.7

14

0.6

12

0.5

10

500

0.4

8

400

0.3

6

300

0.2

4

0.1

2

800 700 600

200 100 0 8- Ju n- 17

0 9- Ju n- 17

10 -J un -17

11 -Ju n- 17

Average of 4G Payload

12 -J un -17

13 -J un -17

14 -Ju n- 17

Average of 3G Payload

Payload actually no issue, (Only for Information)

0 8-Jun-17

9-Jun-17

10-Jun-17

11-Jun-17

Average of Downlink User Throughput 3G (Mbps)

12-Jun-17

13-Jun-17

14-Jun-17

Average of Downlink User Throughput 4G (Mbps)

Throughput actually no issue, (Only for Information)

Figure 22 : NMS KPI Trend


5.

No.

35 (43)


Date


KPI 2G & 3G

Drive Test is out of LTE vendor scope of work, hence the 2G & 3G DT KPI would be reviewed during quarterly Drive Test with PTHS. Therefore, the 2G & 3G aspect only review the NMS KPI, plus MRR data of 3G in SSO report. The target for NMS KPI is maintained of improved, comparing the best week (within 3 weeks) after Frequency Carving/TRX Shutdown versus the week when SSO is collected. 2G & 3G nodes involved are applicable for nodes which are inside LTE polygon, regardless they have collocated LTE installed or not. All KPI, except availability are calculated during busy hour-payload UL+DL daily, averaged within a week. Availability is monitored 24 hr daily.

5.1

List of 2G, 3G & LTE sites inside LTE Polygon Item

Site List 2G & 3G inside the polygon is

Target

PAC Result

Status

Match

Pass

Must be matched with

matched with actual

actual

Adjacent and collo neighbor cell list in excel file attached

SITELIST JPS_SS_4G_B_019.xlsx

5.2

NMS 2G KPI

Baseline Week16

PAC Week20

Comments*

Assignment Success Rate

99.23%

99.84%

Improved

Perceive Drop Rate

1.19%

1.51%

Maintained

Perceive Congestion Rate

0.03%

0.11%

Maintained

SDCCH Drop Rate

0.01%

0.00%

Maintained

SDCCH Congestion Rate

0.00%

0.01%

Maintained

100.00%

100.00%

Maintained

TBF Failure Rate

0.93%

0.41%

Improved

Cell Availability

99.33%

98.91%

Maintained

HO Success Rate

98.17%

99.29%

Improved

SDCCH Success Rate

* Fill comments with: Degraded or Maintained or Improved according to current week compared with baseline


5.3

No. Date

36 (43)



NMS 3G KPI

Baseline Week 16

PAC Week 20

Comments*

RRC Success Rate

99.16%

99.02%

Maintained

Speech Access Rate

98.50%

98.59%

Maintained

PS Access Rate

98.77%

98.00%

Maintained

Speech Drop Rate

1.01%

0.57%

Improved

PS Drop Rate

0.35%

0.35%

Maintained

RAB Congestion

0.00%

0.01%

Maintained

Cell Availability

99.85%

99.82%

Maintained

CS IRAT-HO SR

97.11%

95.00%

Degraded

* Fill comments with: Degraded or Maintained or Improved according to current week compared with baseline

5.4

MRR 3G

During LTE Optimization process, some physical tuning might be executed to enhance LTE quality. While in some sites, the antenna is shared between 3G and LTE. Therefore, LTE vendor must provide the MRR before and after physical tuning is executed. The CPICH RSCP must be maintained, or if due to less sample, the deviation of 2% is accepted. * Fill comments with: Degrade or maintain or improve accor ding to current week compared with baseline (a week before tuning is executed)

Before

After


6.

No.

37 (43)


Date


FEATURE

PAC acceptance validates the feature state on each RAN LTE nodes. The validation refers to Bill of Quantity stated in Purchased Order with the actual feature status on the node. The feature may be applicable on the cell level, site level (eNB) or RRC Connected user level. Each LTE vendor may have their own feature ID. We define 2 type of feature: - Basic: standard deliverables on each product package - Optional: selectable feature chosen by customer. Below is the detail log file on feature validation:

FEATURES

FEATURE ID

FEATURE DOMAIN

FEATURE TYPE

BoQ Checking

RECOMME NDED BASELINE

Current Status

CS Fallback to UTRAN

LOFD-001033

RF

Optional

YES

ON

ON

CS Fallback to GERAN

LOFD-001034

RF

Optional

YES

OFF

OFF

CS Fallback with LAI to GERAN

LOFD-001069

RF

Optional

YES

OFF

OFF

LoCation Services(LCS)

LOFD-00104 7

Product

Optional

YES

OFF

OFF

Support of UE Category2/3/4

LOFD-001030

RF

Optional

YES

ON

ON

Enhanced Scheduling

LOFD-001015

RF

Optional

YES

ON

ON

LOFD-001027

RF

Optional

YES

Trial

Trial

LOFD-001029

RF

Optional

YES

Trial

Trial

LOFD-001020

RF

Optional

YES

OFF

OFF

Security Mechanism

LOFD-001010

Product

Optional

YES

ON

ON

Intra-LTE Load Balancing

LOFD-001032

RF

Optional

YES

LOFD-070215

RF

Optional

YES

Temporary OFF Temporary OFF

Temporary OFF Temporary OFF

LOFD-001019

RF

Optional

YES

ON

ON

LOFD-001017

RF

Optional

YES

Temporary OFF

Temporary OFF

LOFD-001052

RF

Optional

YES

ON

ON

LOFD-001053

RF

Optional

YES

OFF

OFF

LOFD-001054

RF

Optional

YES

Temporary OFF

Temporary OFF

Active Queue Management(AQM) Enhanced Admission Control PS Inter-RAT Mobility between E-UTRAN and GERAN

Intra-LTE User Number Load Balancing PS Inter-RAT Mobility between E-UTRAN and UTRAN RObust Header Compression (ROHC) Flash CS Fallback to UTRAN Flash CS Fallback to GERAN Flexible User Steering


FEATURES Inter-RAT Load Sharing to UTRAN UL Interference Rejection Combining Automatic Neighbour Relation(ANR)

FEATURE ID

No.


Date

FEATURE DOMAIN


FEATURE TYPE

BoQ Checking

RECOMME NDED BASELINE

Current Status

LOFD-001044

RF

Optional

YES

Trial

Trial

LOFD-001012

RF

Optional

YES

ON

ON

LOFD-002001

RF

Optional

YES

ON

ON

LOFD-002004

Product

Optional

YES

ON

ON

LOFD-002007

RF

Optional

YES

ON

ON

LOFD-002005

RF

Optional

YES

OFF

OFF

LOFD-001024

Product

Optional

YES

Scene On

Scene On

LOFD-070203

RF

Optional

YES

Temporary OFF

Temporary OFF

LOFD-001001

RF

Optional

YES

ON

ON

LOFD-003011

Product

Optional

YES

ON

ON

LOFD-003012

Product

Optional

YES

Temporary OFF

Temporary OFF

S1 and X2 over IPv6

LOFD-003017

Product

Optional

YES

OFF

OFF

IPsec

LOFD-003009

Product

Optional

YES

OFF

OFF

Public Key Infrastructure(PKI)

LOFD-003010

Product

Optional

YES

OFF

OFF

Integrated Firewall

LOFD-003014

Product

Optional

YES

OFF

OFF

S1-flex

LOFD-001018

Product

Optional

YES

ON

ON

2G/3G and LTE Cotransmission

LOFD-003002

Product

Optional

YES

Scene On

Scene On

UL 64QAM

LOFD-001006

RF

Optional

YES

ON

ON

Inter-RAT ANR

LOFD-002002

RF

Optional

YES

Trial

Trial

RACH Optimization

LOFD-002015

RF

Optional

YES

Scene On

Scene On

LOFD-001039

Product

Optional

YES

OFF

OFF

LOFD-001056

Product

Optional

YES

OFF

OFF

UL 2x2 MU-MIMO

LOFD-001002

RF

Optional

YES

Temporary OFF

Temporary OFF

Intra-eNodeB UL CoMP

LOFD-001066

RF

Optional

YES

ON

ON

RF

Optional

YES

ON

ON

RF

Optional

YES

ON

ON

Self-configuration PCI Collision Detection & Self-Optimization Mobility Robust Optimization (MRO) Remote Electrical Tilt Control RIM Based LTE Target Cell Selection DL 2x2 MIMO Enhanced Transmission QoS Management IP Performance Monitoring

RF Channel Intelligent Shutdown PSU Intelligent Sleep Mode

CQI Adjustment Dynamic Scheduling

LOFD00101501 LOFD00101502

Control Channel IRC

LOFD-001094

RF

Optional

YES

Trial

Trial

CS Fallback with LAI to UTRAN

LOFD-001068

RF

Optional

YES

ON

ON


FEATURES

No.

FEATURE ID

SRVCC to UTRAN


Date

FEATURE DOMAIN

39 (43)

FEATURE TYPE

BoQ Checking


RECOMME NDED BASELINE Temporary OFF

Temporary OFF

Current Status

LOFD-001022

RF

Optional

YES

LOFD-070207

RF

Optional

YES

Scene On

Scene On

LOFD-070219

Product

Optional

YES

Scene On

Scene On

LOFD-001014

RF

Optional

YES

OFF

OFF

Static TDM eICIC

LAOFD-002001

RF

Optional

YES

OFF

OFF

TTI Bundling

LOFD-001048

RF

Optional

YES

Temporary OFF

Temporary OFF

FeICIC

LAOFD-081234

RF

Optional

YES

OFF

OFF

SFN

LOFD-003029

RF

Optional

YES

Scene On

Scene On

CPRI Compression

LOFD-001076

Product

Optional

YES

OFF

OFF

LOFD-002012

Product

Optional

YES

ON

ON

LOFD-003013

Product

Optional

YES

OFF

OFF

IPsec for IPv6

LOFD-003024

Product

Optional

YES

OFF

OFF

Ethernet OAM

LOFD-003004

Product

Optional

YES

OFF

OFF

Antenna Fault Detection

LOFD-002011

Product

Optional

YES

OFF

OFF

Multi-mode BS Common Reference Clock

MRFD-231601

Product

Optional

YES

OFF

OFF

Intelligent Access Class Control IP Active Performance Measurement Dynamic Inter-Cell Interference Coordination

Cell Outage Detection and Compensation Enhanced Synchronization

Criteria Feature status matched with BoQ

Result Match

7.

Issues, Recommendation and Exclusion:

7.1

KPI RAN LTE

Remark Pass

Worse cell availability issue on sector 3 due to hardware issue and already escalate project team to trouble shoot.


7.2

No.


Date


DT KPI LTE

Justification for KPI DT LTE which not achieved the target Spot No

Spot Type

Badspot Description

Action

1

Bad coverage

Bad spot due to weak coverage from site LTE_INDRALAYA Sec 2. Distance around 2.83 Km and and located on cell edge

N/A


Spot No

Spot Type

2

Bad coverage

No. Date



Badspot Description Bad spot due to weak coverage from site LTE_PASARINDRALAYA Sec 3. Distance around 1.65 Km and and located on cell edge

Action N/A


Spot No

Spot Type

3

Bad coverage

No. Date


Badspot Description Bad spot due to weak coverage from site LTE_PASARINDRALAYA Sec 2. Distance around 1.7 Km and located on cell edge

Justification No Access Route Sector 3 LTE_PASARINDRALAYA


Action N/A

PAC_JPS_SS_4G_B_019.docx

Recommend Documents