PAC Report Medan MDN-04_Rev E-1

1 (55)

PAC REV.E HUAWEI Prepared

No.

Alief Risbaya Approved

Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

PROVISIONAL ACCEPTANCE CERTIFICATE (PAC) LTE FDD MEDAN PROJECT

Area

MEDAN

Cluster

MDN-04

Abstract This document is to provide report for XL Axiata on Provisional Acceptance Cluster based for commercial LTE launch.

PT.HUAWEI TECH INVESTMENT

RND PT XL AXIATA

SOM PT XL AXIATA

NETWORK OPTIM PT. HUAWEI SERVICES

NETWORK QUALITY PT. HUAWEI SERVICES

Name :

Name :

Name :

Name :

Name :

Date

Date :

Date :

Date :

Date :

2 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

CONTENTS 1 INTRODUCTION 1.1 Introduction 1.2 General Cluster Information 1.3 Drive Test Methodology “Mobility Assessment” 1.4 Drive Test Methodology “Stationary Assessment” 1.5 FTP Server Information 1.6 Drive Test tool and Detail 2 MAP INFORMATION 2.1 Map Information 2.2 Drive test route, cluster border and coverage prediction 3 Performance Result 3.1 NMS KPI LTE 3.1.1 Availability 3.1.2 Accessibility 3.1.3 Retainability 3.1.4 Integrity 3.1.5 Mobility 3.1.6 Utilization 3.1.7 CSFB 3.1.8 Traffic 3.2 Drive Test KPI 3.2.1 Coverage Map Accuracy 3.2.2 Capacity 3.2.3 Retainability 3.2.4 Accessibility 3.2.5 CSFB 3.2.6 Integrity 3.2.7 Mobility 3.2.8 Functional 3.2.9 PCI Plot 3.2.10 RSRQ 3.2.11 PS DL Throughput 3.2.12 PS UL Throughput 3.2.13 Event Failed 3.2.14 Low RSRP near site (+ 200m) 3.2.15 Sleeping Cell Identification

4 4 4 6 6 6 7 7 7 7 9 9 9 9 9 9 10 10 10 10 10 10 19 20 20 20 22 22 22 23 24 25 26 26 27 27

3 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

3.2.16 External Interference Identification 3.2.17 Bad Spot Analysis 3.2.18 Physical Tuning Summary 3.2.19 Parameter Tuning Summary 4 NMS KPI RAN LTE TREND 5 KPI 2G & 3G 5.1 List of 2G & 3G sites inside LTE Polygon : 5.2 NMS 2G 5.3 NMS 3G 5.4 MRR 3G 6 PUNCHLIST FROM SSA LTE_ISTANA_MAIMUN_MEDAN 7 Issues, Recommendation and Exclusion: 7.1 KPI RAN LTE 7.2 DT KPI LTE 7.3 KPI 2G & 3G 8 Overall KPI Review 8.1 Scoring 8.2 Information Only 8.3 Not Applicable 9 Formula Reference for NMS KPI 10 Revision History

Reference

28 28 31 31 32 34 34 35 36 36 37 38 48 49 50 50 51 51 52 53 54 55

4 (55)


No.


Checked

Kiki Candra

1

INTRODUCTION

1.1

Introduction

Date

Rev

13 Dec 2015

E

Reference

Provisional Acceptance shall be conducted after all the sites on air within cluster. If there are some issues that halt the RFS e.g. due to delayed community case, tower strengthening, etc, PAC can be conducted when at least 85% of sites are on air within a cluster. This document presents the result of Cluster Drive test and Network Performance KPI based on active measurement and OSS data collection for Cluster MDN-04. The drive-test KPIs are evaluated by drive-test coverage and statistic according to the predefined drive-test route that is mutually agreed by both parties. The results of the measurements are then compared with the passing criteria agreed upon by XL and HUAWEI.

1.2

General Cluster Information General Site Information Cluster Name Cluster MDN-04 City Medan Total number of planned sites 20 sites Total number of On-Air sites: 20 sites Total number pending On-Air Sites 0 sites

Medan Cluster MDN-04 LTE Site list eNodeB ID

eNodeB Name

Cell Id

Long

Lat

TAC

PCI

BW

OA Date

Type

220025

LTE_PURI_MEDAN

4

98.6969722

3.5793

22009

246

10 MHz

18-Dec-15

HTI Propose

220025

LTE_PURI_MEDAN

5

98.6969722

3.5793

22009

247

10 MHz

18-Dec-15

HTI Propose

220025

LTE_PURI_MEDAN

6

98.6969722

3.5793

22009

248

10 MHz

18-Dec-15

HTI Propose

220034

LTE_HOTEL_GRAND_SIRAO

4

98.68625

3.5832333

22008

183

10 MHz

8-Jan-16

HTI Propose

220034

LTE_HOTEL_GRAND_SIRAO

5

98.68625

3.5832333

22008

184

10 MHz

8-Jan-16

HTI Propose

220037

LTE_KOTA_MATSUM_MEDAN

4

98.6950556

3.5759278

22009

261

10 MHz

21-Dec-15

ELIGIBLE

220037


5

98.6950556

3.5759278

22009

262

10 MHz

21-Dec-15

ELIGIBLE

220037


6

98.6950556

3.5759278

22009

263

10 MHz

21-Dec-15

ELIGIBLE

220040

LTE_SIMPANG_WASPADA

4

98.6821111

3.5810556

22008

186

10 MHz

6-Jan-16

ELIGIBLE

220040

LTE_SIMPANG_WASPADA

5

98.6821111

3.5810556

22008

187

10 MHz

6-Jan-16

ELIGIBLE

220040

LTE_SIMPANG_WASPADA

6

98.6821111

3.5810556

22008

188

10 MHz

6-Jan-16

ELIGIBLE

220047

LTE_AUR_MEDAN

4

98.6801111

3.576525

22008

228

10 MHz

18-Dec-15

ELIGIBLE

220047

LTE_AUR_MEDAN

5

98.6801111

3.576525

22008

229

10 MHz

18-Dec-15

ELIGIBLE

5 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

220047

LTE_AUR_MEDAN

6

98.6801111

3.576525

22008

230

10 MHz

18-Dec-15

ELIGIBLE

220048

LTE_KEMALA_MEDAN

4

98.6880556

3.5756056

22008

240

10 MHz

21-Dec-15

ELIGIBLE

220048

LTE_KEMALA_MEDAN

5

98.6880556

3.5756056

22008

241

10 MHz

21-Dec-15

ELIGIBLE

220048

LTE_KEMALA_MEDAN

6

98.6880556

3.5756056

22008

242

10 MHz

21-Dec-15

ELIGIBLE

220049

LTE_SEI_RENGAS

4

98.6918056

3.5865528

22008

207

10 MHz

6-Jan-16

ELIGIBLE

220049

LTE_SEI_RENGAS

5

98.6918056

3.5865528

22008

208

10 MHz

6-Jan-16

ELIGIBLE

220049

LTE_SEI_RENGAS

6

98.6918056

3.5865528

22008

209

10 MHz

6-Jan-16

ELIGIBLE

220052

LTE_BROMO_MEDAN

4

98.7063056

3.5753306

22009

339

10 MHz

6-Jan-16

ELIGIBLE

220052

LTE_BROMO_MEDAN

5

98.7063056

3.5753306

22009

340

10 MHz

6-Jan-16

ELIGIBLE

220052

LTE_BROMO_MEDAN

6

98.7063056

3.5753306

22009

341

10 MHz

6-Jan-16

ELIGIBLE

220059

LTE_SUTRISNO_BARAT

4

98.69905

3.582444

22009

249

10 MHz

18-Dec-15

ELIGIBLE

220059

LTE_SUTRISNO_BARAT

5

98.69905

3.582444

22009

250

10 MHz

18-Dec-15

ELIGIBLE

220059

LTE_SUTRISNO_BARAT

6

98.69905

3.582444

22009

251

10 MHz

18-Dec-15

ELIGIBLE

220060

LTE_RS_METHODIST_MEDAN

4

98.6925833

3.5835556

22008

210

10 MHz

6-Jan-16

ELIGIBLE

220060


5

98.6925833

3.5835556

22008

211

10 MHz

6-Jan-16

ELIGIBLE

220060


6

98.6925833

3.5835556

22008

212

10 MHz

6-Jan-16

ELIGIBLE

220065

LTE_MEGA_MAS

4

98.7073056

3.5821083

22009

303

10 MHz

6-Jan-16

ELIGIBLE

220065

LTE_MEGA_MAS

5

98.7073056

3.5821083

22009

304

10 MHz

6-Jan-16

ELIGIBLE

220065

LTE_MEGA_MAS

6

98.7073056

3.5821083

22009

305

10 MHz

6-Jan-16

ELIGIBLE

220066

LTE_SUN_YAT_SEN

4

98.6915278

3.5816667

22008

213

10 MHz

6-Jan-16

ELIGIBLE

220066

LTE_SUN_YAT_SEN

5

98.6915278

3.5816667

22008

214

10 MHz

6-Jan-16

ELIGIBLE

220066

LTE_SUN_YAT_SEN

6

98.6915278

3.5816667

22008

215

10 MHz

6-Jan-16

ELIGIBLE

220072

LTE_PASAR_MERAH_TIMUR

4

98.6831944

3.5725278

22008

243

10 MHz

7-Jan-16

ELIGIBLE

220072


5

98.6831944

3.5725278

22008

244

10 MHz

7-Jan-16

ELIGIBLE

220072


6

98.6831944

3.5725278

22008

245

10 MHz

7-Jan-16

ELIGIBLE

220073

LTE_PERAK_MEDAN

4

98.6957778

3.5837222

22009

222

10 MHz

12-Jan-16

ELIGIBLE

220073

LTE_PERAK_MEDAN

5

98.6957778

3.5837222

22009

223

10 MHz

12-Jan-16

ELIGIBLE

220073

LTE_PERAK_MEDAN

6

98.6957778

3.5837222

22009

224

10 MHz

12-Jan-16

ELIGIBLE

220080

LTE_MC_SIMPANG_GARUDA

4

98.68575

3.5795

22008

192

10 MHz

22-Dec-15

ELIGIBLE

220080


5

98.68575

3.5795

22008

193

10 MHz

22-Dec-15

ELIGIBLE

220080


6

98.68575

3.5795

22008

194

10 MHz

22-Dec-15

ELIGIBLE

220081

LTE_SIMPANG_ASIA_PANDU_(RELOC)

4

98.6878889

3.5823611

22008

195

10 MHz

22-Dec-15

ELIGIBLE

220081


5

98.6878889

3.5823611

22008

196

10 MHz

22-Dec-15

ELIGIBLE

220081


6

98.6878889

3.5823611

22008

197

10 MHz

22-Dec-15

ELIGIBLE

220082

LTE_MC_SUTRISNO_MEDAN

4

98.7018611

3.58225

22009

288

10 MHz

6-Jan-16

ELIGIBLE

220082


5

98.7018611

3.58225

22009

289

10 MHz

6-Jan-16

ELIGIBLE

220082


6

98.7018611

3.58225

22009

290

10 MHz

6-Jan-16

ELIGIBLE

220093

LTE_MULTATULI_MEDAN

4

98.67894

3.579806

22008

189

10 MHz

6-Jan-16

ELIGIBLE

220093

LTE_MULTATULI_MEDAN

5

98.67894

3.579806

22008

190

10 MHz

6-Jan-16

ELIGIBLE

220093

LTE_MULTATULI_MEDAN

6

98.67894

3.579806

22008

191

10 MHz

6-Jan-16

ELIGIBLE

6 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

220095

LTE_GAJAH_GEDE_MEDAN

4

98.6885833

3.5853056

22008

198

10 MHz

18-Dec-15

ELIGIBLE

220095


5

98.6885833

3.5853056

22008

199

10 MHz

18-Dec-15

ELIGIBLE

220095


6

98.6885833

3.5853056

22008

200

10 MHz

18-Dec-15

ELIGIBLE

220098

LTE_ISTANA_MAIMUN_MEDAN

4

98.68439

3.576417

22008

231

10 MHz

22-Dec-15

ELIGIBLE

220098


5

98.68439

3.576417

22008

232

10 MHz

22-Dec-15

ELIGIBLE

220098


6

98.68439

3.576417

22008

233

10 MHz

22-Dec-15

ELIGIBLE

Engineering table information:

Site List Cluster MDN-04.xlsx

Drive Test Methodology “Mobility Assessment”

1.3

Drive test shall be performed under below circumstances:

 

Cluster is barred to ensure only test user camp in the cluster using USIM class 11 HotRod Prioritas profile to be used LTE

No.

Mobile UE

Method

Handset1 Round 1

Round 2

1.4

Idle

Lock LTE

RAT

BAND

KPI Measured

LTE

1800 / 900

RSRP, RSRQ, PCI Plot

HUAWEI E392 (Modem)

Dedicated, continues download

Lock LTE

LTE

1800 / 900

PDCP DL THP, SINR

HUAWEI E392 (Modem)

Dedicated, continues Upload

Lock LTE

LTE

1800 / 900

PDCP UL THP

Handset 1

Dedicated, continues download

Automatic (Unlocked)

2100 / 1800

IRAT HO on edge 4G coverage

WCDMA / LTE

Remark

1 laptop, separated round between UL & DL Test to guarantee single user

1 laptop, separated round between UL & DL Test to guarantee single user

Drive Test Methodology “Stationary Assessment”

Stationary KPI’s will be tested based on the agreed-on methodology with XL team. Cell Edge Performance for Link Budget Verification will be tested on the spot where the RSRP reaches between -115dBm to -120dBm at the edge of a cluster.

1.5

FTP Server Information

FTP Server information

Huawei IP: 202.152.254.235 Username: ftp Password: ftpuser

7 (55)


No.


Checked

Kiki Candra

1.6

Rev

13 Dec 2015

E

Reference

Drive Test tool and Detail

DT Mobility Tools

2

Date

Huawei E392 Samsung Galaxy S4 GENEX Probe v3.15 MSISDN UE : +6285974901395 MSISDN MODEM : +6287889481280

MAP INFORMATION 2.1

Map Information

Fig 1.1. Cluster map information

2.2

Drive test route, cluster border and coverage prediction

Fig. 1.2. Drive Test Route

8 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

1.3. Picture Justification for Inaccessible Route 1 2 3 4 5 6 7

Can't Access To Thamrin Plaza Limitted Access at night Limitted Access at night Limitted Access at night Limitted Access at night Can't Access To Building Can't Access To Building.

Fig 1.3. Coverage Prediction using planning tools

Item Site List, Polygon Border, DT Route and Coverage Prediction match with agreed design

Result Match

Target Must be matched with agreed design

Status Pass

9 (55)


No.


Checked

Kiki Candra

3

Performance Result

3.1

NMS KPI LTE

Date

Rev

13 Dec 2015

E

Reference

Cell KPI Aggregate for 7 days, taken at cell busy hour except for Availability. Availability is measured within 24 hrs in a day. Cell busy hour is defined as the hour when downlink and uplink payload reach the peak value. 21 Feb 2016

Date (Start - End) 3.1.1 No

27 Feb 2016

Availability Name

1

to

Reference

Cell Availability*

> 99.995%

Measured On

Cluster Level 99.936 %

Cell (Aggregated Cluster Level)

Status Pass

*calculates system availability only for acceptance (exclude manual lock due to software upgrade, etc)

3.1.2 No

Accessibility Name

Measured On

Cluster Level

1

Session Setup Success Rate

> 99%


99.721 %

2

RRC Setup Success Rate

> 98%


99.94 %

3.1.3 No

Reference

Session Abnormal Release Rate

3.1.4 No

Status Pass Pass

Retainability Name

1

1 2

Reference

< 1.4%

Measured On Cell (Aggregated Cluster Level)

Cluster Level 0.23 %

Status Pass

Integrity Name UL Packet Loss (PDCP ) DL Packet Loss (PDCP )

Reference

Measured On

Cluster Level

Status

< 1e-6% < 1e-6%

Cell (Aggregated Cluster Level) Cell (Aggregated Cluster Level)

5.4E-05 7.6E-06

Not Pass Not Pass


56.06 Mbps

Info only*

3

Downlink User Throughput (Peak)*

> 15 Mbps (3 MHz) > 50 Mbps (10 MHz) > 75 Mbps (15 MHz)

4

Uplink User Throughput (Peak)*



24.44 Mbps

Info only*

5

Downlink User Throughput (Average)*

> 5.1 Mbps (3 MHz) > 17 Mbps (10 MHz) > 25.5 Mbps (15 MHz)


10.79 Mbps

Info only*

6

Uplink User Throughput (Average)*



5.03 Mbps

Info only*

7

DL Uu Latency

* Depend on user behavior

< 8 ms


No NMS counter available

Counter DL Uu Latency will be available in eRAN 8.0 in Q1 2016, Free of Charge.

10 (55)


No.


Checked

Kiki Candra

3.1.5

Date

Rev

13 Dec 2015

E

Reference

Mobility

No

Name

Reference

Measured On

1

Handover Success Rate Intra-Frequency

> 98%


99.77 %

2

Handover Success Rate Inter-Frequency

> 98%


N/A

3

Handover Success Rate Inter-RAT (IRATHO, not RwR)

> 95%


96.00 %

3.1.6 No

Reference

Maximum eNodeB CPU Utilization

3.1.7 No

Status Pass Only one frequency configuration on this cluster Pass

Utilization Name

1

Cluster Level

< 70%

Measured On

Cluster Level

eNodeB (Aggregated Cluster Level)

20 %

Status Pass

CSFB Name

Reference

Measured On

Cluster Level

Status


N/A

1

Voice - Outgoing Call Setup Time

5s


2

Voice - Outgoing Call Setup Success Rate

> 97%


99.96 %

Pass

3

Voice - Incoming Call Setup Time

3.5 s



N/A

4

Voice - Incoming Call Setup Success Rate

> 97%


99.96 %

Pass

5

Voice - Time to Return to LTE

5s



N/A

> 97%



N/A

6

3.1.8

Voice - Return to LTE Success Rate

Traffic Name

Ref

Cluster Level in a week

UL Volume (Gigabyte)

Information only

97.775 Gb

DL Volume (Gigabyte)

Information only

1012.126 Gb

3.2 3.2.1

Drive Test KPI Coverage Map Accuracy

No

Name

Reference

Result

Status

RSRP plot from coverage prediction overlaid by drive test results Comparation between RSRP from coverage prediction with RSRP from MR data

Must match for 90% of sample. The difference shall not be > 3 dB

Pass

Pass

No MR data

N/A

N/A

3

RSRP >= -115 dBm

> 95% area on the cluster

100 %

Pass

4

SINR >= 0

> 90% area on the cluster

99.15 %

Pass

1 2

*Note: MR will be provided after OSS is patched (after network freeze)

11 (55)


No.


Checked

Kiki Candra

3.2.1.1

Date

Rev

13 Dec 2015

E

Reference

RSRP Coverage Prediction vs RSRP Plot

A histogram to be generated to correlate the Design Prediction Vs DT measurements with a tolerance off ±3dB

RSRP Criteria (dBm) RSRP >=-85 -90 <= RSRP <-85 -100 <= RSRP <-90 -110 <= RSRP <-100 -115<= DL RSRP <-110 RSRP <-115

Legend

Prediction (90% Sample)

Drive Test (90% Sample)

-93 dBm

-94 dBm

Target Accurate within 90% of area + 3dB

Result Pass

12 (55)


No.


Checked

Kiki Candra

3.2.1.2

Date

Rev

13 Dec 2015

E

Reference

RSRP Coverage Prediction vs RSRP MR Data

A histogram to be generated to correlate the Design Prediction vs MR measurements with a tolerance off ±3dB *Note: MR will be provided after OSS is patched (after network freeze)

RSRP Coverage Prediction

RSRP MR Data Result

N/A

Prediction (90% Sample)

MR Data (90% Sample)

Target

Result

-94 dBm

N/A

Accurate within 90% of area + 3dB

Pass with Note

13 (55)


No.


Checked

Kiki Candra

3.2.1.3

Date

Rev

13 Dec 2015

E

Reference

RSRP

Min Value (dBm) -85 -90 -100 -110 -115 -Infinity

RSRP Criteria (dBm) DL RSRP (dBm)>=-85 -90<=DL RSRP (dBm)<-85 -100<=DL RSRP (dBm)<-90 -110<=DL RSRP (dBm)<-100 -115<=DL RSRP (dBm)<-110 DL RSRP (dBm)<-115

Max Value (dBm) Infinity -85 -90 -100 -110 -115

Percentage (%) 56.77% 21.54% 20.15% 1.54% 0.00% 0.00%

Legend

RSRP Plot >= -115 dBm Result

Target

Result

100.00%

In 95% of cluster, the RSRP must be >= -115 dBm

Pass

CDF Plot :

14 (55)


No.


Checked

Kiki Candra

3.2.1.4

Date

Rev

13 Dec 2015

E

Reference

SINR

Min Value (dB) 20 10 5 0 -5 -Infinity

SINR Criteria (dB) SINR (dB)>=20 10<=SINR (dB)<20 5<=SINR (dB)<10 0<=SINR (dB)<5 -5<=SINR (dB)<0 SINR (dB)<-5 SINR > 0

Criteria SINR Plot >= 0 Result Low SINR (<5) found near site (+ 200m)

CDF Plot :

Result 99.15% Not found

Max Value (dB) Infinity 20 10 5 0 -5

Percentage (%) 20.42% 53.32% 19.32% 6.09% 0.85% 0.00% 99.15%

Target In 90% of cluster, the SINR must be >= 0 No low SINR near site

Legend

Pass Result Pass Pass

15 (55)


No.


Checked

Kiki Candra

3.2.1.5

Date

Rev

13 Dec 2015

E

Reference

Cell Edge Verification

No

RSRP

longitude

latitude

PCI

Cell LTE throughout

Target

Status

1

-116dBm

98.710258

3.568390

339

4160 kbit/s

> 1000 Kbit/s

Pass

2 3 4 5 6

-120dBm -117dBm -118dBm -115dBm -117dBm

98.718207 98.693911 98.686799 98.690000 98.694000

3.580703 3.568667 3.568909 3.571000 3.572000

303 262 241 214 223

9480 kbit/s 3210 kbit/s 5050 kbit/s 3100 kbit/s 3480 kbit/s

> 1000 Kbit/s > 1000 Kbit/s > 1000 Kbit/s > 1000 Kbit/s > 1000 Kbit/s

Pass Pass Pass Pass Pass

Note : RSRP Level Cell Edge is between -115dBm ~ -120dBm, taken using FTP application. OOKLA and OpenSignal Cell Edge verification:

16 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

No

RSRP

longitude

latitude

PCI

Cell LTE throughout

Target

Status

1

-116dBm

98.710258

3.568390

339

4160 kbit/s

> 1000 Kbit/s

Pass

No

RSRP

longitude

latitude

PCI

Cell LTE throughout

Target

Status

2

-120dBm

98.718207

3.580703

303

9480 kbit/s

> 1000 Kbit/s

Pass

17 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

No

RSRP

longitude

latitude

PCI

Cell LTE throughout

Target

Status

3

-117dBm

98.693911

3.568667

262

3210 kbit/s

> 1000 Kbit/s

Pass

No

RSRP

longitude

latitude

PCI

Cell LTE throughout

Target

Status

4

-118dBm

98.686799

3.568909

241

5050 kbit/s

> 1000 Kbit/s

Pass

18 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

No

RSRP

longitude

latitude

PCI

Cell LTE throughout

Target

Status

5

-115dBm

98.690000

3.571000

214

3100 kbit/s

> 1000 Kbit/s

Pass

No

RSRP

longitude

latitude

PCI

Cell LTE throughout

Target

Status

6

-117dBm

98.694000

3.572000

223

3480 kbit/s

> 1000 Kbit/s

Pass

19 (55)


No.


Checked

Kiki Candra

3.2.2 No 1

2

3

4

5

Date

Rev

13 Dec 2015

E

Reference

Capacity Name Single User Downlink / Uplink TCP Throughput* Excellent Criteria: RSRP ≥ -80 dBm, SINR ≥ 28 dB Single User Downlink / Uplink TCP Throughput* Good Criteria: -80 dBm > RSRP ≥ -90 dBm, 28 dB > SINR ≥ 18 dB Single User Downlink / Uplink TCP Throughput* Medium Criteria: -90 dBm > RSRP ≥-100 dBm, 18 dB > SINR ≥ 8 dB Single User Downlink / Uplink TCP Throughput* Minimum Criteria: -100 dBm > RSRP ≥ -110 dBm, 8 dB > SINR ≥ 0dB Downlink TCP / UDP Cell Peak Capacity with 2 Ue’s (SUM)

Reference DL > 75 Mbps (15 MHz) UL > 9 Mbps (15 MHz) DL > 50 Mbps (10 MHz) UL > 6 Mbps (10 MHz) DL > 15 Mbps (3 MHz) UL > 1.8 Mbps (3 MHz) DL > 30 Mbps (15 MHz) UL > 4.5 Mbps (15 MHz) DL > 20 Mbps (10 MHz) UL > 3 Mbps (10 MHz) DL > 6 Mbps (3 MHz) UL > 0.9 Mbps (3 MHz) DL > 15 Mbps (15 MHz) UL > 1.5 Mbps (15 MHz) DL > 10 Mbps (10 MHz) UL > 1 Mbps (10 MHz) DL > 3 Mbps (3 MHz) UL > 0.3 Mbps (3 MHz) DL > 3 Mbps (15 MHz) UL > 0.75 Mbps (15 MHz) DL > 2 Mbps (10 MHz) UL > 0.5 Mbps (10 MHz) DL > 0.6 Mbps (3 MHz) UL > 0.15 Mbps (3 MHz) Total > 105.4 Mbps (15 MHz) Total > 70.3 Mbps (10 MHz) Total > 21.2 Mbps (3 MHz)

Measured On

Average value of 90% sample

Status

40.672 Mbps / 20.17 Mbps

Not Pass

26.31Mbps / 19.22 Mbps

Pass

13.99 Mbps / 15.93 Mbps

Pass

Cell

Cell

Cell

Cell 6.97 Mbps / 7.60 Mbps

Pass

75.41 Mbps

Pass

Cell

*Guideline on how to measure point 1 – 4 : (1) Use USIM Class 11 with HotRod Prioritas 50 Gb profile (MBRD 150 Mbps, MBRU 75 Mbps) (2) Cell is barred so that only single user is camping in particular cluster. (3) Perform FTP big file upload and download during mobility test then measured Downlink and Uplink throughput (4) Export the result of PCI, RSRP, SINR, DL Thp and UL Thp (5) Take out PCI which having external transmission backhaul dependency (e.g. not yet upgraded to 78 Mbps for Prime & Eligible sites) (6) Classify each filtered sample into 4 different radio condition (7) Calculate 90% of best sample then average the DL Thp and UL Thp as the final result.

20 (55)


No.


Checked

Kiki Candra

3.2.3 No

Date

Rev

13 Dec 2015

E

Retainability Reference

Measured On

Value

Status

< 1.4%

Cell / Cluster

0.0%

Pass

Name

Referenc e

Measured On

Value

Statu s

1


> 99%

Cell / Cluster

100%

Pass

2


> 98%

Cell / Cluster

100%

Pass

Reference

Measured On

Value

Status

≤5s

Cell / Cluster

2.65 s

Pass

> 97%

Cell / Cluster

100%

Pass

≤ 3.5 s

Cell / Cluster

2.40 s

Pass

> 97%

Cell / Cluster

100%

Pass

≤5s

Cell / Cluster

2.1 s

Pass

> 97%

Cell / Cluster

100%

Pass

1

Name Session Abnormal Release Rate

3.2.4 No

3.2.5 No 1 2 3 4 5 6

Reference

Remark Averaging from SSA DT Result

Accessibility Remark Averaging from SSA DT Result Averaging from SSA DT Result

CSFB Name Voice - Outgoing Call Setup Time Voice - Outgoing Call Setup Success Rate Voice - Incoming Call Setup Time Voice - Incoming Call Setup Success Rate Voice - Time to Return to LTE Voice - Return to LTE Success Rate

Remark

The value is derived by averaging SSA stationary test result

21 (55)


No.


Kiki Candra

Checked

Date

Rev

13 Dec 2015

E

Reference

Guideline on CSFB calculation : (a) Voice - Outgoing Call Setup Time is measured as follow (KPI target remains same ≤ 5s) :

(b) voice-Incoming Call Setup Time is measured as follow (KPI target remains same ≤ 3.5s)

22 (55)


No.


Checked

Kiki Candra

3.2.6 No 1

Name

2 3

DL Packet Loss (PDCP )*

5

Downlink Peak User Throughput** Uplink Peak User Throughput**

6 Downlink Average User Throughput** 7

8

Rev

13 Dec 2015

E

Reference

Integrity

RTT Packet Delay (ping) 32/1000* UL Packet Loss (PDCP )*

4

Date

Uplink Average User Throughput**

Reference

Measured On

<= 20 ms / 30 ms

Cell

< 1e-6

Cell

73.19ms/ 83.17ms 0

< 1e-6 > 15 Mbps (3 MHz) > 50 Mbps (10 MHz) > 75 Mbps (15 MHz) > 4 Mbps (3 MHz) > 15 Mbps (10 MHz) > 25 Mbps (15 MHz) > 5.1 Mbps (3 MHz) > 17 Mbps (10 MHz) > 25.5 Mbps (15 MHz) > 3 Mbps (3 MHz) > 10 Mbps (10 MHz) > 15 Mbps (15 MHz)

Cell

0

Pass

Cell

40.66 Mbps

Not Pass

Cell

28.50 Mbps

Pass

Cell / Cluster

9.02 Mbps

Not Pass

Cell / Cluster

21.20 Mbps

Pass

Cell

3.76 ms

Pass

Jitter (Uplink and Downlink)*

< 50 ms

Value

Status Not Pass Pass

*Stationary test. For PAC is derived from SSA average result (after rectification) **Using drive test method

3.2.7 No

Mobility Name Handover Success Rate Intra-Frequency Handover Success Rate Inter-Frequency Handover Success Rate Inter-RAT

1 2 3

3.2.8 No

Ref

Measured On

Value

Status

> 98%

Cell / Cluster

100%

Pass

> 98%

Cell / Cluster

N/A

N/A

Only one frequency configuration in this cluster

> 95%

Cell / Cluster

N/A

N/A

Not Happened in DT

Remark

Functional Name

1

Downlink QoS Test

2

Downlink GBR / NGBR Test

Method One UE in excellent, one UE in medium, and one UE in bad positions, all with same priority. One additional UE with higher priority is inserted, under different conditions One UE in excellent, one UE in medium and one UE in bad positions, all with same priority and GBR. One additional UE with higher priority but NGBR is inserted, under different conditions.

Measured On Cluster

Cluster

Status OK

N/A. No GBR/NGBR product is available

23 (55)


No.


Checked

Kiki Candra

3.2.8.1

Date

Rev

13 Dec 2015

E

Downlink QoS Test

Test Result HotRod Priority speed (higher QoS) is higher than Super Hotrod (lower QoS) 3.2.9

Reference

Status Pass

PCI Plot

PCI plot is provided for information only. Cross-feeder has been checked during SSA

24 (55)


No.


Checked

Kiki Candra

3.2.10

Date

Rev

13 Dec 2015

E

Reference

RSRQ

*RSRQ is provided for information only.

Min Value (dB) -6 -9 -11 -14 -Infinity

RSRQ Criteria (dB) RSRQ (dB)>=-6 -9<=RSRQ (dB)<-6 -11<=RSRQ (dB)<-9 -14<=RSRQ (dB)<-11 RSRQ (dB)<-14

Max Value (dB) Infinity -6 -9 -11 -14

Percentage (%) 1.57% 68.62% 29.38% 0.44% 0.00%

Legend

25 (55)


No.


Checked

Kiki Candra

3.2.11

Date

Rev

13 Dec 2015

E

Reference

PS DL Throughput

Min Value (Mbps) 30 20 10 5 0

DL Throughput (Mbps) DL Throughput (Mbps)>=30 20<=DL Throughput (Mbps)<30 10<=DL Throughput (Mbps)<20 5<=DL Throughput (Mbps)<10 0

Item Average DL Throughput Found low DL Throughput ( < 5 Mbps) near site ( + 200m)

Max Value (Mbps) Infinity 30 20 10 5

Test Result Mbps

20.677

Not Found

Percentage (%) 13.81% 30.91% 41.39% 12.34% 1.55%

Target Info only No low DL throughput near site

Legend

Status Info Pass

26 (55)


No.


Checked

Kiki Candra

3.2.12

Rev

13 Dec 2015

E

Reference

Max Value (Mbps) Infinity 15 10 5 2

Percentage (%) 67.36% 20.10% 11.36% 0.83% 0.34%

PS UL Throughput

Min Value (Mbps) 15 10 5 2 0

UL Throughput (Mbps) UL Throughput (Mbps)>=15 10<=UL Throughput (Mbps)<15 5<=UL Throughput (Mbps)<10 2<=UL Throughput (Mbps)<5 0

Item

Target

Average UL Throughput

Info only

Found low UL Throughput ( < 2 Mbps) near site ( + 200m) 3.2.13

Date

No low UL throughput near site

Test Result 16.781

Legend

Status

Mbps

Info

Not Found

Pass

Event Failed

EVENT FAIL MDN_04.csv

Item Found event failed report

Target No event failed is detected

Test Result Not Found

Status Pass

27 (55)


No.


Checked

Kiki Candra

3.2.14

Min Value (dBm) -85 -90 -100 -110 -115 -Infinity

Rev

13 Dec 2015

E

Reference

Low RSRP near site (+ 200m)

Percentage(%) RSRP Criteria (dBm) DL RSRP (dBm)>=-85 -90<=DL RSRP (dBm)<-85 -100<=DL RSRP (dBm)<-90 -110<=DL RSRP (dBm)<-100 -115<=DL RSRP (dBm)<-110 DL RSRP (dBm)<-115

Item Found low RSRP (<110 dBm) near site ( + 200m) 3.2.15

Date

Max Value (dBm) Infinity -85 -90 -100 -110 -115

Legend 56.77% 21.54% 20.15% 1.54% 0.00% 0.00%

Target

Result

Status

No low RSRP near site

Not Found

Pass

Sleeping Cell Identification

TRAFIC CLUSTER MDN_04.xlsx

Item Sleeping cell identification

Target No sleeping cell

Result Sleeping Cell is Not Found

Status Pass

28 (55)


No.


Checked

Kiki Candra

3.2.16

Rev

13 Dec 2015

E

Reference

External Interference Identification

Item External Interference Identification

3.2.17

Date

Result No external interference found

Status Info

Bad Spot Analysis

RSRP Coverage Comparison:

SUMMARY : RSRP Plot >= -110 dBm Result BEFORE

AFTER

100.00%

100.00%

Target

Result

In 95% of cluster, the RSRP must be >= -110 dBm

Pass

29 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

SINR Coverage Comparison :

SUMMARY : RSRP Plot >= -115 dBm Result BEFORE

AFTER

97.81%

99.15%

Target In 90% of cluster, the SINR must be >= 0

Result Pass

PDCP DL Coverage Comparison :

SUMMARY : PDCP DL must be >= 5 Mbps Result BEFORE

AFTER

65.01%

98.45%

Target The PDCP DL must be >= 5 Mbps

Result Pass

30 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

Below activities are carried out to resolve it: Spot No. 1

2

3

4

5

6

7

8

9

10

11

12

13

Spot Type

Bad Spot Description

-Low SINR and low coverage from site -Poor SINR 422C198E_LTE_MEGA_MAS sector 2 -Poor PDCP DL -Poor RSRP -Poor SINR -Poor DL Throughput

Low SINR and low coverage from site MC4222586E_LTE_MC_SUTRISNO_MEDAN sector 1

- Low RSRP, SINR due to Overshooting from site 422C199E_LTE_SUN_YAT_SEN sector 1 with distance 1.235 km , - Low RSRP, SINR due to Overshooting from site MC422C297E_LTE_MC_ASIA_MEGAMAS sector 2 with -Poor RSRP distance 0.915 km -Poor SINR - Low RSRP, SINR due to Overshooting from site -Poor PDCP DL 4223714E_LTE_SUTRISNO_BARAT sector 1 with distance 0.697 km , - Low SINR and low coverage from site 4223053E_LTE_PURI_MEDAN sector 1. -Poor RSRP -Poor SINR -Poor DL Throughput -Poor RSRP -Poor SINR -Poor DL Throughput -Poor RSRP -Poor SINR -Poor DL Throughput -Poor RSRP -Poor SINR -Poor DL Throughput -Poor SINR -Poor DL Throughput -Poor SINR -Poor DL Throughput -Poor RSRP -Poor SINR -Poor DL Throughput -Poor RSRP -Poor SINR -Poor DL Throughput -Poor RSRP -Poor SINR -Poor DL Throughput -Poor RSRP -Poor SINR -Poor DL Throughput

Recommendation

Implemented

-422C198E_LTE_MEGA_MAS sector 2 Downtilt ET form 4 to 7

Done

-MC4222586E_LTE_MC_SUTRISNO_MEDAN sector 1 Downtilt ET form 3 to 5

Done

-422C199E_LTE_SUN_YAT_SEN sector 1 Downtilt ET 0 to 4 -MC422C297E_LTE_MC_ASIA_MEGAMAS sector 2 Downtilt ET 0 to 2 -4223714E_LTE_SUTRISNO_BARAT sector 1 Downtilt ET 0 to 6 -4223053E_LTE_PURI_MEDAN sector 1 Downtilt ET form 0 to 4

Done

Low SINR and low coverage from site MC4222586E_LTE_MC_SUTRISNO_MEDAN sector 2

-MC4222586E_LTE_MC_SUTRISNO_MEDAN sector 2 Downtilt ET form 3 to 5

Done

Low SINR and low coverage from site 4223714E_LTE_SUTRISNO_BARAT sector 3

-4223714E_LTE_SUTRISNO_BARAT sector 3 Downtilt ET form 0 to 6

Done

Low SINR and low coverage from site 4222541E_LTE_KOTA_MATSUM_MEDAN sector 3

-M4222541E_LTE_KOTA_MATSUM_MEDAN sector 3 Downtilt ET form 5 to 7

Done

Low SINR and low coverage from site 422C199E_LTE_SUN_YAT_SEN sector 3

-422C199E_LTE_SUN_YAT_SEN sector 3 Downtilt ET form 0 to 8

Done

Low SINR and low coverage from site MC4222582E_LTE_SIMPANG_ASIA_PANDU_(RELOC) sector 2

-MC4222582E_LTE_SIMPANG_ASIA_PANDU_(RELOC) sector 2 Downtilt ET form 6 to 7 & re-azimuth to 190 degree

Done

Low SINR and low coverage from site MC4222581E_LTE_MC_SIMPANG_GARUDA sector 2

-MC4222581E_LTE_MC_SIMPANG_GARUDA sector 2 Uptilt ET form 6 to 3

Done

Low SINR and low coverage from site 4222580E_LTE_SIMPANG_WASPADA sector 3

-4222580E_LTE_SIMPANG_WASPADA sector 3 Downtilt ET form 3 to 4

Done

Low SINR and low coverage from site 4223071E_LTE_KEMALA_MEDAN sector 3

-4223071E_LTE_KEMALA_MEDAN sector 3 Downtilt ET form 2 to 6

Done

Low SINR and low coverage from site 4222541E_LTE_KOTA_MATSUM_MEDAN sector 3

-M4222541E_LTE_KOTA_MATSUM_MEDAN sector 3 Downtilt ET form 5 to 7

Done

Low SINR and low coverage from site 4223072E_LTE_SEI_RENGAS sector 1 & LTE_PERAK_MEDAN Sec.3

-4223072E_LTE_SEI_RENGAS sector 1 Uptilt MT form 10 to 5, LTE_PERAK_MEDAN Sec.3 ET Downtilt 0 to 2

Done

31 (55)


No.


Checked

Kiki Candra

3.2.18

Date

Rev

13 Dec 2015

E

Reference

Physical Tuning Summary

Below are physical tuning activities carried out during optimization process: NEW SITE AND 1ST TIER NEIGHBOR

3.2.19

BEFORE

AFTER

Site ID

Site Name

Cell ID

E/M

E/M

4222541E


6

5/4

7/4

MC4222586E


4

3/2

5/2

MC4222586E


5

3/2

5/2

422C199E

LTE_SUN_YAT_SEN

4

0/0

4/0

422C199E

LTE_SUN_YAT_SEN

6

0/2

8/2

4223714E

LTE_SUTRISNO_BARAT

4

0/0

6/0

4223714E

LTE_SUTRISNO_BARAT

6

0/0

6/0

422C198E

LTE_MEGA_MAS

5

4/4

7/4

MC422C297E

LTE_MC_ASIA_MEGAMAS

5

0/4

2/4

4223053E

LTE_PURI_MEDAN

4

0/0

4/0

MC4222581E


5

6/3

3/3

4222580E

LTE_SIMPANG_WASPADA

6

3/4

4/4

4223071E_

LTE_KEMALA_MEDAN

6

2/3

6/3

4223072E

LTE_SEI_RENGAS

4

3/8

3/2

Parameter Tuning Summary

There are no parameter tuning on 2G and 3G Below are parameters changed on LTE during optimization activity: MO Object

INTERRATHOCOMMGROUP

INTERRATHOUTANGROUP

CELLRESEL

Parameter

Value

InterRatHoA1A2Hyst

2

InterRatHoA1ThdRsrp

-113

InterRatHoA2ThdRsrp

-115

InterRatHoA1A2TimeToTrig

640ms

InterRatHoUtranB1ThdRscp

-85

InterRatHoUtranB1Hyst

2

InterRatHoUtranB1TimeToTrig

320ms

SNonIntraSearchQ

4

SNonIntraSearch

6

ThrshServLow

6

32 (55)


No.


Checked

Kiki Candra

4

Date

Rev

13 Dec 2015

E

Reference

NMS KPI RAN LTE TREND Availability


Cell Availability degraded 25February due to alarm Cell Unavailable fault at site MC2222582_SimpangAsiaPandu

Session Setup SR is maintained above reference value 99%; Degrade due to Availability degraded (inline)


Session Abnormal Release Rate

RRC Setup Success Rate is maintained above reference value 98%

Session Abnormal Release Rate is maintained below reference value 1.4%

33 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

UL/DL PDCP Packet Loss

Downlink Average Cell Throughput

PDPCP UL/DL Packet Loss performance is above reference value 1e-6.

Cell DL Throughput Maximum is 56.06 Mbps

Uplink Average Cell Throughput

HOSR Intra-frequency

Cell UL Throughput Maximum is 24.43 Mbps

Handover Success Rate Intra Frequency is maintained above reference value 98%

IRAT-HO SR

Processor Load

Handover Success Rate Inter-RAT is maintained above reference value 95%; Degraded since 26 February due to Double Configuration of EARFCN

eNodeB processor load maximum is lower than 70%.

34 (55)


No.


Checked

Kiki Candra

5

Date

Rev

13 Dec 2015

E

Reference

KPI 2G & 3G

Drive Test is out of LTE vendor scope of work, hence the 2G & 3G DT KPI would be reviewed during quarterly Drive Test with PTHS. Therefore, the 2G & 3G aspect only review the NMS KPI, plus MRR data of 3G in PAC report. The target for NMS KPI is maintained of improved, comparing the best week (within 3 weeks) after Frequency Carving/TRX Shutdown versus the week when PAC is collected. 2G & 3G nodes involved are applicable for nodes which are inside LTE polygon, regardless they have collocated LTE installed or not. All KPI, except availability are calculated during busy hour-payload UL+DL daily, averaged within a week. Availability is monitored 24 hr daily.

5.1

List of 2G & 3G sites inside LTE Polygon : SITE ID 3053L2 3070 3071 3072 2222541 2222580 2223121 2223121L1 2223717 2222581MC 222C227 222C230 222PC020 C199 MC2223794 MC222C294 MC502 MC506 MC510 PC253 222PC070 PX086 MC5515 PX095 PX096 MC2222582 3222541G 3222586G 3223121G 3223714G 3223717G 322C227G 322C230G 322MC502G 322MC506G 322MC510G 322MC5515G

SITE NAME 3053L2_PuriMedan3 3070_AURMEDAN 3071_KEMALAMEDAN 3072_SEIRENGAS 2222541_KotaMatsumMedan 2222580_SimpangWaspada 2223121_Bromomedan 2223121L1_BromoMedan2 2223717_RSMethodist Medan 2222581MC_MC_SimpangGaruda 222C227_PasarMerahTimur 222C230_PerakMedan_2G 222PC020_HotelHermes Medan C199_SunYatSen MC2223794_GajahGedeMedan MC222C294_SurabayaMedan MC502_SINARBARUMEDAN MC506_GANDHISUTRISNO MC510_GANDHISUTOMO PC253_NovotelMedan 222PC070_HotelGrand Sirao PX086_GARUDACITRA MC5515_PerumMegamas PX095_GarudaPlaza PX096_RSUPERMATABUNDA MC2222582_SimpangAsiaPandu 3222541G_3G_KOTA_MATSUM_MEDAN 3222586G_3G_MC_SUTRISNO_MEDAN 3223121G_3G_BROMO_MEDAN 3223714G_3G_SUTRISNO_BARAT 3223717G_3G_RS_METHODIST_MEDAN 322C227G_3G_PASAR_MERAH_TIMUR 322C230G_3G_PERAK_MEDAN 322MC502G_3G_SINAR_BARU_MEDAN 322MC506G_3G_GANDHI_SUTRISNO 322MC510G_3G_GANDHI_SUTOMO 322MC5515G_3G_PERUM_MEGAMAS

Long

Lat

98.697 98.6801 98.6881 98.6918 98.6951 98.6821 98.7063 98.7063 98.6926 98.6857 98.6832 98.6958 98.6816 98.6915 98.6886 98.6853 98.6826 98.7036 98.6883 98.6833 98.6863 98.6873 98.7048 98.686 98.6853 98.6875 98.6951 98.7019 98.7063 98.699 98.6926 98.6832 98.6958 98.6826 98.7036 98.6883 98.7029

3.5793 3.57653 3.57561 3.58656 3.57593 3.58106 3.57533 3.57533 3.58356 3.5795 3.57253 3.58372 3.58197 3.58167 3.58531 3.58286 3.58114 3.58205 3.58152 3.5825 3.58323 3.57753 3.5845 3.57831 3.58042 3.58231 3.57593 3.58225 3.57533 3.58244 3.58356 3.57253 3.58372 3.58114 3.58206 3.58153 3.58475

Network

LTE Site ID Colocation

2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 2G 3G 3G 3G 3G 3G 3G 3G 3G 3G 3G 3G

4223053E 4223070E 4223071E 4223072E 4222541E 4222580E 4223121E 4223121E 4223717E MC4222581E 422C227E 422C230E Non Colo 422C199E MC4223794E Non Colo Non Colo Non Colo Non Colo Non Colo 422PC070E Non Colo Non Colo Non Colo Non Colo MC4222582E 4222541E MC4222586E 4223121E 4223714E 4223717E 422C227E 422C230E Non Colo Non Colo Non Colo Non Colo

35 (55)


No.


Checked

Kiki Candra

322PC020G 322PC070G 322PC253G 322PX086G 322PX095G 322PX096G E136G E144G E724G 322EG18G E718G E722G E723G MC3222580G MC3222581G MC3222582G MC3223772G MC3223794G MC3223805G MC322C294G MC3223619G

322PC020G_3G_HOTEL_HERMES_MEDAN 322PC070G_3G_HOTEL_GRAND_SIRAO 322PC253G_3G_NOVOTEL_MEDAN 322PX086G_3G_GARUDA_CITRA_HOTEL 322PX095G_3G_GARUDA_PLAZA 322PX096G_3G_RSU_PERMATA_BUNDA E136G_3G_SUN_YAT_SEN E144G_3G_MEGA_MAS_MEDAN E724G_3G_SEI_RENGAS 322EG18G_3G_SEI_MERAH E718G_3G_PURI_MEDAN E722G_3G_AUR_MEDAN E723G_3G_KEMALA_MEDAN MC3222580G_3G_MC_SIMPANG_WASPADA MC3222581G_3G_MC_SIMPANG_GARUDA MC3222582G_3G_MC_ASIA_PANDU_MEDAN MC3223772G_3G_MULTATULI_MEDAN MC3223794G_3G_GAJAH_GEDE_MEDAN MC3223805G_3G_ISTANA_MAIMUN_MEDAN MC322C294G_3G_MC_SURABAYA_MEDAN MC3223619G_3G_MC_PETUMBAK_TIMUR

Date

Rev

13 Dec 2015

E

98.6817 98.6863 98.6833 98.6873 98.686 98.6853 98.6915 98.7073 98.6918 98.697 98.697 98.6801 98.6881 98.6821 98.6857 98.6879 98.6789 98.6886 98.6844 98.6853 98.6833

Item Site List 2G & 3G inside the polygon is matched with actual

5.2

Result Match

3.58211 3.58323 3.5825 3.57753 3.57831 3.58042 3.58167 3.58211 3.58655 3.5793 3.5793 3.57653 3.57561 3.58106 3.5795 3.58236 3.57981 3.58531 3.57642 3.58283 3.5825

3G 3G 3G 3G 3G 3G 3G 3G 3G 3G 3G 3G 3G 3G 3G 3G 3G 3G 3G 3G 3G

Reference

Non Colo 422PC070E Non Colo Non Colo Non Colo Non Colo 422C199E 422C198E 4223072E Non Colo 4223053E 4223070E 4223071E 4222580E MC4222581E MC4222582E MC4223772E MC4223794E MC4223805E Non Colo Non Colo

Target Must be matched with actual

Status Pass

NMS 2G

KPI Assignment Success Rate Perceive Drop Rate Perceive Congestion Rate SDCCH Drop Rate SDCCH Congestion Rate SDCCH Success Rate TBF Failure Rate Cell Availability HO Success Rate

Baseline Week (W-38)

Current Week (W-49)

Comments* Maintained Maintained Maintained Maintained Maintained Maintained Improved Maintained Maintained

Result** Pass Pass Pass Pass Pass Pass Pass Pass Pass

* Fill comments with : Degraded or Maintained or Improved according to current week compared with baseline ** Fill result with Pass if the KPI is maintained or improved, and Not Pass if it gets degraded

36 (55)


No.


Checked

Kiki Candra

5.3

Date

Rev

13 Dec 2015

E

Reference

NMS 3G

KPI

Baseline Week (W-38)

Current Week (W-49)

RRC Success Rate Speech Access Rate PS Access Rate Speech Drop Rate PS Drop Rate RAB Congestion Cell Availability SHO Success Rate

Comments*

Result**

Maintained Maintained Maintained Maintained Maintained Maintained Maintained Maintained

Pass Pass Pass Pass Pass Pass Pass Pass

* Fill comments with : Degraded or Maintained or Improved according to current week compared with baseline ** Fill result with Pass if the KPI is maintained or improved, and Not Pass if it gets degraded

5.4

MRR 3G

During LTE Optimization process, some physical tuning might be executed to enhance LTE quality. While in some sites, the antenna is shared between 3G and LTE. Therefore, LTE vendor must provide the MRR before and after physical tuning is executed. The CPICH RSCP must be maintained, or if due to less sample, the deviation of 2% is accepted.

Criteria CPICH RSCP >= -110 dBm

Before 100%

After 100%

Comments Improved

Target Maintained or improved

Result Pass

* Fill comments with : Degrade or Maintain or Improve according to current week compared with baseline (a week before tuning is executed)

37 (55)


No.


Checked

Kiki Candra

6

Date

Rev

13 Dec 2015

E

Reference

PUNCHLIST FROM SSA

Punch list is defined as the list of items that are not pass during SSA stage due to limitation on XL side (e.g. USIM class 11 was not ready, AO Profile of HotRod priority was not ready, Transmission backhaul upgrade was not completed, etc). Vendor must retest again the “Non Pass” items using below method: a) Use USIM class 11 with HotRod Prioritas profile (MBRD 150 Mbps, MBRU 75 Mbps) b) Make sure all cells within eNB are unlocked in cell barred, therefore only 1 UE attach c) Use SSA Rev.G for validation (Speed is stable 50 Mbps + 10% within 30 sec) d) Get the acknowledgement from PTHS Optim Region that issues have already been solved and result is above threshold If the result is still below target, vendor has to perform necessary cluster tuning, troubleshooting and optimization. If still could not meet the target due to external issues (e.g. Transmission backhaul capacity limitation, etc) the justification must be provided. LTE_SUTRISNO_BARAT Before rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass

DL Single User Throughput (Max)

24 Mbps

13.80 Mbps

50 Mbps stable, plus minus 10%, within 20 sec

Not Pass

23.2 Mbps

UL Single User Throughput (Max)

10.00 Mbps

10.30 Mbps


Not Pass

9.80 Mbps

69.69 Mbps

65.22 Mbps

UDP Can 50 Mbps (with 10% tolerance)

Pass

60.49 Mbps

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


59.6 Mbps

56.1 Mbps


Pass

52.3 Mbps


21.2 Mbps

21.1 Mbps


Pass

21.7 Mbps

-

-


UDP (Mbps)

After rectification Functionality Stationary Test (10 times)

UDP (Mbps) -

-

38 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

LTE_ISTANA_MAIMUN_MEDAN Before rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


18.80 Mbps

35.10 Mbps


Not Pass

35.70 Mbps


25.80 Mbps

25.00 Mbps


Pass

24.90 Mbps

Pass

64.84 Mbps

58.25 Mbps

46.36 Mbps


Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


59.2 Mbps

58.4 Mbps


Pass

61.1 Mbps


22.8 Mbps

20.9 Mbps


Pass

24.90 Mbps


-

UDP (Mbps)


UDP (Mbps) -

-

-

Sec 1

Sec 2

Sec 3

LTE_PURI_MEDAN Before Rectification Functionality Stationary Test (10 times)

Ref

Pass / Not Pass


12.10 Mbps

9.90 Mbps

4.70 Mbps


Not Pass


25.50 Mbps

23.3 Mbps

25.10Mbps


Pass

58.69 Mbps

56.09 Mbps

57.53 Mbps


Pass

UDP (Mbps)

After Rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


59.8 Mbps

34 Mbps


Not Pass

59.8 Mbps


22.6 Mbps

21.2 Mbps


Pass

21.5 Mbps

-

61.92 Mbps


Pass

-

UDP (Mbps)

After retest FTP Throughput still can’t meet target but UDP test can achive the target (>50Mbps stable 30s), need to check each link Transport performance between 3053

39 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

Sec 3

Ref

Pass / Not Pass

LTE_KOTA_MATSUM_MEDAN Before rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2


15.70 Mbps

12.00 Mbps

10.80 Mbps


Not Pass


21.30 Mbps

24.50 Mbps

25.00 Mbps


Pass

51.79 Mbps

60.75 Mbps

56.02 Mbps


Pass

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass

Pass

57.2 Mbps


Pass -

UDP (Mbps)

After rectification Functionality Stationary Test (10 times) DL Single User Throughput (Max)

57.1 Mbps


60.2 Mbps

25.9 Mbps

28.5 Mbps

23.8 Mbps


-

-

-


UDP (Mbps)

LTE_KEMALA_MEDAN Before rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


3.7 Mbps

3.90 Mbps

5.40 Mbps


Not Pass


26.00 Mbps

15.70 Mbps

15.90 Mbps


Pass

54.31 Mbps

54.31 Mbps

59.67 Mbps


Pass

UDP (Mbps)

After rectification Functionality Stationary Test (10 times) DL Single User Throughput (Max) UL Single User Throughput (Max) UDP (Mbps)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass

52.9 Mbps

55.8 Mbps


Pass

57.2 Mbps

Pass -

22.9 Mbps

17.5 Mbps

24.3 Mbps


-

-

-


40 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

LTE_GAJAH_GEDE_MEDAN Before Rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


5.50 Mbps

19.50 Mbps

5.10 Mbps


Not Pass


25.90 Mbps

25.90 Mbps

28.50 Mbps


Pass

50.92 Mbps

55.15 Mbps

59.86 Mbps


Pass

UDP (Mbps)


Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


43.2 Mbps

45.8 Mbps


Not Pass

54.8 Mbps


27.2 Mbps

27.5 Mbps


Pass

25.8 Mbps

Pass

68.15 Mbps


UDP (Mbps) -

69.78 Mbps

After retest FTP Throughput still can’t meet target but UDP test can achive the target (>50Mbps stable 30s), need to check each link Transport performance between 3001<>MC3223794G

LTE_AUR_MEDAN Before rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3


6.2 Mbps

1.7 Mbps

2 Mbps


24.8 Mbps

24.1 Mbps

24.2 Mbps

UDP (Mbps)

62.242 Mbps

60.761 Mbps

55.833 Mbps


Pass

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass

Not Pass

Ref 50 Mbps stable, plus minus 10%, within 20 sec 15 Mbps stable, plus minus 10%, within 20 sec

Pass / Not Pass

Not Pass

Pass

After rectification Functionality Stationary Test (10 times) DL Single User Throughput (Max)

42.4 Mbps

37.5 Mbps

67.4 Mbps



20.8 Mbps

20.961 Mbps


Pass

23 Mbps

58.12 Mbps

57.756 Mbps


Pass

57.12 Mbps

UDP (Mbps)

After retest FTP Throughput still can’t meet target but UDP test can achive the target (>50Mbps stable 30s), need to check each link Transport performance between 3070

41 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

LTE_SIMPANG_ASIA_PANDU_(RELOC) Before rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


29.2 Mbps

40.66 Mbps

26.83 Mbps


Not Pass


20.33 Mbps

23 Mbps

20.33 Mbps


Pass

UDP (Mbps)

69.92 Mbps

68.264 Mbps

53.909 Mbps


Pass

Sec 3

Ref

Pass / Not Pass

Not Pass


Sec 1

Sec 2


43.5 Mbps

28.6 Mbps

41 Mbps



26 Mbps

27.7 Mbps


Pass

29.1 Mbps

54.06 Mbps

59.79 Mbps


Pass

63.33 Mbps

UDP (Mbps)

After retest FTP Throughput still can’t meet target but UDP test can achive the target (>50Mbps stable 30s), need to check each link Transport performance between 3001<>MC2222582

LTE_PASAR_MERAH_TIMUR Before Rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


2.6 Mbps

2.7 Mbps

3.6 Mbps


Not Pass


24.6 Mbps

25 Mbps

20.8 Mbps


Pass

UDP (Mbps)

65.991 Mbps

59.983 Mbps

37.658 Mbps


Not Pass

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass Not Pass

After Rectification Functionality Stationary Test (10 times) DL Single User Throughput (Max)

36.4 Mbps

39.6 Mbps

34.7 Mbps



24.84 Mbps

19.20 Mbps


Pass

24.65 Mbps

65.32 Mbps

59.47 Mbps


Pass

70.82 Mbps

UDP (Mbps)

After retest FTP Throughput still can’t meet target but UDP test can achive the target (>50Mbps stable 30s), need to check each link Transport performance between 3070<>222C227

42 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

LTE_BROMO_MEDAN Before Rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


0.4 Mbps

0.8 Mbps

0.7 Mbps


Not Pass


20.7 Mbps

24.1 Mbps

24 Mbps


Pass

UDP (Mbps)

69.764 Mbps

60.128 Mbps

62.916 Mbps


Pass

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass

34.8 Mbps

42.9 Mbps


Not Pass

38 Mbps

Pass Pass

After Rectification Functionality Stationary Test (10 times) DL Single User Throughput (Max) UL Single User Throughput (Max)

21 Mbps

21.7 Mbps

23.3 Mbps


59.45 Mbps

59.53 Mbps

68.98 Mbps


UDP (Mbps)

After retest FTP Throughput still can’t meet target but UDP test can achive the target (>50Mbps stable 30s), need to check each link Transport performance between 3002<>2223121

LTE_HOTEL_GRAND_SIRAO Before Rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


0.561 Mbps

1.8 Mbps

- Mbps


Not Pass


21.2 Mbps

24.4 Mbps

- Mbps

7.5 Mbps stable, plus minus 10%, within 20 sec

Pass

UDP (Mbps)

35.375 Mbps

35.303 Mbps

- Mbps


Pass


Sec 1

Sec 2


35.9 Mbps

36.2Mbps


23 Mbps

30.36 Mbps

UDP (Mbps)

Sec 3

Ref

Pass / Not Pass

- Mbps


Pass

- Mbps

7.5 Mbps stable, plus minus 10%, within 20 sec

Pass


43 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

LTE_SUN_YAT_SEN Before Rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


9.1 Mbps

7.4 Mbps

12.7 Mbps


Not Pass


22.9 Mbps

22.7 Mbps

24.3 Mbps


Pass

UDP (Mbps)

59.503 Mbps

58.376 Mbps

63.54 Mbps


Pass


Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass

34.65 Mbps

32.56 Mbps


Not Pass

29.94 Mbps

Pass Pass

21.45 Mbps

19.65 Mbps

21.37 Mbps


53.92 Mbps

59.79 Mbps

56.21 Mbps


UDP (Mbps)

After retest FTP Throughput still can’t meet target but UDP test can achive the target (>50Mbps stable 30s), need to check each link Transport performance between 3001<>MC2222582<>C199

LTE_MULTATULI_MEDAN Before Rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


0.4 Mbps

3.3 Mbps

2.8 Mbps


Not Pass


0.7 Mbps

3.1 Mbps

1.7 Mbps


Not Pass

UDP (Mbps)

71.235 Mbps

70.566 Mbps

68.908 Mbps


Pass


Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


39.8 Mbps

37.2 Mbps


Not Pass

38.4 Mbps


24.5 Mbps

22.87 Mbps


Pass

25.5 Mbps

60.07 Mbps

59.43 Mbps


Pass

59.56 Mbps

UDP (Mbps)

After retest FTP Throughput still can’t meet target but UDP test can achive the target (>50Mbps stable 30s), need to check each link Transport performance between 3070<>MC3223772G

44 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

LTE_MC_SIMPANG_GARUDA Before Rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


12.6 Mbps

10.9 Mbps

13.2 Mbps


Not Pass


19.8 Mbps

19.1 Mbps

16.7 Mbps


Pass

UDP (Mbps)

69.981 Mbps

68.058 Mbps

60.921 Mbps


Pass


Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


57.1 Mbps

51 Mbps


Pass

51.1 Mbps


19.8 Mbps

16.6 Mbps


Pass

15.8 Mbps


UDP (Mbps)

LTE_MC_SUTRISNO_MEDAN Before Rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


6.9 Mbps

2.2 Mbps

3.1 Mbps


Not Pass


22.7 Mbps

24.1 Mbps

23.8 Mbps


Pass

UDP (Mbps)

70.149 Mbps

70.75 Mbps

69.982 Mbps


Pass

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass

59.6 Mbps

66.7 Mbps


Pass

57.3 Mbps

21.3 Mbps

21.2 Mbps


Pass

21.3 Mbps

After Rectification Functionality Stationary Test (10 times) DL Single User Throughput (Max) UL Single User Throughput (Max) UDP (Mbps)


45 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

LTE_PERAK_MEDAN Before Rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


9.9 Mbps

9.5 Mbps

9.9 Mbps


Not Pass


24.1 Mbps

24.3 Mbps

24.2 Mbps


Pass

UDP (Mbps)

61.257 Mbps

60.563 Mbps

65.059 Mbps


Pass

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass

56.5 Mbps

58 Mbps


Pass

54.7 Mbps

Pass

28.6 Mbps

15 Mbps stable, plus minus 10%, within 20 sec UDP Can 50 Mbps (with 10% tolerance)

Pass


24.7 Mbps

25.9 Mbps

UDP (Mbps)

LTE_RS_METHODIST_MEDAN Before Rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


2 Mbps

3.8 Mbps

2.2 Mbps


Not Pass


24.8 Mbps

23.4 Mbps

24.4 Mbps


Pass

UDP (Mbps)

70.005 Mbps

56.21 Mbps

60.849 Mbps


Pass

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


46.8 Mbps

45.9 Mbps


Not Pass

44 Mbps


24.8 Mbps

24.7 Mbps


Pass

25.9 Mbps

71.9 Mbps

56.2 Mbps


Pass

62 Mbps


UDP (Mbps)

After retest FTP Throughput still can’t meet target but UDP test can achive the target (>50Mbps stable 30s), need to check each link Transport performance between 3002<>3072<>3223717G

46 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

LTE_SIMPANG_WASPADA Before Rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


2.6 Mbps

2.9 Mbps

6.8 Mbps


Not Pass


19.2 Mbps

16.4 Mbps

17 Mbps


Pass

UDP (Mbps)

58.926 Mbps

68.347 Mbps

69.308 Mbps


Pass

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass

37.5 Mbps

37.98 Mbps


Not Pass

44.85 Mbps

Pass Pass


21.25 Mbps

22.05 Mbps

21.97 Mbps


51.66 Mbps

55.57 Mbps

52.839 Mbps


UDP (Mbps)

After retest FTP Throughput still can’t meet target but UDP test can achive the target (>50Mbps stable 30s), need to check each link Transport performance between 3070<>2252580

LTE_SEI_RENGAS Before Rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


2.6 Mbps

9.2 Mbps

3 Mbps


Not Pass


23.2 Mbps

25.2 Mbps

24 Mbps


Pass

UDP (Mbps)

56.522 Mbps

57.862 Mbps

57.027 Mbps


Pass

After Rectification

47 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

LTE_MEGA_MAS Before Rectification Functionality Stationary Test (10 times)

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


1.5 Mbps

0.8 Mbps

2.3 Mbps


Not Pass


23.2 Mbps

24.6 Mbps

21.4 Mbps


Pass

UDP (Mbps)

49.989 Mbps

69.26 Mbps

62.963 Mbps


Not Pass

Sec 1

Sec 2

Sec 3

Ref

Pass / Not Pass


40.4 Mbps

56.9 Mbps


Not Pass

55.9 Mbps


21.3 Mbps

22.6 Mbps


Pass

21.3 Mbps


Pass


UDP (Mbps) 56.59 Mbps

After retest FTP Throughput still can’t meet target but UDP test can achive the target (>50Mbps stable 30s), need to check each link Transport performance between 3049<>C198

48 (55)


No.


Checked

Kiki Candra

7

Date

Rev

13 Dec 2015

E

Issues, Recommendation and Exclusion: Below are the explanation of the KPI that does not meet the target.

Reference

49 (55)


No.


Checked

Kiki Candra

7.1

Date

Rev

13 Dec 2015

E

Reference

KPI RAN LTE

a.) Network Element Availability Rate : 2. MC2222582_SimpangAsiaPandu due to eNodeB Alarm (Cell Unavailable) on 25 February 2016.

b.) Configuration Issue

Double configuration EARFCN 1375 & 3758

50 (55)


No.


Checked

Kiki Candra

7.2

Date

Rev

13 Dec 2015

E

DT KPI LTE All KPI DT already PASS

7.3

KPI 2G & 3G All KPI 2G and 3G Network mostly maintained

Reference

51 (55)


No.


Checked

Kiki Candra

8

Overall KPI Review

8.1

Scoring KPI Category

Design Review LTE, 2G and 3G

NMS LTE

Drive Test LTE

Date

Rev

13 Dec 2015

E

KPI Name

Reference

Result

Weighting

Score

Site List, Polygon Border, DT Route and Coverage Prediction match with agreed design 2G & 3G site list inside polygon

Pass

10

10

Pass

10

10

Cell Availability Session Setup Success Rate RRC Setup Success Rate

Pass Pass Pass

2 1 1

2 1 1

Session Abnormal Release Rate UL Packet Loss (PDCP ) DL Packet Loss (PDCP ) Handover Success Rate Intra-Frequency Handover Success Rate Inter-RAT (IRAT-HO, not RwR) Maximum eNodeB CPU Utilization Voice - Outgoing Call Setup Success Rate Voice - Incoming Call Setup Success Rate RSRP plot from coverage prediction overlaid by drive test results Comparation between RSRP from coverage prediction with RSRP from MR data RSRP > -115 dBm SINR > 0 Cell Edge Verification Single User Downlink / Uplink TCP Throughput - Excellent Criteria Single User Downlink / Uplink TCP Throughput - Good Criteria Single User Downlink / Uplink TCP Throughput - Medium Criteria Single User Downlink / Uplink TCP Throughput - Poor Criteria Downlink TCP / UDP Cell Peak Capacity with 2 Ue’s Session Abnormal Release Rate Session Setup Success Rate RRC Setup Success Rate Voice - Outgoing Call Setup Time Voice - Outgoing Call Setup Success Rate Voice - Incoming Call Setup Time Voice - Incoming Call Setup Success Rate Voice - Time to Return to LTE Voice - Return to LTE Success Rate RTT Packet Delay (ping) 32/1500 UL Packet Loss (PDCP ) DL Packet Loss (PDCP ) Downlink Peak User Throughput Uplink Peak User Throughput

Pass Pass Pass Pass Pass Pass Pass Pass Pass

1 1 1 1 4 1 1 1 6

1 0 0 1 4 1 1 1 6

Pass

6

6

Pass Pass Pass Pass

6 6 2 10

6 6 2 10

Pass

10

10

Pass

10

10

Pass

10

10

Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass

10 1 1 1 1 1 1 1 1 1 1 1 1 10 10

10 1 1 1 1 1 1 1 1 1 1 1 1 10 10

52 (55)


No.


Checked

Kiki Candra

Drive Test LTE

NMS 2G

NMS 3G

MRR 3G Punch list from SSA

8.2 KPI Category

NMS LTE

Drive Test LTE

Date

Rev

13 Dec 2015

E

Reference

Downlink Average User Throughput

Pass

10

10

Uplink Average User Throughput Jitter (Uplink and Downlink) Handover Success Rate Intra-Frequency Handover Success Rate Inter-RAT Downlink QoS Test Found low DL Throughput ( < 5 Mbps) near site ( + 200m) Found event failed report Found low RSRP (<110 dBm) near site ( + 200m) Sleeping cell identification Cell overshooting Assignment Success Rate Perceive Drop Rate Perceive Congestion Rate SDCCH Drop Rate SDCCH Congestion Rate SDCCH Success Rate TBF Failure Rate TCH Availability Cell Availability HO Success Rate RRC Success Rate Speech Access Rate PS Access Rate Speech Drop Rate PS Drop Rate RAB Congestion Cell Availability CS IRAT-HO SR CPICH RSCP < -110 dBm All are revisit and accepted Total Achievement

Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass Pass

10 8 2 4 1 4 1 4 2 4 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 8 10

10 8 2 4 1 4 1 4 2 4 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 8 10 227 99.12%

Information Only KPI Name Downlink User Throughput (Peak) Uplink User Throughput (Peak) Downlink User Throughput (Average) Uplink User Throughput (Average) Voice - Outgoing Call Setup Time Voice - Incoming Call Setup Time Voice - Time to Return to LTE Voice - Return to LTE Success Rate UL Volume (Gigabyte) DL Volume (Gigabyte) PCI Plot RSRQ

Reason Depend on user behavior Depend on user behavior Depend on user behavior Depend on user behavior Info in PAC. In FAC is mandatory Info in PAC. In FAC is mandatory Info in PAC. In FAC is mandatory Info in PAC. In FAC is mandatory Depend on user behavior Depend on user behavior Provided for MOCN/MORAN info Only for info. We refer to SINR for scoring

229

53 (55)


No.


Checked

Kiki Candra

Drive Test LTE NMS LTE

8.3

Average DL Throughput in DT plot External Interference Identification Physical tuning summary Parameter tuning summary NMS KPI Trend

Date

Rev

13 Dec 2015

E

Reference

Already measured in 4 different radio criteria Provided for XL & PTHS to resolve For XL & PTHS reference For XL & PTHS reference Already measured in NMS KPI Trend

Not Applicable

KPI Category NMS KPI NMS KPI Drive Test Drive Test

KPI Name DL Uu Latency Handover Success Rate Inter-Frequency Handover Success Rate Inter-Frequency Downlink GBR / NGBR Test

Reason Available in next eRAN 8.0 release Applicable whereby LTE 900 is installed Applicable whereby LTE 900 is installed Product is not available

We conclude that PAC of Cluster Medan-04 (MDN-04) is:

Pass, accepted Not pass (rejected), need further optimization *Tick one appropriate result

 

54 (55)


No.


Checked

Kiki Candra

Date

Rev

13 Dec 2015

E

Reference

Formula Reference for NMS KPI

9

Huawei’s Formula: No

KPICategory

1 Availability 2 Accessibility

KPIName Network Element Availability RRC Setup Success Rate

3 Accessibility 4 Accessibility 5 Accessibility

S1 SIG (Signaling) ERAB Setup Success Rate Session Setup Success Rate (SSSR)

6 Retainability

Session Abnormal Release Rate / ERAB Drop Rate ULPacketLoss(PDCP)

7 Integrity 8 9 10 11

Integrity Traffic Traffic Traffic

12 Traffic 13 Traffic

DLPacketLoss(PDCP) Downlink Peak User Throughput Uplink Peak User Throughput Maximum PDCP Cell Throughput DL(Mbps) Maximum PDCP Cell Throughput UL(Mbps) Downlink Average User Throughput (Mbps)

Final Formula (1-∑(+)/([TotalNumberofCells]*{SP}*60))*100% ((L.RRC.ConnReq.Succ.Emc+L.RRC.ConnReq.Succ.HighPri+L.RRC.ConnReq.Succ.Mt+L.RRC.ConnRe q.Succ.MoData+L.RRC.ConnReq.Succ.DelayTol)/(L.RRC.ConnReq.Att.Emc+L.RRC.ConnReq.Att.HighP ri+L.RRC.ConnReq.Att.Mt+L.RRC.ConnReq.Att.MoData+L.RRC.ConnReq.Att.DelayTol))x100% 100*(L.S1Sig.ConnEst.Succ/L.S1Sig.ConnEst.Att) (L.E-RAB.SuccEst/L.E-RAB.AttEst)*100% 100*((L.RRC.ConnReq.Succ.Emc+L.RRC.ConnReq.Succ.HighPri+L.RRC.ConnReq.Succ.Mt+L.RRC.Co nnReq.Succ.MoData+L.RRC.ConnReq.Succ.DelayTol)/(L.RRC.ConnReq.Att.Emc+L.RRC.ConnReq.Att. HighPri+L.RRC.ConnReq.Att.Mt+L.RRC.ConnReq.Att.MoData+L.RRC.ConnReq.Att.DelayTol))*(L.S1Sig. ConnEst.Succ/L.S1Sig.ConnEst.Att)*(L.E-RAB.SuccEst/L.E-RAB.AttEst) /(+)*100%

(∑L.Traffic.UL.PktLoss.Loss.QCI.n)/(∑L.Traffic.UL.PktLoss.Tot.QCI.n)*100% (∑L.Traffic.DL.PktUuLoss.Loss.QCI.n)/(∑L.Traffic.DL.PktUuLoss.Tot.QCI.n)*100% No counter is available to measure the Downlink Peak Throughput. No counter is available to measure the Uplink Peak Throughput. Max[L.Thrp.bits.DL.Max/1000000] Max[L.Thrp.bits.UL.Max/1000000] (L.Thrp.bits.DL-L.Thrp.bits.DL.LastTTI)/(L.Thrp.Time.DL.RmvLastTTI*1000)

14 Traffic 15 Traffic 16 Traffic

Uplink Average User Throughput (Mbps) (L.Thrp.bits.UL -L.Thrp.bits.UE.UL.LastTTI)/(L.Thrp.Time.UE.UL.RmvLastTTI*1000) Average PDCPCell Throughput DL(Mbps) (L.Thrp.bits.DL/L.Thrp.Time.Cell.DL.HighPrecision)/1000 Average PDCP Cell Throughput UL(Mbps) (L.Thrp.bits.UL/L.Thrp.Time.Cell.UL.HighPrecision)/1000

17 Mobility

Handover Success Rate Intra-Frequency

18 Mobility

Handover Success Rate Inter-Frequency

19 Mobility

Handover Success Rate Inter-RAT

20 21 22 23 24 25 26 27 28

Maximum eNodeB CPU Utilization Voice - Outgoing Call Setup Time Voice - CSFB Call Setup Success Rate Voice - Incoming Call Setup Time Voice - Time to Return to LTE Voice - Return to LTE Success Rate DL Traffic Volume(MB) UL Traffic Volume(MB) Average Simultaneous RRC Connected UEs Maximum Simultaneous RRC Connected UEs Average Number of Activated UEs in the Uplink in a Cell Maximum Number of Activated UEs in the Uplink in a Cell Average Number of Activated UEs in the Downlink in a Cell Max Number of Activated UEs in the Downlink in a Cell Downlink Resource Block Utilizing Rate Uplink Resource Block Utilizing Rate DL Latency(ms)

Utilization CSFB CSFB CSFB CSFB CSFB Traffic Traffic Traffic

29 Traffic 30 Traffic 31 Traffic 32 Traffic 33 Traffic 34 Utilization 35 Utilization 36 Integrity

INTERFREQ_HO=((L.HHO.IntraeNB.InterFreq.PrepAttOut+L.HHO.IntraeNB.IntraFreq.PrepAttOut+L.HHO .IntereNB.IntraFreq.PrepAttOut+L.HHO.IntereNB.InterFreq.PrepAttOut)(L.HHO.Prep.FailOut.HOCancel+L.HHO.Prep.FailOut.MME+L.HHO.Prep.FailOut.NoReply+L.HHO.Prep. FailOut.Other+L.HHO.Prep.FailOut.PrepFailure+L.HHO.Prep.FailOut.TargetIllegal))/(L.HHO.IntraeNB.Inte rFreq.PrepAttOut+L.HHO.IntraeNB.IntraFreq.PrepAttOut+L.HHO.IntereNB.IntraFreq.PrepAttOut+L.HHO.I ntereNB.InterFreq.PrepAttOut) *[(L.HHO.IntraeNB.IntraFreq.ExecSuccOut + L.HHO.IntereNB.IntraFreq.ExecSuccOut)/(L.HHO.IntraeNB.IntraFreq.ExecAttOut + L.HHO.IntereNB.IntraFreq.ExecAttOut)]x 100% INTRAFREQ_HO=((L.HHO.IntraeNB.InterFreq.PrepAttOut+L.HHO.IntraeNB.IntraFreq.PrepAttOut+L.HHO .IntereNB.IntraFreq.PrepAttOut+L.HHO.IntereNB.InterFreq.PrepAttOut)(L.HHO.Prep.FailOut.HOCancel+L.HHO.Prep.FailOut.MME+L.HHO.Prep.FailOut.NoReply+L.HHO.Prep. FailOut.Other+L.HHO.Prep.FailOut.PrepFailure+L.HHO.Prep.FailOut.TargetIllegal))/(L.HHO.IntraeNB.Inte rFreq.PrepAttOut+L.HHO.IntraeNB.IntraFreq.PrepAttOut+L.HHO.IntereNB.IntraFreq.PrepAttOut+L.HHO.I ntereNB.InterFreq.PrepAttOut) *[(L.HHO.IntraeNB.InterFreq.ExecSuccOut + L.HHO.IntereNB.InterFreq.ExecSuccOut)/(L.HHO.IntraeNB.InterFreq.ExecAttOut + L.HHO.IntereNB.InterFreq.ExecAttOut)] x 100% IRAT_HO=((L.IRATHO.E2W.PrepAttOut(L.IRATHO.E2W.Prep.FailOut.MME+L.IRATHO.E2W.Prep.FailOut.NoReply+L.IRATHO.E2W.Prep.FailO ut.PrepFailure))/L.IRATHO.E2W.PrepAttOut)*(L.IRATHO.E2W.ExecSuccOut/L.IRATHO.E2W.ExecAttOu t) x 100% VS.BBUBoard.CPULoad.Mean No Counter, to be developed by smartcare (L.CSFB.E2W/L.CSFB.PrepSucc)*100% No Counter, to be developed by smartcare No Counter, to be developed by smartcare No Counter, to be developed by smartcare (L.Thrp.bits.DL/1000000)/8 (L.Thrp.bits.UL/1000000)/8 L.Traffic.User.Avg L.Traffic.User.Max L.Traffic.ActiveUser.UL.Avg L.Traffic.ActiveUser.UL.Max L.Traffic.ActiveUser.DL.Avg L.Traffic.ActiveUser.DL.Max (L.ChMeas.PRB.DL.Used.Avg/L.ChMeas.PRB.DL.Avail) x 100% (L.ChMeas.PRB.UL.Used.Avg/L.ChMeas.PRB.UL.Avail) x 100% UL and DL UU Latency KPI can be stas in ERAN 8.0, now the version is ERAN 7.0

55 (55)


No.


Checked

Kiki Candra

Rev

13 Dec 2015

E

Reference

Revision History

10 Rev

Date

Date

Item Updated 4.2 Cluster DT : Adding PCI Plot (required for MOCN)

Author

1.3 Drive Test Methodology: Remove round 3 data collection (CSFB result is taken from SSA for PAC). For FAC CSFB will be taken from round 3. SINR would be on DL Dedicated Mode 3.2 Drive Test KPI on Capacity : explain clear range of different radio condition 3.2 Drive Test KPI - Retainability, Accessibility, RRC Setup Success Rate values are derived by averaging SSA result 3.2 Drive Test KPI – CSFB Voice Incoming Call Set Up Time : explaining start and end time measurement message flow E

13 Dec 2015

3.2 Downlink QoS Test : updating the test sample by comparing 2 product with higher QoS and lower QoS Adding 2G & 3G aspect to be reviewed in Chapter 5 (NMS 2G, NMS 3G and MRR 3G) Coverage Map Accuracy : histogram plot, RSRP >= dBm in 95% cluster area, SINR > 0 in 90% cluster area Low RSRP, SINR, DL Throughput, UL Throughput near site External interference and overshooting analysis Summary of Tuning activities Scoring update

Alief Risbaya Sirait

PAC Report Medan MDN-04_Rev E-1

Recommend Documents