01
15 November 2022
Network Service Management Area Sumatera
CITO (Certificate Integration and Acceptance Automation)
Medan, Des_2022
CITO | Milestone
PAYLOAD (PB) RADIO HYGIENE INDEX (RHI)
Milestone
2018 2019 2020 2021 2022
• Document Collection
• Dashboard View
Mining and collect
• Auto Approve for 21 days
• QC Reminder
• New Way Out for Dependency Issue
• Transport (TNL)
• Power
Finding the way
• RCI Solution Summary
Cito Enhancement
• Scoring Methodology
• Re-define KPI aggregation
• 4G KPI Scoring
• 3G KPI Scoring
• 2G KPI Scoring
• New View KPI each SOW
KPI New Method
• Predefine SOW Objective
• Objective post implementation review
• Red Capacity result
• Payload Single site comparation
• Auto rejection for minimum quality requirement (ie. CQI cell
< 7)
• Productivity single site detection
New solution
2017
• Paperless Document
• Manual KPI Introduction
• Document View Data
Cito Starting
More than 1000 SOW and Solution each year
How to collect all documentation and extract to find network insight?
And how post implementation analysis result ?
PRB Balance Unbalance
Scale Up to Area 1
CITO | Naura VS Cito Comparation
PAYLOAD (PB) RADIO HYGIENE INDEX (RHI)
CITO | PRB Unbalance Detection
PAYLOAD (PB) RADIO HYGIENE INDEX (RHI)
PRB Utilization
Count as balance RB
Unbalance IF
L1800 vs L2100 gap > 30%
else IF
L1800 vs L900 gap > 30%
else IF
L900 vs L2100 gap > 40%
Count as Unbalance RB
BDBH KPI
Group by
Sector Aggregation 3 days
(last - avg) Band Comparation
CITO Preview Result for All SS
1 2 3 4
L2300 L2100 L1800 L900
To Solve & Detect Cases Like this?
Gap PRB 44%
Simple modeling to PRB unbalance detection CITO Feature - Detect Unbalance PRB
Gap PRB
45% after
optimization
CITO show information about RB Balance
Unbalance
Unbalance
Simple model
What went Well
• 4G Utilization Optimize
• Each band Resource band balance
• Payload Improvement What went Wrong
• L2300 modeling compare other band Further Improvement
• Model to detect Multisector imbalance
• Stagging gap PRB L900 - L1800 - L2100
Next Iteration and Development
16 %Sector unbalance
multisector
Compare sec 1 vs
sec 4 Stagging
CITO | Flowchart
PAYLOAD (PB) RADIO HYGIENE INDEX (RHI) RNO
Submit
Team Leader Accept
Vendor
Accept
Reject
Reject
IF >= 70 IF < 70
Defen SQA Eng SQA
Accept Accept
SQA Manager Reject
Reject
Reject
CITO | QC Submit jika skor >= 70
PAYLOAD (PB) RADIO HYGIENE INDEX (RHI)
KPI 2G Threshold Bobot RULE Colour POINT B X P
HOSR (%) 95 5 x ≥ 95,00 HIJAU 1 5
SDSR NEW (%) 98 10 x ≥ 98,00 HIJAU 1 10
TDR New(%) 5 10 x ≥ 5,00 MERAH 0 0
UL TBF Est SR NEW(%) 98 5 x ≥ 98,00 HIJAU 1 5
DL TBF Est SR NEW (%) 98 5 x ≥ 98,00 HIJAU 1 5
TBF Comp SR New (%) 98 5 x ≥ 98,00 HIJAU 1 5
CSSR (%) 98 15 x ≥ 98,00 HIJAU 1 15
SDCCH Blocking (%) 5 10 x ≥ 5,00 MERAH 0 0
TCH Blocking New(%) 5 10 x ≥ 5,00 MERAH 0 0
TCH Availability (%) 95 5 x ≥ 95,00 HIJAU 1 5
Total Traffic (Erl) 100 10 x ≥ 100,00 HIJAU 1 10
Total Payload (GB) 0.1 10 x ≥ 0,10 HIJAU 1 10
100 70
QC 2G
KPI 4G Threshold Bobot RULE COLOR POINT B X P
RRC Setup Success Rate (%) 99.5 5 x ≥ 99,50 HIJAU 1 5
E-RAB Setup Success Rate (%) 99.5 5 x ≥ 99,50 HIJAU 1 5
Call Setup Success Rate (%) 99 5 x ≥ 99,00 HIJAU 1 5
Service Drop Rate (%) 0.4 5 x ≥ 0,40 MERAH 0 0
Intra-Frequency Handover Out Success Rate (%) 99 5 x ≥ 99,00 HIJAU 1 5
LTE to WCDMA Redirection Success Rate (%) 100 5 x ≥ 100,00 HIJAU 1 5
LTE to GERAN Redirection Success Rate (%) 100 5 x ≥ 100,00 HIJAU 1 5
Radio Network Availability Rate (%) 95 5 x ≥ 95,00 HIJAU 1 5
CSFB Preparation Success Rate (%) 99.5 5 x ≥ 99,50 HIJAU 1 5
Total Payload Band L900, L1800, L2100, L2300 200 15 6 HIJAU 1 15 Proporsional
CQI > 10 (tergantung band, liat list keterangan) 10 25 20 1 25 Proporsional
SE > 1.8 (tergantung band, liat list keterangan) 1.8 10 8.3 1 10 Proporsional
DriveTest (tergantung band, liat list keterangan) 5
100 90
QC 4G
Keterangan Threshold Per Band
THRESHOLD
Parameter Bobot L900 L1800 L2100 L2300
RSRP Distribution 1 x ≥ 90,00 x ≥ 80,00 x ≥ 80,00 x ≥ 80,00 SINR Distribution 2 x ≥ 80,00 x ≥ 80,00 x ≥ 80,00 x ≥ 80,00 HOSR Distribution 1 x ≥ 70,00 x ≥ 90,00 x ≥ 90,00 x ≥ 70,00 UL RSSI 1 x ≥ -85,00x ≥ -85,00x ≥ -85,00x ≥ -85,00
CQI > 10 25 9 10 10 11
SE > 1.8 10 1.4 1.8 1.8 1.6
• Semua nilai KPI didapat dari perhitungan daily cell yang di average 7 hari
• Kecuali untuk perhitungan payload, didapat dengan cara SUM daily
terlebih dahulu dari level cell, setelah itu baru di average 7 hari
CITO | QC Submit
PAYLOAD (PB) RADIO HYGIENE INDEX (RHI)
1. QC yang berhasil di-submit, akan tampil di halaman
New QC milik Team Leader untuk di review 2. QC yang telah disetujui Team Leader, akan tampil di halaman New QC milik Vendor untuk di review
3. QC yang telah disetujui Vendor, akan tampil di halaman QC Ready
Review milik SQA Staff 4. QC yang telah disetujui SQA Staff, akan tampil di halaman QC
Accepted milik SQA Manager
CITO | QC Submit Rejected
5. Apabila QC di reject oleh salah satu user tadi. Maka qc akan langsung kembali ke halaman QC Rejected milik user RNO