0% found this document useful (0 votes)
203 views9 pages

Bëst in Test.: Safaricom Kenya

The document provides a benchmarking certificate and results for Safaricom's mobile network in Kenya. It details umlaut's testing methodology where they conducted drive tests of Safaricom and other networks across Kenya. Safaricom achieved the highest overall score of 832 out of 1000, scoring highest in both voice and data categories.

Uploaded by

PNG networks
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
203 views9 pages

Bëst in Test.: Safaricom Kenya

The document provides a benchmarking certificate and results for Safaricom's mobile network in Kenya. It details umlaut's testing methodology where they conducted drive tests of Safaricom and other networks across Kenya. Safaricom achieved the highest overall score of 832 out of 1000, scoring highest in both voice and data categories.

Uploaded by

PNG networks
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 9

bëst in test.

For adding something on top in Kenya and reaching an


overall score of 832 dots in mobile network benchmarking
survey we proudly award this certificate to

Safaricom Kenya

Score 832 out of 1000 in Total


Score 360 out of 400 in Voice Services
Score 472 out of 600 in Data Services

Hakan Ekmen
Chief Executive Officer Telecommunication
umlaut certificate umlaut certificate

Measurement Overview Measurement setup

Drivetest Voice Data

Device Samsung Galaxy S10 Samsung Galaxy S10

Test Cases Mobile-to-Mobile (M2M) Data 4G preferred CA


umlaut tested and measured the performance of its voice Side1 (4G preferred: Volte) to Side2 (4G preferred: Volte) HTTP DL data stream 7s
and data services on smartphones in comparison to other 115 sec call window HTTP UL data stream 7s
70 sec call duration HTTP 5MB DL fixed file transfer
LTE/UMTS/GSM mobile radio networks in metropolitan 15 sec call setup timeout HTTP 2.5MB UL fixed file transfer
and rural areas of Kenya. Multi-RAB traffic injection on both sides Web Browsing - Kepler ETSI Ref. Page
10 Live web pages (5 http / 5 https)
The audit was done as a performance benchmark performed All data measurements have been performed in 4G 2 YouTube HD video ~ 45s
by umlaut between September 24th 2020 and October preferred mode. Voice measurements have been done in 1 YouTube live stream ~ 45s

26th 2020 in cities and towns as well as on connection 4G/4G preferred mode on both sides, while call origin has Mobility and 100% Drivetest
Route Types 61% in Cities, 13% in Towns and 26% on Roads
roads. been alternated.
Dedicated measurements have been executed as drive The following pages provide a comparative overview Samples ~17043 ~ 198980

tests outdoors using a Samsung Galaxy S10 Smartphone about the performance results observed for the Dates 27 measurement days (using 2 vehicles)
September 24th 2020 - Oct 26th 2020
1000 Mbit/s Download / 105 Mbit/s Upload. different tested service types.

2 3
umlaut certificate umlaut certificate

Testing area
Drive route

Eldoret

Kisumu
Molo
Nakuru
Nyeri
Kiambu
Narok
Thika
Migori Karuri Ruiru
Kikuyu Nairobi
Ngong Athi River
20.4 % Kitengela
of population measured

10047 km
measuring distance
Mombasa

4 5
umlaut certificate umlaut certificate

Claims Methodology

Best in test
Safaricom

The leader in mobile benchmarking, umlaut, has analyzed


the mobile networks of Kenya with regards to mobile net-
Best in data work performance. We measure smartphone voice and
data performance based on extensive drivetests – from
Safaricom
major metropolitan areas to smaller cities and connection
roads.
We objectively define the routes and test methodology
and publish the results through certificates or public
benchmark reports. cedented in its level of detail and enables comparisons
As the de-facto industry standard, our benchmarking between the network performance and capability of each
methodology focuses on customer-perceived network mobile network. Our public benchmarks as well as the
Best in voice quality and covers a wide range of mobile services. certificate benchmarks help network operators to demon-
Safaricom Today, more than 200 mobile networks in more than strate how well they are delivering wireless connections to
120 countries are being evaluated by our unique scoring consumers, business users and enterprises and reveals the
methodology. It allows a technical analysis that is unpre- areas of improvement.

6 7
umlaut certificate umlaut certificate

Score and breakdown


Safaricom achieved the highest overall score among competitors with 832 dots out of 1000.

Total score
Total Score
Safaricom Telkom Airtel Faiba
1000 Points
Voice max. 400 360 123 52 -

963 Cities Drivetest 240 93% 43% 14% -


832
Towns Drivetest 80 92% 14% 14% -
Roads Drivetest 80 79% 11% 10% -

Data Data max. 600 472 149 158 127


max. 600
Cities Drivetest 360 79% 29% 29% 22%
Towns Drivetest 120 76% 19% 22% 20%
Roads Drivetest 120 82% 18% 23% 20%
Total 1000 832 272 210 127

- Shown total scores are rounded.


472
272 Shown scores are rounded.

210
Voice
max. 400
127
149
158
360 123 52 127
Operator Safaricom Telkom Airtel Faiba

Overall score considering Voice and Data. For Faiba only data services were tested.

8 9
umlaut certificate umlaut certificate

Achieved percentage of the maximum score in each of the different data services. Voice KPI overview
The following table indicates the achieved values of all networks under test in each of the relevant Voice Key Performance
Indicators (KPIs) for the geographical categories “Cities”, “Towns” and “Roads”. Voice not tested for Operator 4.
Data Service Group max Safaricom Telkom Airtel Faiba
Web Browsing 90,0 79% 30% 30% 31%
Voice Service Group Unit Safaricom Telkom Airtel Faiba
File Download 90,0 69% 21% 22% 10%
Cities Qualifier [%] 99,1 95,3 91,3 -
File Upload 90,0 77% 38% 32% 16%
Call Setup Time [s] 1,2 5,9 5,6 -
YouTube 90,0 89% 28% 31% 30%
Call Setup Time (P90) [s] 1,5 8,2 7,2 -
Web Browsing 30,0 78% 26% 27% 30% Cities
Speech Quality (AVG) [MOS-LQO] 4,1 3,6 3,3 -
File Download 30,0 71% 10% 11% 7%
Towns Speech Quality (P10) [MOS-LQO] 3,8 3,0 2,1 -
File Upload 30,0 72% 12% 21% 15%
Multirab connectivity [%] 99,6 83,5 68,4 -
YouTube 30,0 81% 28% 31% 29%
Qualifier [%] 99,1 90,5 83,8 -
Web Browsing 30,0 83% 21% 26% 27%
File Download 30,0 80% 10% 14% 8% Call Setup Time [s] 1,4 6,7 5,2 -
Roads
File Upload 30,0 81% 15% 20% 20% Call Setup Time (P90) [s] 1,7 9,1 6,4 -
Towns
YouTube 30,0 84% 26% 32% 25% Speech Quality (AVG) [MOS-LQO] 4,0 3,3 3,4 -
Speech Quality (P10) [MOS-LQO] 3,6 2,6 2,2 -
Multirab connectivity [%] 99,6 53,7 72,8 -
Qualifier [%] 94,8 81,2 71,0 -
Call Setup Time [s] 1,4 6,6 5,5 -
Call Setup Time (P90) [s] 1,7 9,0 7,5 -
Roads
Speech Quality (AVG) [MOS-LQO] 4,0 3,2 3,4 -
Speech Quality (P10) [MOS-LQO] 3,6 2,4 2,2 -
Multirab connectivity [%] 94,2 40,8 72,1 -

10 11
umlaut certificate umlaut certificate

Data KPI overview


The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance The following table indicates the achieved values of all networks under test in each of the relevant Data Key Performance
Indicators (KPIs) for the geographical category “Cities”. Indicators (KPIs) for the geographical category “Towns”.

Data Cities KPI Name Unit Safaricom Telkom Airtel Faiba Data Towns KPI Name Unit Safaricom Telkom Airtel Faiba

HTTP Live Page DL Qualifier [%] 97,1 89,8 89,9 81,7 HTTP Live Page DL Qualifier [%] 97,0 86,9 88,1 29,0
Smartphone Overall Session Time [s] 2,0 2,9 3,0 2,8 Smartphone Overall Session Time [s] 1,9 2,9 3,2 2,7

HTTP Static Page Qualifier [%] 98,7 91,1 92,5 83,7 HTTP Static Page Qualifier [%] 98,4 86,2 88,7 28,6
DL Smartphone Overall Session Time [s] 1,0 2,9 2,5 2,2 DL Smartphone Overall Session Time [s] 1,0 3,6 2,7 1,8
Qualifier [%] 97,3 93,7 93,9 86,5 Qualifier [%] 98,9 89,5 89,7 30,3

HTTP 5MB DL Average Session Time [s] 1,9 19,4 14,9 17,1 HTTP 5MB DL Average Session Time [s] 2,4 16,5 18,7 15,5
Smartphone 90% faster than [Mbit/s] 15,5 0,8 1,1 1,0 Smartphone 90% faster than [Mbit/s] 12,0 1,0 0,9 0,9
10% faster than [Mbit/s] 75,1 15,3 16,7 20,2 10% faster than [Mbit/s] 75,4 15,5 21,2 22,8
Qualifier [%] 98,0 93,3 92,3 83,1 Qualifier [%] 98,6 83,6 90,1 28,6

HTTP 2500KB UL Average Session Time [s] 1,9 6,3 5,0 6,0 HTTP 2500KB UL Average Session Time [s] 2,4 9,4 4,9 5,6
Smartphone 90% faster than [Mbit/s] 9,6 1,3 1,8 1,4 Smartphone 90% faster than [Mbit/s] 6,5 0,9 2,7 1,6
10% faster than [Mbit/s] 25,9 12,3 15,0 13,8 10% faster than [Mbit/s] 24,3 10,6 14,4 13,5
Qualifier [%] 96,4 92,4 92,4 84,0 Qualifier [%] 96,2 90,1 91,2 30,1
Average Data Rate [Mbit/s] 58,5 6,4 7,8 8,2 Average Data Rate [Mbit/s] 53,3 7,6 8,6 10,2
HTTP DL FDTT HTTP DL FDTT
90% faster than [Mbit/s] 19,2 0,9 1,2 1,0 90% faster than [Mbit/s] 17,0 1,0 1,1 1,0
10% faster than [Mbit/s] 106,8 15,4 16,9 20,5 10% faster than [Mbit/s] 102,4 17,7 22,1 23,6
Qualifier [%] 97,6 96,1 93,6 81,9 Qualifier [%] 96,8 88,2 89,1 27,7
Average Data Rate [Mbit/s] 36,4 9,7 11,5 7,8 Average Data Rate [Mbit/s] 30,3 6,6 9,7 9,0
HTTP UL FDTT HTTP UL FDTT
90% faster than [Mbit/s] 12,5 1,9 2,7 1,2 90% faster than [Mbit/s] 7,4 1,2 2,0 1,9
10% faster than [Mbit/s] 56,5 17,8 20,8 17,8 10% faster than [Mbit/s] 54,9 14,8 19,9 18,7
Qualifier [%] 99,3 64,9 70,6 62,1 Qualifier [%] 97,5 71,1 63,1 22,4
YouTube Start Time [s] 1,7 2,9 2,7 2,5 YouTube Start Time [s] 1,8 3,1 2,7 2,5
AVG Resolution [p] 919 722 774 757 AVG Resolution [p] 917 740 803 764
Qualifier [%] 99,4 79,9 76,6 68,7 Qualifier [%] 99,0 78,4 73,5 26,0
YouTube Live YouTube Live
Start Time [s] 2,3 3,4 3,4 3,3 Start Time [s] 2,3 4,0 3,6 3,4
Smartphone Smartphone
AVG Resolution [p] 1038 734 802 787 AVG Resolution [p] 1034 743 791 826

12 13
umlaut certificate umlaut certificate

Data KPI Overview


Achieved values of all networks under test in each of the relevant Data Key Performance Indicators (KPIs) for the geo-
graphical category “Roads”.

Data Roads KPI Name Unit Safaricom Telkom Airtel Faiba

HTTP Live Page DL Qualifier [%] 97,0 63,2 73,0 19,7


Smartphone Overall Session Time [s] 2,0 3,2 3,2 3,0

HTTP Static Page Qualifier [%] 97,7 62,1 73,7 19,6


DL Smartphone Overall Session Time [s] 1,2 4,3 2,8 2,1
Qualifier [%] 98,4 64,6 73,6 21,0

HTTP 5MB DL Average Session Time [s] 3,2 18,7 14,3 20,0
Smartphone 90% faster than [Mbit/s] 7,8 0,9 1,1 0,7
10% faster than [Mbit/s] 75,9 14,7 23,5 23,5
Qualifier [%] 97,4 56,2 70,6 18,9

HTTP 2500KB UL Average Session Time [s] 2,7 10,6 8,1 5,9
Smartphone 90% faster than [Mbit/s] 5,3 0,8 0,9 1,4
10% faster than [Mbit/s] 24,2 11,7 14,4 14,6
Qualifier [%] 95,8 66,4 75,6 21,2
Average Data Rate [Mbit/s] 52,6 6,6 10,9 7,8
HTTP DL FDTT
90% faster than [Mbit/s] 10,7 0,9 1,4 1,0
10% faster than [Mbit/s] 114,9 17,0 24,4 19,2
Qualifier [%] 97,2 59,0 71,1 19,0
Average Data Rate [Mbit/s] 26,5 6,0 8,8 9,0
HTTP UL FDTT
90% faster than [Mbit/s] 5,4 1,0 0,9 1,2
10% faster than [Mbit/s] 53,7 14,8 20,9 21,8
Qualifier [%] 97,5 46,8 59,6 14,5
YouTube Start Time [s] 1,8 3,5 2,9 2,8
AVG Resolution [p] 914 708 807 715
Qualifier [%] 97,9 62,1 64,5 15,4
YouTube Live
Start Time [s] 2,4 4,4 3,4 3,4
Smartphone
AVG Resolution [p] 1028 727 885 749

14 15
umlaut SE
Am Kraftversorgungsturm 3 · 52070 Aachen · Germany

Hakan Ekmen · Chief Executive Officer Telecommunication


cell +49 151 571 33 235 · [email protected]

www.umlaut.com

You might also like