Internet access service quality: QoS parameters, evaluation methods and practical solutions

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

What user does in Internet ? Searches an information Communicates Expresses feelings, represents himself, searches like-minded persons Plays games, entertains, watches videos, TV, listens radio Buys, pays taxes, accesses e - bank, stocks exchange services Access e - government services:
ISC Kyiv, Ukraine

V. Stundia

2010.05.19

2 page

 Access services of any public institution (some services request e- identification, e-signature) Annual declaration of incomes and property (upload files of 15-20 kB) Declaration of residence Registration for a visit to doctor Declaration of farmers areas under crops (download speed min600 kb/s is recommended !?) Access services of Real property register, Social insurance register, Health insurance register. E-voting (up to now is suspended)
ISC Kyiv, Ukraine

Examples of public E- government services

V. Stundia

2010.05.19

3 page

What customer would like to obtain and what provider could offer: Short Internet services access time High download/upload speed from/to Internet Rare data transfer/service cut-offs ISPs Internet access services are limited by: Available interconnections traffic Peering traffic and diversity limitations The last mile Internet access technologies

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

4 page

Internet access architecture

Server

User
Modem Modem

User

User

Gateway

Gateway Internet

Gateway
Server

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

5 page

LT NET
109 ISPs ~ 600 connections

~ 200 transit connections ~ 400 peering connections

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

6 page

Lithuanian Internet interconnections

10 LT ISP have interconnections

3 interconnection with TIER-1 ISP 11 interconnection with other ISP International traffic ~ 60 Gb/s

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

7 page

Internet access technologies

Wired: Power-line, Dial-up, ISDN, DSL, Cable, LAN, Fiber.

Wireless/mobile: GSM-GPRS/EDGE, Wi-Fi, UMTSHSDPA/HSUPA, WiMAX, LTE

Regardless physical Internet access technology transport layer is the same - IP (TCP/IP, UDP/IP)

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

8 page

Distribution of Internet access services users by the manner of connection IVQ 2009 796 thousands of Lithuanian subscribers (23,9 connections per 100 population, 47.7 % households) 109 ISPs
LAN 3,45%

xDSL 28,65%

Leased lines 0,17%

Cable modems 6,64% Fiber (FTTH, FTTB) 31,98% Through the mobile telephone network 20,11% Wireless 8,73%

Dial-up 0,28%

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

9 page

Max downlink data transmission speed defined in contract (IV Q 2009)

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

10 page

ADSL
ADSL - Asymmetric Digital Subscriber Line utilizes cooper wire for data transmission Distance: up to 4 km. ADSL2+M Downstream speed up to 24 Mb/s, Upstream speed up to 1 Mb/s TEO offers up to 12 Mb/s (ADSL2+)

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

11 page

Internet through TV Cable Business users From 3 Mbit/s up to 30 Mb/s. For home users up to 6 Mb/s

Up to 4 Mb/s, (Peering 10 Gb/s, Interconnections 2 Gb/s)

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

12 page

Fiber optic
Theoretically single fiber-optic cable can carry data up to thousands of Tb/s ! FTTH / FTTB TEO offers for home users FTTH up to 200 Mb/s (LT NET) up to 80 Mb/s Internet 5C - FTTH up to 100 Mb/s (LT NET) up to 80 Mb/s Internet up to 100 Mb/s (LT NET) 15 Mb/s Internet
ISC Kyiv, Ukraine

V. Stundia

2010.05.19

13 page

GPRS/EDGE/UMTS
GPRS - General Packet Radio Service - 2.5 G EDGE - Enhanced Data rates for GSM Evolution 2.75 G UMTS HSDPA/HSUPA -3.5G (GPRS up to 85,6 Kb/s, EDGE up to 236,8 Kb/s, UMTS HSDPA up to 7,2 Mb/s, HSUPA up to 2 Mb/s)

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

14 page

Offers:

3G HSDPA in 200 cities and towns Up to 1 Mb/s, 3 GB/month for 40 LT = 11,6 EUR Up to 2 Mb/s 7 GB/month for 70 LT = 20,3 EUR 7,2 Mb/s + 20 LT
ISC Kyiv, Ukraine

V. Stundia

2010.05.19

15 page

Offers:
1 GB/month for 19 LT = 5,5 EUR 3 GB/month for 29 LT = 20,3 EUR 10 GB/month for 49 LT 15 GB/month for 69 LT PREPAID SERVICES Up to 0,5 Mb/s,1LT/hour Up To 7,2 Mb/s, 3,5 LT/hour

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

16 page

Offers:

1 GB/month , 19 LT = 5,5 EUR 3 GB/month, 29 Lt = 8,4 EUR Trial period 2 months !

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

17 page

4G WiMax and LTE

Wimax; Theoretically up to 70 Mb/s 112 km (in practice 10 Mb/s 2 km in urban area, 10 km in rural area)

Network is in 20 cities/towns Download up to 10 Mb/s From 9 LT to 69 LT Has prepaid service 2ct/MB

Network is in 5 cities/towns Download up to 768 Kb/s -2 Mb/s From 59 LT to 99 LT

Omnitel anounced LTE trial results : up to 52 Mb/s, Bite- LTE 2011 first Q
ISC Kyiv, Ukraine

V. Stundia

2010.05.19

18 page

Internet access QoS parameters

ETSI EG 202 057-4 Successful log-in ratio [%] Login time [sec] Data transmission speed/rate [kb/s] min, max, mean value Unsuccessful data transmission ratio [%] Packet loss ratio [%] Delay [msec] Jitter/Delay variation [msec]

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

19 page

Targets for QoS parameters to achieve good quality Internet services Data transmission (One way) Web browsing
TCP/IP transport, HTTP Amount of downloaded data: 10 KB Delay < 2-4 s/page Information loss 0

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

20 page

Bulk data transfer TCP/IP transport, FTP Amount of data: 10 KB 10 MB Delay < 15- 60 s/file Information loss 0 E-mail (e-mail server access transfer to server2) TCP/IP SMTP Amount of data 10 KB (with attachment several MB) Delay <4s minutes Information loss 0
ISC Kyiv, Ukraine

V. Stundia

2010.05.19

21 page

 Telephony VoIP: (Symmetrical up/down load) UDP/IP Data transmission rate: 4 Kb/s 64 Kb/s Delay (one way) < 150 ms Jitter < 1 ms Packet loss ratio <3%

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

22 page

High quality audio streaming: (one way) UDP/IP Download rate: 16 Kb/s 128 Kb/s Delay (one way) < 10 s Jitter < 1 ms Packet loss ratio <1%

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

23 page

Videophone: (two way) UDP/IP Data transmission rate: 16 Kb/s 384 Kb/s Delay (one way) < 150 ms Jitter < 1 ms Packet loss ratio <1%

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

24 page

Video streaming: (one way) UDP/IP Download rate: 16 Kb/s 384 Kb/s Delay (one way) < 10 s Jitter < 1 ms Packet loss ratio <1% IP TV MPEG4 SDTV Download rate: 1,5 2 Mb/s

HDTV Download rate: 7 10 Mb/s Delay (one way) < 150 ms

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

25 page

 Many ISP have own data download speedometers (Unfortunately they provide data speed from their server to user computer. There are many speedometers in Internet, but it is difficult to compare their results

RRT speedometer for evaluation of ISP QoS (user oriented)

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

26 page

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

27 page

RRT speedometer measures:

Download rate, kbps Upload rate, kbps Round trip (both way) delay, ms Jitter, ms Lost packets, % Determines user IP and DNS address Selected WebPages download rate Provides statistics

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

28 page

Since 2008 RRT speedometer was launched it was utilized 1,5 mil. times

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

29 page

RRT experience and technique applied for evaluation of mobile ISP

Measurement equipment
X1000 GPS
PC

Data Base server

Results

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

30 page

Tests scheduler

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

31 page

Test

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

32 page

2009 UMTS QoS tests conditions

Tests methods according ETSI TS 102 250-2 v1.6.2

(2008-09) In Cities and Towns where 3 operators offer UMTS Tests performed during working hours from 8 am to 5 pm (Semi) simultaneous tests for all 3 operators Sufficient BS signal strength (>-105 dBm) Tested HTTP services by downloading uncompressible 1 MB file, placed in RRT HTTP server in IXP

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

33 page

2009 UMTS QoS tests results Tests geography

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

34 page

2009 UMTS QoS tests results

BS radio signal power > -105 dBm

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

35 page

2009 UMTS QoS tests results

Bit Lietuva

1,97 1,96 1,99

1,95 1,96 1,97 1,98 1,99 2

Omnitel

Tele2

1,94

PS access time, s

Bit Lietuva

9,2

Omnitel

18,4
20,1
0 5 10 15 20 25

Tele2

HTTP service access time, s

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

36 page

2009 UMTS QoS tests results

Bit Lietuva

828
604 566
0 200 400 600 800 1000

Omnitel

Tele2

HTTP download rate, kb/s

Bit Lietuva

1,2 2,4 2,4

0 0,5 1 1,5 2 2,5 3

Omnitel

Tele2

Unsuccessful downloads ratio, %

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

37 page

Customers complains on ISP QoS

Since 2007 RRT has been judged up to 50 complains on ISP QoS (technical) The most of them were on mobile internet access GPRS/EDGE/ UMTS QoS One of the main issue- weak radio signal Worse data rates than expected, cut offs... After emerging new technologies complains on older technologies increase...
ISC Kyiv, Ukraine

V. Stundia

2010.05.19

38 page

Customers complains on ISP QoS

RRT performs evaluation tests in user defined location Preferably RRT uses its equipment (not users) Take into account contract defined QoS limits Evaluates general Internet access QoS parameters

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

39 page

Conclusions More information about Internet access QoS should be provided for customers (Obligations for ISPs and reliable info from third party) Internet access QoS parameters should be customer oriented and exactly defined Regulator should be technically competent to evaluate ISP QoS

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

40 page

i !
Thank You !

Dr. Virgilijus Stundia Deputy director of Market Surveilance Departmen Communications Regulatory Authority of the Republic of Lithuania [email protected] , Algirdo str. 27A, LT-03219 Vilnius, Lithuania

ISC Kyiv, Ukraine

V. Stundia

2010.05.19

41