0% found this document useful (0 votes)
32 views9 pages

Characterization of A 3G EV-DO Network - A Measurement Study

Download as pdf or txt
Download as pdf or txt
Download as pdf or txt
You are on page 1/ 9

Characterization of a 3G EV-DO Network -

a Measurement Study
Zhe Zhou, Mark Claypool and Robert Kinicki
Computer Science Department at Worcester Polytechnic Institute
Worcester, MA USA
{jeffz,claypool,rek}@cs.wpi.edu

Abstract—The growth of mobile streaming applications has overhead, frequency and duration of transmission data rates,
increased the importance of a better understanding of 3G EV- EV-DO packet fragmentation and encapsulation, EV-DO and
DO performance. This paper provides performance measure- higher layer loss characteristics, and observed signal strengths.
ments for a series of experiments that offer an in-depth, cross-
layer understanding of EV-DO. Insights are provided for data While providing a general understanding of a deployed EV-DO
rate control, packet encapsulation/combination, early completion, network, these low-level characteristics facilitate the develop-
packet interarrival time, packet loss pattern and queue manage- ment of an EV-DO simulator or they can be used by end hosts
ment. Key results are: data rates for non-mobile EV-DO users to improve application performance over EV-DO.
are more stable than previously reported with little variance Our experiments show high variability in network conditions
over short time scales and more random behavior over long
time scales; low-level packet encapsulation/combination happens when the client location changes. However, measured station-
frequently; and custom service provider configurations (e.g., ary EV-DO client reception characteristics have less variability
advanced queue management), and operating system differences than previously reported [3]. Over time scales of a few min-
(e.g., clock granularity for device drivers) can obfuscate network utes, throughput at EV-DO clients shows little variance, while
behavior relative to EV-DO specifications. over interval of tens of minutes, EV-DO client throughput
Index Terms—3G, EV-DO, bandwidth estimation
changes unpredictably. Only relatively short sampling periods
(less than 1 second) are needed for a consistent estimate of the
I. I NTRODUCTION
standard deviation of network bandwidth. Operating systems
The emergence of smart phones as a popular Internet mobile provide timing granularities that are smaller (1 millisecond in
platform and the increased use of cellular access cards on Windows) and larger (increments of 4 milliseconds in Linux)
laptops has fueled the pressure for cellular network providers than those provided by EV-DO packet transmissions (1.667
to develop technologies that enable higher capacity to support milliseconds). EV-DO packet errors are infrequent but when
the plethora of new streaming applications designed for mobile they do occur, they are bursty. The effects of upper layer queue
wireless clients. management (e.g., RED [4]) often obfuscate EV-DO network
Effective mobile video streaming requires video servers that behavior beyond what can be inferred in the specification.
adapt quickly and efficiently to the variability in wireless The paper is organized as follows: Section II provides
transmission conditions, particularly the transmission rates. an overview of previous related research; Section III intro-
Bandwidth estimation has been proposed and investigated as duces EV-DO networks; Section IV details our measurement
a technique to optimally adjust streamed video transmission methodology and experiment design; Section V presents and
rates to match the available bandwidth over the Internet path. analyzes experimental results and Section VI concludes by
However, historically, bandwidth estimation explorations have summarizing our main findings.
only considered cases where the last hop is either a wired
LAN or an IEEE 802.11 wireless access point. Bandwidth II. R ELATED W ORK
estimation research for cellular networks is challenging, with To the best of our knowledge, there are no bandwidth
only sparse published measurements, due to: the volatile nature estimation techniques designed specifically for 3G EV-DO
of mobile wireless transmissions, limited access by external networks. Due to the fundamental differences between EV-DO
researchers to proprietary cellular network infrastructures, networks and wireless 802.11 or wireline networks, existing
difficulties in managing controlled measurements over cellu- bandwidth estimation tools are likely to be inaccurate in mea-
lar network infrastructures, and no proven, publicly-available suring the bandwidth for EV-DO networks. The fundamental
cellular network simulators [1], [2]. challenges for bandwidth estimation over EV-DO include pos-
This paper presents measurement studies of the widely sible packet fragmentation and multiple packet encapsulation,
deployed 3G EV-DO Rev. A cellular network technology. By the proportional fair scheduler, a time-division multiplexing
investigating low-level EV-DO characteristics, this research slotted forward link, and highly variable transmission rates.
assists in the ultimate goal of developing effective band- A handful of literature explores the feasibility of directly
width estimation techniques for mobile streaming applications. applying existing bandwidth estimation techniques designed
Important EV-DO details uncovered include EV-DO packet for wireline and wireless IEEE 802.11 to EV-DO networks.
For example, Castellanos et al. [2] compare three bandwidth to an EV-DO packet, whereas protocol together with packet
estimation tools (TOPP, SLoPS and pathChirp) in mobile refers to packets at other network layers (e.g., IP packet).
networks. The authors do not find any of these estimation tools Figure 1 illustrates a typical EV-DO network. Access Termi-
to be more outstanding than the others, but the results show nals (ATs) connect to an Access Point (AP), also known as a
that pathChirp performs the best. However, the experiments Radio Node (RN). APs are managed by Radio Control Nodes
only use NS-2 based simulations, and the NS-2 configurations (RNCs) that offer services including resource and mobility
are not presented. The paper does not provide details about management. Packet Data Serving Nodes (PDSNs) connect
the mobile network studied (for example, whether it is 1xRTT, RNCs into the Internet and manage Point-to-Point Protocol
1xEV, or UMTS). (PPP) sessions for the ATs.
Claypool et al. [5] compare TCP throughput with the
bandwidth estimation results from a tool called npath [6].
The estimation results remain steady at about 525 kbps, but
the TCP throughput varies from 300 to 350 kbps. While the
authors do not comment on the difference, the result shows
npath does not estimate the achievable throughput accurately.
Koutsonikolas and Hu [1] use WBest [7] to estimate the
achievable throughput of an EV-DO terminal. Their experi-
mental results show that WBest fails to measure the achievable Fig. 1. Typical EV-DO Network Architecture
throughput defined either by the maximum TCP throughput
or the maximum UDP throughput. The study concludes that An EV-DO Rev. A AP transmits data to ATs at a variable
bandwidth estimation in EV-DO networks is not feasible rate that depends upon the received DRC (Data Rate Control)
because of the high variability in transmission rates exhibited index. Every EV-DO time slot (1.667 milliseconds), each AT
at small time scales. estimates the highest possible DRC1 for individual packet
An interesting phenomena is that the measured TCP reception based on its measured Signal to Interference and
throughput in [5] and [1] exhibit different properties. For Noise Ratio (SINR) and sends the DRC index to the AP. Better
example, [5] observes TCP throughput being in the 300 wireless channel conditions yield higher DRCs where DRC 14
to 350 kbps range and reasonably stable over a 24 hour corresponds to the highest data rate and DRC 0 corresponds
period, while [1] sees TCP throughput changes much more to the lowest data rate.
drastically (e.g., for one specific location, TCP throughput is The AP maps an AT’s DRC into a specific EV-DO MAC
measured at 700 kbps at 4am and about 350 kbps at 10am). layer transmission format that consists of a packet size (in
A possible explanation of this difference is the year the two bits), a duration (in time slots) and a preamble length (in
sets of measurement are taken, 2006 for [5] and 2009 for chips). Generally, a higher DRC implies a larger packet size
[1]. The worldwide number of EV-DO subscribers had grown and/or a shorter duration, which is intended to produce a
from 65 million in 2006 [8] to 127 million in 2009 [9]. higher data rate.
Although service providers may have built additional network The duration, measured in time slots, can be understood
infrastructure to accommodate the increased number of users, as the number of time slots a packet is scheduled to be
the increased density of the EV-DO user population may have transmitted. If the SINR at reception time is good, the AT
caused the throughput variability observed in [1]. can receive and decode the packet in the first time slot the
Despite the difference between observed achievable packet is transmitted, even when the packet could have two
throughput, both [5] and [1] find that the achievable throughput time slots scheduled. This event, known as early completion,
measurement by sending TCP/UDP flows stays relatively helps compensate for an AT’s inaccurate DRC estimation and
steady for several minutes at a time, suggesting streaming typical fluctuations in channel signal strengths.
applications may benefit from using appropriate bandwidth An EV-DO network maintains PPP sessions for each AT.
estimators. For instance, a bandwidth estimate valid for several Internet IP packets are encapsulated into PPP packets and
minutes can help choose a suitable transmission rate for a sent through several EV-DO layers to the appropriate AT.
YouTube streaming video since about 98% of YouTube videos The formation of PPP packets does not preserve IP packet
are less than 10 minutes long [10]. More generally, an accurate boundaries, meaning that IP packets can be combined or
bandwidth estimation can allow for initial configuration of fragmented by the EV-DO network layers.
application network parameters (e.g., initial video encoding EV-DO APs use Proportional Fairness (PF) scheduling
rate). Subsequent adjustment of bandwidth estimation can when transferring data to multiple ATs. The PF scheduler
be inferred from the statistics of actual application packets essentially uses a round-robin mechanism across ATs with
received, or by rerunning the bandwidth estimation. an adjustment that gives priority to ATs that report to the
III. BACKGROUND AP a current DRC that is better than its previous weighted
average. While a PF scheduler tends to improve overall system
This section briefly introduces fundamental EV-DO con-
cepts and terminology. In this paper, Packet used alone refers 1 With an objective of no more than a 1% packet error rate
TABLE II
throughput [11], it increases the variability of IP packet S OFTWARE TOOLS
response times. Tool Author Purpose
Packet error rate (PER) is the error rate of EV-DO packets. EV-DO Sniffer Airvana Record EV-DO traffic trace for
An EV-DO packet can fail to be received after the scheduled DRC, SINR and PER
number of transmission attempts (as opposed to early comple- QCAT Qualcomm Parse EV-DO traffic trace for
DRCs and packet transmission
tion) and all retransmissions attempted by the EV-DO Radio formats (every second)
Link Protocol. Higher PERs increase delays in transmissions Keep-Alive Tool WPI Send dummy traffic periodically
and possibly packet loss at the IP layer. to keep aircard connected
Traffic Generation WPI Send from server to client with
IV. M ETHODOLOGY Tool controlled packet rates and sizes

Our EV-DO experiments utilized a laptop with a 3G EV-


DO Rev. A card as a mobile wireless client to measure
cellular traffic captured by an EV-DO network sniffer and a UDP packet to the server every 3 seconds. Our custom
Wireshark.2 By carefully controlling the IP packet size and traffic generating tool sends UDP traffic from the server to
packet rate of downstream traffic from a well-connected server the client using a 10-byte application header that indicates
(see Figure 2), the investigation correlates information across sequence numbers.
network layers to infer EV-DO behavior. While this toolset examines traffic across multiple network
layers, there are several capabilities not supported by the tools.
EV-DO Tower Without EV-DO packet-level granularity, these experiments
EV-DO Client only observe packet encapsulation, overhead and interarrival
times indirectly. As EV-DO packet transmission formats are
aggregated per second by the tools, per slot-time formats are
not available and there is no certainty that client-requested
DRCs match the DRCs of the subsequent EV-DO packet
Server
sent. The lack of automated support by the sniffer (e.g.,
command-line arguments) meant experimental runs could not
Internet Cloud
be scheduled and human intervention was required to repeat
runs.
Additionally, there is evidence of EV-DO packet loss at high
loads. Namely, an observed mismatch in byte count between
Fig. 2. Experiment Topology
the application layer and the EV-DO layer is attributed to the
aircard missing some EV-DO traffic in the sniffer-recorded
Table I provides hardware details for our setup that sends
summary packet.
traffic from a WPI desktop to an EV-DO enabled laptop to
study EV-DO characteristics relevant for bandwidth estimation
V. R ESULTS
of streaming video down to a mobile device. Similarly, Table II
lists the software tools employed in the EV-DO measurements. This section provides experimental findings for EV-DO
network experiments run between May and November 2011.
TABLE I The three locations and average recorded DRC’s at these
H ARDWARE locations are shown in Table III. In the rest of this paper we
Hardware Specification refer to these locations by their labels.
Laptop (Client) Dell Precision M4500, Intel Core i5-M560
2.67GHz, 4G memory TABLE III
Desktop Dell Precision, Intel Core i5-660 3.33GHz, 4G E XPERIMENT LOCATIONS
(Server) memory, Intel 82578DM gigabit Ethernet NIC
over 100 Mbps Ethernet connection DRC
Label Location
EV-DO Aircard Serria Wireless AC595 mode
EV-DO Network Verizon EV-DO Rev. A A single-family home in Worces-
Location A 13
WPI Egress 500 Mbps over gigabit link ter, MA
An academic building in WPI
Location B 8
(Worcester Polytechnic Institute)
A high-rise apartment in Cam-
Location C 6
The EV-DO sniffer runs on Windows providing DRC and bridge, MA
SINR statistics per EV-DO time slot and DRC, SINR, and
packet error rate (PER) statistics per second. QCAT exports
sniffer traces to text files for packet format analysis. Since the Our EV-DO end device (AT) is stationary for all experi-
sniffer receives no information when the Aircard goes dormant ments discussed except for a mobile experiment where the
after a 5-second idle interval, our custom keep-alive tool sends laptop gathers measurements from a car moving about 30
miles per hour. For the stationary experiments, the laptop is
2 http//www.wireshark.org placed in the exact same physical spot at each location.
6 1
4 Mobile
DRC
0.9 Stationary
SINR
5 2
0.8
0
0.7
4
-2

SINR (dBm)

Fraction
0.6
DRC

-4
3 0.5
-6 0.4
2 -8 0.3
-10 0.2
1
-12 0.1

0 -14 0
0 0.2 0.4 0.6 0.8 1 0 2 4 6 8 10 12 14
Time (seconds) DRC indices

Fig. 3. DRC and SINR correlation over 1 second intervals (mobile) Fig. 4. CDF of DRCs

1
We are aware that the limited scale of our experiments may
0.9
not yield ubiquitously representative results. However, previ-
0.8
ous mobile network data studied in large scale has been pre-
0.7
sented mostly only from the vantage of the network provider,

Fraction
0.6
likely due to the manual process needed to gather data at the
AT. Some of our experiments (e.g., throughput versus sample 0.5

time) are run at locations with different DRC ranges providing 0.4

some breadth to the representation. Other experimental results 0.3

(e.g., different packet interarrival times caused by the operating 0.2

system) are generally applicable. Overall, the results offer a 0.1 Mobile
Station
practical instance of an AT-side perspective of a commercial 0
0 1000 2000 3000 4000 5000 6000
EV-DO network, while highlighting network aspects that could Stability Duration (slots)
be studied at a larger scale in future work.
Fig. 5. CDF of DRC steadiness
A. DRC Analysis
DRC indices are forward-link rate requests made per EV-
DO time slot from an AT to the AP. Our experiments examine DRC fluctuation has a direct impact on AP transmission
DRC distributions from both stationary and mobile EV-DO rate variability, which in turn impacts streaming applications
endpoints. Previous work studying 3G networks has shown and bandwidth estimation. Generally, a more stable DRC
DRCs to be a key attribute in determining EV-DO end-device distribution should yield steadier streaming data rates, more
performance [3]. accurate bandwidth estimation and reduced estimation times.
DRC requests are based on the SINR computed at the
To examine this variation, AT DRC requests made every EV-
AT. Figure 3 shows an example of the correlation between
DO time slot (1.667 milliseconds) are recorded over a period
DRC and SINR over a one-second period for a mobile device.
of 800 seconds. From this data, the size of continuous bursts
Although the DRC fluctuates among 2, 3, and 5, there is no
of non-changing DRC values (referred to as ”steady region”
visual correlation between SINR and DRC over this time scale.
in the rest of the text) are extracted and then computed as a
Thus, we provide no further analysis of performance based on
fraction of the total number of DRC values. Figure 5 graphs
SINR.
the CDF of this DRC steadiness for the same stationary and
Figure 4 depicts the CDF of DRCs reported over two
mobile experiments.
90-minute experiments. The mobile experiment is run in a
car moving at 30 mile per hour as aforementioned and the In the stationary experiment, DRC values remain constant
stationary experiment is run at Location B. Both cases yield over relatively long time periods. For the stationary AT, over
nearly a full-range of DRC values, with DRC values of 1-13 half the time the DRC stays in steady regions of 1000+ time
seen clearly. The DRC distribution is slightly broader during slots (approximately 1.5 seconds), exhibiting more steadiness
the mobile experiment. There are few DRC 14 values reported than reported previously [3]. Almost 10% of the time, the
in the mobile case, and none in the stationary case.3 DRCs belong to steady regions of 3000+ time slots (more
than 5 seconds). Even in the mobile AT case, DRCs remain in
3 Reported DRC 0 values appear to be mode changes by the AT and not steady regions of 600+ time slots (more than a second) over
actual requests for data transmission rates. half the time.
B. Throughput versus Sample Time 3 620

EV-DO Packet Arrivals (Per Second)


EV-DO

Application Packet Size (Bytes)


Application
Determining the sample size needed for accurate measure- 2.5
619

ments is important, both for experimentation and for tools 618


such as bandwidth estimation that make throughput predictions 2
617
from a minimal number of samples. To this end, three traces
1.5 616
collected at all three locations (representing three different AT
throughputs) are selected for comparison. The three traces last 615
1
for 200 seconds during which time the server sends saturating 614
UDP traffic to the AT. The average throughputs are: 285 kbps 0.5
613
for Location C, 441 kbps for Location B, and 813 kbps for
Location A. The packet size used for Location B and C is 1500 0 612
500 550 600 650 700 750 800
bytes and the packet size used for Location A is 33 bytes. Time (Seconds)
Figure 6 graphs the standard deviation of the average
throughput versus the sampling interval in seconds. As ex- Fig. 7. EV-DO packet arrivals with increasing IP packet sizes over time
pected, the standard deviation stabilizes with increased sample
interval. However, the standard deviation is quite low even
for very few samples. This suggests bandwidth estimation
the right-hand y-axis) and EV-DO packet arrivals per second
techniques may be able to obtain fairly accurate predictions
(shown by the left-hand y-axis). At approximately 675 sec-
with relatively few measurements. Note, for all three traces,
onds, some of the EV-DO packet arrival rates jump from 1 per
the coefficient of variation (standard deviation divided by the
second to 2 per second. This suggests that at 617 bytes the IP
mean) is approximately 1.
packet size is too big to fit in one EV-DO packet and must be
fragmented into two EV-DO packets. In addition to confirming
1000
Location A, 813 kbps
Location B, 441 kbps
the presence of EV-DO packet fragmentation, this data also
Location C, 285 kbps provides enough detail to compute EV-DO header sizes. At
Standard Deviation (kbps)

800
DRC 14, EV-DO sends 640 bytes per slot and Figure 7 implies
the EV-DO header is 24 bytes.
600
To ascertain EV-DO overhead for other DRC values, ex-
periments with three distinct IP packet sizes (50 bytes, 400
400
bytes, and 750 bytes) are conducted at Location B and C. Each
experiment has the server send packets to the AT at a fixed
200
packet rate for 10 seconds, followed by a three-second quiet
period where no packets are sent, then doubling the packet
0
1 2 3 4 5 6
rate and repeating transmissions up to a saturating rate (higher
Sample Interval (seconds) than the EV-DO maximum). Each experiment is repeated 5
times for each packet size and location combination. Figure 8
Fig. 6. Standard deviation versus sampling interval shows the EV-DO packets arrivals for one such experiment
(packet size 50 bytes, Location C). For example, at around
90 seconds, the previous batch of IP packets are received (as
C. EV-DO Packet Analysis EV-DO packets), a 3 seconds pause is executed, and the next
IP packets can be fragmented during transfer to EV-DO batch of IP packets (sent at double the previous packet rate)
ATs. To better understand how and when packet fragmentation start to be received. In correspondence to the doubling of IP
occurs within EV-DO, experiments run at Location A that packets sending rate, the EV-DO packet arrival rate increases
elicited predominantly a 14 DRC are examined over a range every 13 seconds up to the saturation point, with no noticeable
of IP packet sizes. UDP packets are sent from the server to the drop-off in packet arrival rates once saturation is reached. EV-
AT in ten-packet batches. All packets in a batch are the same DO packet arrival rate seems to increase less when packet
size sent at a rate of 1 packet per 3 seconds. After sending one rate is higher (e.g., for the two batches at time 128 and 256),
batch, the server pauses 10 seconds, increases the packet size suggesting EV-DO is combining IP packets.
by 1 byte, and sends the next batch. The 3 second interval is Figure 9 presents the ratio of the number of bytes of the
chosen since it is long enough to distinguish packet(s) sent at EV-DO traffic to that of IP layer traffic (including IP header)
the EV-DO layer for each UDP packet, but short enough to for all experimental runs. Some experiments finshed earlier
avoid the AT going dormant and disconnecting. If there is no than others because those experiments use the larger packet
data transmission in 5 seconds the AT will enter a dormant sizes and reach the saturation faster. The EV-DO overhead
state which affects the statistics of the next packet. converges from about 15:1 at a low packet per second rate, to
Figure 7 shows an experimental segment where the UDP close to 1 at a high packet per second rate. The high overhead
packet size varies from 612 bytes to 620 bytes (shown by for small IP packets at low sending rate is because EV-DO
EV-DO Packet Arrival Rate (per Second)
1000 1

0.9

0.8

0.7
100

Fraction
0.6

0.5

0.4
10
0.3

0.2

0.1

1 0
0 20 40 60 80 100 120 140 160 1 2 3 4 6 8 10 12 1416
Time (seconds) Packet Interarrival Time (ms)
1

Fig. 8. EV-DO packets over time 0.9

0.8

0.7
does not have a backlog from which the IP packets can be

Fraction
0.6
combined. At high sending rate, EV-DO combines IP packet 0.5
to help keep overhead low. 0.4

0.3

50-Byte Packets 0.2


15 400-Byte Packets
750-Byte Packets 0.1

0
4 8 12 16
Packet Interarrival Time (ms)
10
Ratio

Fig. 10. Interarrival time of application packets (Windows top, Linux bottom)

IP Packets that arrive 1 millisecond apart are likely sent in the


1
same EV-DO packet (EV-DO packets must be separated by
20 40 60 80 100 120 140 160
Time (seconds)
at least one EV-DO time slot). The timing clusters observed
are likely due to distinct buffering schemes in each OS stack
or from different timing mechanisms in the device driver.
Fig. 9. Ratio of EV-DO traffic to IP traffic
Thus, any application-level packet dispersion techniques that
infer bandwidth based on packet timings on the order of a
D. Application Packet Analysis few milliseconds may not be able to ascertain EV-DO packet
Some bandwidth estimation techniques use packet disper- arrivals accurately.
sion to infer available bandwidth. These techniques have been
proven to work well in wired networks [12] and IEEE 802.11 E. PER and Out-of-Order Packets
networks [7], but to the best of our knowledge, they have not When an AT requests a DRC from the AP, the DRC is
been thoroughly studied in mobile phone networks. The next chosen to achieve less than a 1% EV-DO packet error rate
experiments offer a preliminary view of packet dispersion in (PER) given the measured SINR. For a 500 second interval,
EV-DO networks. the PER is recorded each second at Location B. Over the 500
Figure 10 shows the CDF of UDP packet interarrival times seconds, only 15 seconds are observed with non-zero PER.
gathered at the receiving laptop’s application layer of the EV- Figure 11 plots the CDF and CCDF of PER observed when
DO AT for two experiments. The two experiments are run at there are errors. From the figure, 90% of the time the PER is
Location A with the same setup – the only difference being the between 0.15 to 0.40, with the bulk of PERs around 0.20. The
operating system, Microsoft Windows (top) or Linux (bottom). CCDF also includes seconds when there is no packet error to
The packet size is set to 50 bytes to reduce the possibility of give a more complete view of the data.
packet fragmentation. Figure 12 shows the IP packet loss for experiments that
The graphs demonstrate that the packet interarrival times are are run in Location A with a slowly increasing data rate to
significantly affected by the operating system. The Windows observe loss behavior at link saturation. With small, 33-byte
interarrival times cluster in multiples of 1 millisecond and the IP packets (top), the rate increases steadily until link saturation
Linux interarrival times cluster in multiples of 4 milliseconds. is reached and there is significant loss. There is a noticeable
1 1000 1200
Throughput
0.9 Loss (packets)
1000

Number of Lost Packets


0.8 800

Throughput (kbps)
0.7
800
Fraction

0.6 600

0.5 600

0.4 400
400
0.3

0.2 200
200
0.1

0 0 0
0 0.2 0.4 0.6 0.8 1 0 20 40 60 80 100 120 140
Packet Error Rate (Fraction) Time (seconds)
1 1800 1200
Throughput
1600 Loss (packets)
1000

Number of Lost Packets


1400
0.1

Throughput (kbps)
1200 800
Fraction

1000
0.01 600
800

600 400
0.001
400
200
200

0.0001 0 0
0.1 0.2 0.4 0.6 0.8 1 0 20 40 60 80 100 120 140
Packet Error Rate (Fraction) Time (seconds)

Fig. 11. CDF of PER (top), CCDF of PER (bottom) Fig. 12. Packet loss with increasing throughput (top: 33 byte packets, bottom:
1500 byte packets)

TABLE IV
dip in throughput around 100 seconds. With large, 1500-byte PACKET TRANSMISSION FORMAT REPORT
IP packets (bottom), there is a similar increase in rate until DRC Size Slots slot1 slot2 slot3 slot4 PER
saturation, but a noticeable increase in throughput around 60 0 1024 16 0 7 0 0 0
seconds before the rate decreases to the saturation point. 2 128 8 12 0 0 0 0
2 512 8 5 0 0 0 0
Application sequence numbers can be used to determine 2 1024 8 14 12 0 0 0
lost packets, but the analysis is made difficult by out-of-order 3 128 4 4 0 0 0 0
arrivals. To infer out-of-order packets caused by the EV-DO 3 512 4 5 0 0 0 0
network, two experiments are run. Using 33 byte packets, the 3 1024 4 113 17 0 0 0
4 1024 2 33 1 0
first experiment sends data at 100 kbps from the server to the 5 2048 4 14 937 60 0 0.4%
AT (achieved rate of 85 kbps) and the second experiment sends 6 1024 1 31 0
data at 750 kbps (achieved rate of 585 kbps). Both experiments 7 2048 2 1475 18373 0.3%
run for three minutes. In the first experiment, there are no 8 3072 2 0 26774 0.7%
9 2048 1 4 0
out-of-order packets, while in the second experiment there are 10 4096 2 0 4984 1.4%
167 out-of-order packets, accounting for 0.04% of all 379198 13 5120 2 0 94 0
packets that are received.
Examining traceroute output before and after the experi-
ments indicates routing changes occurred in both the first and
at Location A (the receiving rate is 377 kbps). Transmission
second experiments. These route changes, and not the EV-DO
formats which have no packets transmitted are omitted from
link, could be the cause of the out-of-order packets observed
the table. From the table, early completion is prevalent for low
in the second experiment.
DRCs.4 For example, DRC 3 with 1024 bit EV-DO packets
F. Early completion has 113 packets complete in slot 1 and 17 in slot 2 and no
EV-DO early completion can be observed in Table IV. In the packets in the subsequent slots. However, for higher DRCs,
table, each DRC implies one or more combinations of packet all DRC slots are needed for transmission. For example, DRC
sizes (in bits) and time slots scheduled to send those packets. 10 has all EV-DO packet completions during slot 2.
This experiment runs for 278 seconds, with the server sending 4 DRC 0 and 2 have more than 4 slots but no EV-DO packets are sent in
33-byte packets at a rate of 1 Mbps to the EV-DO end device these slots.
In most cases the PER is less than 1% [13], though at DRC VI. C ONCLUSIONS
10 the PER is a little higher. The PER exhibits an increasing Though wide-spread in deployment, low-level 3G EV-DO
trend with the DRC going up, implying that packets are more analysis suitable for simulation and bandwidth estimation tech-
likely to be lost at higher DRC for the same location. niques for streaming video are not well-established. Through
G. Queue management careful experimentation and measurements with an EV-DO
Saturating traffic is sent from our server to the EV-DO end sniffer, Wireshark and application-level tools, this paper pro-
device, with the packet loss pattern is plotted in Figure 13. vides insights into EV-DO performance not previously re-
The experiment is conducted at Location A, with a fixed ported or demonstrated. The results should be useful for those
packet size of 33 bytes. All losses are in bursts of 3 or building EV-DO simulators or building bandwidth estimation
more packets, with most losses in bursts 400-1000 packets tools for streaming applications over EV-DO – both areas of
in a row. Figure 14 shows the corresponding CDF of the our future work.
time between two consecutive packet losses. Loss intervals Our preliminary investigations show Data Rate Controls
are mostly between 30 to 100 milliseconds. The bursty nature (DRCs) requested by the EV-DO ATs are centered around a
of the packet drops suggests queue management, likely above few values in the case of stationary end-hosts and somewhat
the EV-DO layer, perhaps employing an algorithm such as more scattered in case of mobile end-hosts. In all cases,
Random Early Detection (RED) [4]. DRCs observed are steadier than reported in previous work.
Measured throughputs over these DRCs exhibit consistent
10000 variance, suggesting accurate bandwidth predictions may be
made after relatively few samples.
EV-DO constructs forward link packets based on the max-
Number of Packet Losses

1000 imum packet size the current DRC allows regardless of the
original IP packet boundaries. IP packets are observed being
combined and fragmented to best fit into each EV-DO packet.
100
DRC 14 packets have 24-byte headers, but the exact size of
the EV-DO headers appears to vary with different DRCs.
10 The interarrival times of application packets are multiples
of a few milliseconds that differ by operating system on the
EV-DO end-host. At such granularities, the interarrival times
1
0 0.5 1 1.5 2 2.5 3 3.5 4 observed at the application layer are not necessarily a direct
Time (seconds) reflection of the interarrival times at the EV-DO layer.
Normal packet error rates (PERs) are less than 1%, but
Fig. 13. Packet loss over time losses tend to be bursty. When losses do occur, per-second
loss rates typically range from 20-40%.
There is no significant packet loss in Figure 13 in the initial Early completion can achieve significant gains. For DRCs
1.2 seconds, suggesting a downlink queue at the AP. Using the that have a nominal transmission duration longer than 1 time
method in [14], we calculate the queue size to be about 235 slot, in some cases most of the packets are successfully
bytes. This size does not change significantly with the packet transmitted in the first time slot. In contrast, in some cases,
size which implies the queue is a per-byte queue, rather than particularly for higher DRCs, none of the packets are received
a per-packet queue. in the first time slot.
EV-DO networks may use queue management to stop ac-
1 cepting packets into the queue when the network is congested.
0.9 When an EV-DO network receives incoming packets at a rate
0.8 higher then EV-DO can forward, the packets are dropped in
0.7 a regular discrete fashion rather than a continuous fashion as
would be the case with a drop-tail queue.
Fraction

0.6

0.5 Possible future work includes more measurements, partic-


0.4 ularly with different environmental (e.g., urban versus sub-
0.3 urban) and end-host (e.g., mobile versus stationary) character-
0.2 istics.
0.1

0
1 10 100 1000
Time between Packet Losses (Milliseconds)

Fig. 14. CDF of time between packet losses


R EFERENCES
[1] Dimitrios Koutsonikolas and Y. Charlie Hu, “On the Feasibility of
Bandwidth Estimation in 1x EVDO Networks,” in Proceedings of ACM
Workshop on Mobile Internet through Cellular Networks, Beijing, China,
Sep. 2009.
[2] C. U. Castellanos, D. L. Villa, O. M. Teyeb, J. Elling and J. Wigard,
“Comparison of Available Bandwidth Estimation Techniques in Packet-
switched Mobile Networks,” in Proceedings of IEEE Personal, Indoor
and Mobile Radio Comm. (PIMRC), Helsinki, Finland, Sep. 2006.
[3] X. Liu, A. Sridharan, S. Machiraju, M. Seshadri, and H. Zhang,
“Experiences in a 3G Network: Interplay between the Wireless Channel
and Applications,” in The ACM Annual International Conference on
Mobile Computing and Networking, San Francisco, CA, USA, Sep.
2008.
[4] S. Floyd and V. Jacobson, “Random Early Detection Gateways for
Congestion Avoidance,” IEEE/ACM Transactions on Networking, Aug.
1993.
[5] M. Claypool, R. Kinicki, W. Lee, M. Li, and G. Ratner, “Characteriza-
tion by Measurement of a CDMA 1x EVDO Network,” in International
ICST Wireless Internet Conference, Boston, MA, USA, Aug. 2006.
[6] C. Dovrolis, P. Ramanathan, and D. Moore, “Packet-Dispersion Tech-
niques and a Capacity-Estimation Methodology,” IEEE/ACM Transac-
tions on Networking, vol. 12, no. 6, pp. 963–977, 2004.
[7] M. Li, M. Claypool, and R. Kinicki, “WBest: A Bandwidth Estimation
Tool for IEEE 802.11 Wireless Networks,” in Proceedings of IEEE LCN
Conference, Montreal, QC, Canada, Oct. 2008.
[8] Q. Inc., “EV-DO Rev. A and B: Wireless Broadband for the Masses,”
2007, http://www.qualcomm.com/documents/ev-do-rev-and-b-wireless-
broadband-masses-whitepaper.
[9] CDMA Development Group, “Over 1/2 Billion CDMA
Subcribers Served and 128 Million EV-DO,” 2009,
http://www.wirelessandmobilenews.com/2009/09/over-12-billion-
cdma-subcribers-served-and-128-million-ev-do.html.
[10] Xu Cheng, Dale, C. and Jiangchuan Liu, “Statistics and Social Network
of YouTube Videos,” in International Workshop on Quality of Service,
Enschede, The Netherlands, Jun. 2008.
[11] Q. Bi, “A Forward Link Performance Study of the 1xEV-DO Rev. 0
System Using Field Measurements and Simulations,” Bell Lab Technical
Journal, Mar. 2004.
[12] M. Jain and C. Dovrolis, “End-to-End Available Bandwidth: Measure-
ment Methodology, Dynamics, and Relation with TCP Throughput,” in
ACM SIGCOMM, Pittsburgh, PA, USA, Aug. 2002, pp. 295–308.
[13] Bhushan, N., Lott, C., Black, P., Attar, R., Yu-Cheun Jou, Fan, M.,
Ghosh, D., Au, J., “CDMA2000 1xEV-DO Revision A: A Physical Layer
and MAC Layer Overview,” IEEE Communications Magazine, vol. 44,
no. 2, pp. 75–87, 2006.
[14] M. Claypool, R. Kinicki, M. Li, J. Nichols, and H. Wu, “Inferring
Queue Sizes in Access Networks by Active Measurement,” in Passive
and Active Network Measurement (PAM), Antibes Juan-les-Pins, France,
Apr. 2004.

You might also like