THROUGHPUT TEST

METHODS FOR
MIMO RADIOS
9-Jan-2014

Fanny Mlinarsky
[email protected]

Telephone: +1.978.376.5841 www.octoScope.com Massachusetts, USA

 2

Brief History of Wireless

5G
4G Key wireless
LTE-A technologies
IEEE 802 802.11n/ac
Wireless capacity / throughput

LTE
3G 802.16e
802.11a/b/g
2G WCDMA/HSxPA
GPRS
Analog CDMA
GSM IS-54
IS-136
TACS
AMPS
First cell NMT
phones

1970 1980 1990 2000 2010 2015

G = generation
www.octoscope.com
 3

Analog to Logic Transition in Radio Architecture

Baseband (Logic)
Analog Signal Source A/D D/A Conversion
RF Front End (TX/RX) RF Front End (TX/RX)

Old radio architecture Modern radio architecture

www.octoscope.com
 4

The Gs
Peak Data Rate (Mbps)
G Downlink Uplink
1 Analog 19.2 kbps
2 Digital TDMA, CDMA 14.4 kbps
Improved CDMA variants (WCDMA, CDMA2000) 144 kbps (1xRTT);
3 384 kbps (UMTS);
2.4 Mbps (EVDO)
3.5 HSPA (today) 14 Mbps 2 Mbps
HSPA (Release 7) DL 64QAM or 2x2 MIMO; UL 16QAM 28 Mbps 11.5 Mbps
3.75
HSPA (Release 8) DL 64QAM and 2x2 MIMO 42 Mbps 11.5 Mbps
WiMAX Release 1.0 TDD (2:1 UL/DL ratio), 10 MHz channel 40 Mbps 10 Mbps
3.9 LTE, FDD 5 MHz UL/DL, 2 Layers DL 43.2 Mbps 21.6 Mbps
LTE CAT-3 100 Mbps 50 Mbps
4 LTE-Advanced 1000 Mbps 500 Mbps

www.octoscope.com
 5

History of IEEE 802.11

1989: FCC authorizes ISM bands
900 MHz, 2.4 GHz, 5 GHz
1990: IEEE begins work on 802.11
1994: 2.4 GHz products begin shipping
1997: 802.11 standard approved
1998: FCC authorizes UNII Band, 5 GHz
1999: 802.11a, b ratified
2003: 802.11g ratified
2006: 802.11n draft 2 certification by the
Wi-Fi Alliance begins
2009: 802.11n certification
2013: 802.11ad (up to 6.8 Gbps) 802.11 has pioneered commercial
deployment of OFDM and MIMO
2014: 802.11ac (up to 6.9 Gbps) key wireless signaling technologies

ISM = industrial, scientific and medical

UNII = Unlicensed National Information Infrastructure

www.octoscope.com
 6

Wireless Channel

Time and frequency variable

OFDM transforms a frequency- and time-
variable fading channel into parallel
correlated flat-fading channels, enabling
wide bandwidth operation

Channel Quality
Frequency
Frequency-variable channel
appears flat over the narrow
band of an OFDM subcarrier.

OFDM = orthogonal frequency division multiplexing

www.octoscope.com
 7

MIMO Systems

MIMO systems are typically described as NxM, where N is the number

of transmitters and M is the number of receivers.

TX TX
2x2
RX MIMO radio RX
channel

TX TX

RX RX

2x2 radio 2x2 radio

MIMO = multiple input multiple output

www.octoscope.com
 8

MIMO Configurations

SISO (Single Input Single Output)

Traditional radio
MISO (Multiple Input Single Output)
Transmit diversity (STBC, SFBC, CDD)
SIMO (Single Input Multiple Output)
Receive diversity, MRC
MIMO (Multiple Input Multiple Output)
SM to transmit multiple streams simultaneously; can be used in
conjunction with CDD; works best in high SNR environments and
channels de-correlated by multipath
TX and RX diversity, used independently or together; used to enhance
throughput in the presence of adverse channel conditions
Beamforming
MIMO = multiple input multiple output
SM = spatial multiplexing
SFBC = space frequency block coding
STBC = space time block coding
CDD = cyclic delay diversity
MRC = maximal ratio combining
SM = Spatial Multiplexing
SNR = signal to noise ratio
www.octoscope.com
 9

MIMO Based RX and TX Diversity

When 2 receivers are available in a MIMO
radio MRC can be used instead of simple
diversity to combine signals from two or more
antennas, improving SNR Peak
MIMO also enables transmit diversity
techniques, including CDD, STBC, SFBC
TX diversity is used to spread the signal so as
to create artificial multipath to decorrelate
signals from different transmitters so as to
optimize signal reception Null

MIMO = multiple input multiple output

SIMO = single input multiple outputs
SM = spatial multiplexing
SFBC = space frequency block coding
STBC = space time block coding Delay is inside the TX
CDD = cyclic delay diversity
MRC = maximal ratio combining
SNR = signal to noise ratio

www.octoscope.com
 10

MIMO Channel Correlation

Correlation represents an ability to send
multiple spatial streams in the same channel Beamforming example
and in the same cell
According to Shannon law the lower the
MIMO channel correlation the higher the
MIMO channel capacity
Correlation is a function of
TX and RX antenna correlation (function of
antenna spacing and polarization)
Angular spread of reflections (multipath
widens AS and thus lowers correlation)
TX diversity techniques (e.g. time offsetting of
two TX transmissions to emulate multipath, Focused RF beam forms by
reduce correlation) combining radiation from multiple
phase-locked antenna elements.
Beamforming
MIMO = multiple input multiple output
MU-MIMO multi-user MIMO Helps enable SM and MU-MIMO
SM = spatial multiplexing

www.octoscope.com
 11

MIMO Channel Capacity

Approaching 2x gain at low

correlation and high SNR Variation due
to antenna
correlation

MIMO gain is made

Typical 2- possible by low
stream MIMO correlation and high
channel SNR.

Under average
Typical SISO channel channel conditions
MIMO gain may be
only ~ 20%.

SNR = signal to noise ratio Credit: Moray Rumney

= TX antenna correlation Agilent Technologies Inc.
= RX antenna correlation

www.octoscope.com
 12

Throughput vs. Angular Spread

Shorter distance = wider angular spread = higher throughput

4 8 8
Open air -
throughput
decreases
with distance

Initiation algorithm ?exploring the airlink for a few seconds?

Source: SmallNetBuilder.com measurement (linksys_ea6500_5ghz_80mhz_up_mpe_vs_openair.png)

www.octoscope.com
 13

Linksys EA6500 3x3 11a/b/g/n/ac AP/router

Wide angular spread in a small anechoic chamber

http://www.smallnetbuilder.com/wireless/wireless-howto/32082-how-we-test-wireless-products-revison-7 www.octoscope.com
 14

MIMO Test Challenges

Getting repeatable and consistent measurements is next to impossible in open air
conditions. The reasons?
1. Modern wireless devices are designed to automatically adapt to the changing
channel conditions.
2. Adaptation algorithms programmed into the baseband layer of these radios
are complex and sometimes get into unintended states.
3. Wireless environment is time-, frequency- and position- variable in terms of
path loss, multipath, Doppler effects and interference, often stumping the
decision logic of the adaptation algorithms.
MIMO radios can change their data rate from 1 Mbps to over 1 Gbps on a packet-
by-packet basis [12].

www.octoscope.com
 15

Adaptation Parameters 802.11a/b/g/n/ac

Adaptation Variables
Modulation BPSK, QPSK, 16-QAM, 65-QAM, 256-QAM
Signaling CCK, DSSS, OFDM
Coding rate 1/2, 3/4, 5/6
# spatial streams 1 to 8
Wi-Fi: 20/40/80/160 MHz
Channel width
LTE: up to 20 MHz
Guard Interval (GI) Wi-Fi: 400/800 ns; LTE: 5.2 usec
Spatial Multiplexing (SM)
TX diversity
MIMO mode
RX diversity
Beamforming

Refer to 802.11ac document [2] for details of the latest 802.11 technology

www.octoscope.com
 16

Data Rate Adaptation Example - 802.11g

Adaptation algorithms
are stateful.

In this example data

rate never recovers to
its peak value of 54
Mbps even though
favorable channel
conditions are
restored.

www.octoscope.com
 17

Example of 802.11ac Device Throughput

Example of throughput measurement of an 802.11ac link using IxChariotTM. In this

example the test conditions are static, but it appears that the adaptation algorithm of
the TX DUT keeps making adjustments resulting in throughput fluctuations vs. time.

www.octoscope.com
 18

MIMO Modes of Transmission

MIMO Mode Explanation
Spatial Multiplexing Use of multiple MIMO radios to transmit two or more data streams in the
same channel.
TX diversity Use of multiple MIMO radios to transmit slightly different versions of the
same signal in order to optimize reception of at least one of these versions.
TX diversity schemes include space time block coding (STBC), space
frequency block coding (SFBC) and cyclic delay diversity (CDD).
RX diversity Use of multiple MIMO radios to combine multiple received versions of the
same signal in order to minimize PER. A common RX diversity technique is
maximal ratio combining (MRC).
Combination of TX and RX diversity Use of TX diversity at the transmitting device in combination with RX
diversity at the receiving device.
Beamforming Use of multiple MIMO transmitters to create a focused beam, thereby
extending the range of the link or enabling SM.
Multi-user MIMO (MU-MIMO) Forming multiple focused beams or using TX diversity techniques to enable
simultaneous communications with multiple device. Typically beamforming is
done by a base station or an access point (AP) to communicate
simultaneously with multiple client devices.

www.octoscope.com
 19

Factors Impacting MIMO Throughput

Factors Explanation/Impact Notes
MIMO channel Function of several variables including The lower the correlation the higher the throughput
correlation device antenna spacing, antenna
polarization and multipath
Angular spread of the Related to correlation and strongly Multipath causes signal to bounce around and arrive at
received signal influenced by multipath in the channel different angles, thereby widening the angular spread at a
receiver. Typically, the wider the angular spread the higher
the MIMO throughput.
Device antenna Related to angular spread and MIMO throughput will vary vs. device orientation and
spacing and device correlation antenna spacing. Typically, the wider the antenna spacing
orientation the lower the correlation and the higher the throughput.
Antenna polarization Vertical, horizontal or circular Cross-polarization (vertical and horizontal) is sometimes
used to lower MIMO correlation, thus enabling spatial
multiplexing. Multipath reflections can alter polarization.
Noise and High noise power with respect to signal MIMO devices can adapt to the environment by selecting the
interference power results in low SNR (signal to most suitable mode of operation (e.g. TX diversity in low
noise ratio) SNR conditions; spatial multiplexing in high SNR, low
correlation conditions).
Motion of devices or Causes Doppler spread of the signal OFDM signaling is sensitive to Doppler spread. Throughput
multipath reflectors should be measured in a variety of Doppler environments.
Delay spread of Causes clusters of reflections to arrive Delay spread is higher for larger spaces (e.g. outdoors) than
reflections at the receiver at different times for smaller spaces (e.g. home environment)

www.octoscope.com
 20

Evolution of Wireless Testbed Architecture

Isolation box

MIMO OTA

SISO conducted Multi Path Emulator (MPE)

Fader or MPE [1]

New generation wireless testbeds must support

MIMO OTA testing to accommodate MIMO and
multi-radio devices with internal antennas.

www.octoscope.com
 21

Shape of Antenna Field

Shape of the
simulation of a dipole antenna field
antenna field
varies from
product to product
Field can be
blocked by metal
surfaces such as
batteries, ground open air inside a Wi-Fi device

planes, etc.

www.octoscope.com
 22

DUT Rotation for Throughput Testing

Master
Bi-directional traffic

0 iPerf
DUT 90
iPerf 180
270

Rotate the DUT and average results for at least 4

orientations. Alternatively, place DUT on a turntable.

www.octoscope.com
 23

Test Environments per 802.11.2

Source: 802.11.2 [14]

= controlled
environment

www.octoscope.com
 24

MIMO OTA Test Methods

Base Station Emulator

Channel Emulator

RF Amplifier and
Calibration
Subsystem

Being standardized by 3GPP [10] and CTIA [11]

Anechoic chamber
Reverberation chamber

www.octoscope.com
 25

Wireless Channel
Multipath cluster
model

Composite angular spread

Per path angular spread

Composite angular spread

Multipath and Doppler

fading in the channel

www.octoscope.com
 26

Concept of Clusters and Power Delay Profile

Cluster 1

Cluster 2 Single cluster of energy

bouncing back and forth and
dying out vs. time.

Cluster 3

Power Delay Profile (PDP) of 802.11n model D

www.octoscope.com
 27

802.11n Channel Models - Summary

Model [3] Distance to 1st # taps Delay Max delay # clusters

wall (avg) spread
(rms)
A* test model 1 0 ns 0 ns
B Residential 5m 9 15 ns 80 ns 2
C small office 5m 14 30 ns 200 ns 2
D typical office 10 m 18 50 ns 390 ns 3
E large office 20 m 18 100 ns 730 ns 4
F large space 30 m 18 150 ns 1050 ns 6
(indoor or outdoor)
* Model A is a flat fading model; no delay spread and no multipath

The LOS component is not present if the distance between the transmitter and the receiver
is greater than the distance to 1st wall.

www.octoscope.com
 28

Channel Emulation Requirements Summary

802.11ac LTE (36-521 Annex

802.11n
80 MHz 160 MHz B)
RF bandwidth
(no channel 40 MHz 80 MHz 160 MHz 20 MHz
aggregation)
EVM (avg down- -28 dBm -32 dBm -32 dBm -22 dBm
fading is -40 dB) (64QAM) (256QAM) (256QAM) (8% 64QAM)
TDL Taps 18 35 69 9
Delay resolution 10 ns 5 ns 2.5 ns 10 ns

www.octoscope.com
 29

3GPP and 802.11 Channel Models

Parameter Model Name References and Notes
3GPP Models (RTL) LTE: EPA 5Hz; EVA 5Hz; EVA 3GPP TS 36.521-1 V10.0.0 (2011-12)
70Hz; ETU 70Hz; ETU 300Hz; 3GPP TS 36.101 V10.5.0 (2011-12)
High speed train; MBSFN
GSM: RAx; HTx; TUx; EQx; TIx 3GPP TS 45.005 V10.3.0 (2011-11) Annex C

3G: PA3; PB3; VA30; VA120; 3GPP TS 25.101 V11.0.0 (2011-12)

High speed train; Birth-Death 3GPP TS 25.104 V11.0.0 (2011-12)
propagation; Moving 3GPP TS 36.521-1 V10.0.0 (2011-12)
propagation; MBSFN
IEEE 802.11n/ac Models A, B, C, D, E, F IEEE 802.11-03/940r4
(software) IEEE 11-09-0569
Channel modelling Tap: delay, Doppler, PDP weight
building blocks (RTL) Path: list of taps
System: NxM, correlation matrix

www.octoscope.com
 30

octoBox MPE MIMO OTA Testbed

Test Antennas

DUT AP
Ethernet
Traffic Filter
TX/RX

Multipath
segment

Attenuators

Ethernet
Remote
Filter
Desktop Master Client

octoBox

Testbed being used for benchmarking

http://www.smallnetbuilder.com/wireless/wireless-howto/32082-how-
we-test-wireless-products-revison-7
MPE = multi path emulator

www.octoscope.com
 31

octoBox MPE Response vs. IEEE Model B

www.octoscope.com
 32

octoBox MPE Frequency Response

www.octoscope.com
 33

Example Throughput vs. Atten Measurements

Source: www.smallnetbuilder.com

www.octoscope.com
 34

Controlled RF Environment Testing

www.octoscope.com
 35

Isolating DUTs in a Wireless Testbed

www.octoscope.com
 36

How to Select RF Isolation Chamber

There are two issues to be
aware of when selecting an
isolation chamber:
Isolation specifications often dont
include the impact of data and
power cables that must penetrate
the walls of the chamber to power
and control the DUT inside during
the test.
Most isolation boxes on the
market are not designed for OTA
coupling. OTA support requires
high isolation, absorption and
special conditions to enable high
MIMO throughput.

OTA = over the air www.octoscope.com

 37

Concluding Thoughts
Test engineers face difficult challenges when measuring MIMO
throughput because
Wireless channel environment is constantly changing
Radio operating mode changes to adapt to the changing environment
Makes it difficult to obtain repeatable test results
To guarantee repeatable and meaningful results the testbed must be
Capable of creating a range of realistic wireless channel conditions in a
consistent manner
Well isolated to keep interference from impacting the performance of highly
sensitive radios
Easy to maintain isolation vs. use
A testbed used for benchmarking must be able to support multiple
spatial streams showing maximum throughput of the DUT

www.octoscope.com
 38

References
1. Azimuth ACE, Spirent VR5, Anite Propsim faders are the most popular faders on the market today. octoScopes multipath emulator, MPE,
is a simpler non-programmable fader that comes built into a controlled environment test bed with 2 octoBox anechoic chambers.

2. IEEE P802.11ac/D6.0, Draft STANDARD for Information Technology Telecommunications and information exchange between systems
Local and metropolitan area networks Specific requirements Part 11: Wireless LAN Medium Access Control (MAC) and Physical
Layer (PHY) specifications Amendment 4: Enhancements for Very High Throughput for Operation in Bands below 6 GHz, July 2013

3. IEEE, 802.11-03/940r4: TGn Channel Models; May 10, 2004

4. IEEE, 11-09-0569 , TGac Channel Model Addendum Supporting Material, May 2009

5. TS 25.101, Annex B, User Equipment (UE) radio transmission and reception (FDD),

6. TS 36.101, Annex B, Evolved Universal Terrestrial Radio Access (E-UTRA); User Equipment (UE) radio transmission and reception

7. TS 36.521-1, Annex B, Evolved Universal Terrestrial Radio Access (E-UTRA); User Equipment (UE) conformance specification Radio
transmission and reception Part 1: Conformance Testing

8. TS 45.005, Annex C, GSM/EDGE Radio Access Network; Radio transmission and reception

9. TS 51.010-1, Mobile Station (MS) conformance specification; Part 1: Conformance specification

10. 3GPP TR 37.977 V1.2.0 (2013-11), Verification of radiated multi-antenna reception performance of User Equipment (UE), Release 12,
November 2013

11. CTIA, Test Plan for Mobile Station Over the Air Performance - Method of Measurement for Radiated RF Power and Receiver
Performance, Revision 3.1, January 2011

12. 802.11 Data Rate Computation spreadsheet, 12/2013, http://www.octoscope.com/cgi-

bin/start.cgi/Array_Pages/Entrance_RequestArticles.html?SourceCode=Whitepapers

13. octoBox Isolation Test Report, 12/2013, http://www.octoscope.com/English/Collaterals/Documents/octoBox_Isolation_Measurements.pdf

14. IEEE P802.11.2/D1.0, Draft Recommended Practice for the Evaluation of 802.11 Wireless Performance, April 2007
www.octoscope.com
 39

For More Information

To download white papers, presentations, test reports and

articles on wireless topics, please visit
http://www.octoscope.com/English/Resources/Articles.html

www.octoscope.com

www.octoscope.com
 40

LTE Throughput Test

Informal drive-through testing of initial Verizon LTE

deployments in the Boston area
Measure throughput using www.speedtest.net
Based on our sniffer measurements of the
speedtest.net running on the desktop and iPhone:
The program uses HTTP protocol to download and upload
large images multiple times
The test runs for about 10 sec in each direction
Ookla operates speedtest.net using many servers
around the world and routing the test traffic to the
nearest server
http://www.ookla.com/speedtest.php

www.octoscope.com
 octoScopes LTE Throughput Measurements

DL/UL, Mbps

www.octoscope.com
 LTE Measurements

Location in the car DL (kbps) UL (kbps) Latency (ms)

Inside center of the car 14800 5499 112
Inside driver front window 14527 8824 107
Inside passenger front window 13687 8001 111
Outside the car 19703 8587 112

LTE Measurements: Impact of Speed (60 mph in open space)

36 Mbps DL 8 Mbps UL

DL = downlink
Measurements performed by octoScope in October 2011 UL = uplink
www.octoscope.com