Bad Measurements Make a Bad Network:

How to Boost the Reliability of Your Wi-Fi

1
Contents
Executive Summary.....................................................................................................................................3

Risks of Imprecise Signal Strength Readings..........................................................................................4

Accuracy in Wi-Fi Design Matters ..........................................................................................................5

Accurate Signal Strength Readings: The Key to Good Wi-Fi Networks..........................................8

External Testing Proves Ekahau Sidekick is the Most Accurate Survey Device on the
Market...........................................................................................................................................................................10

How the Devices Were Measured...............................................................................................10

1st Key Finding: Sidekick Offers Unmatched Precision..........................................................12

2nd Key Finding: Sidekick’s Omni-directional Antennas Enable Precise Readings,

Regardless of AP Direction.............................................................................................................15

3rd Key Finding: Sidekick Units Function Consistently...........................................................17

Conclusion: Sidekick is the Best Tool for Wi-Fi Professionals Who Want Consistently
Accurate Survey Data...............................................................................................................................19

About Ekahau.............................................................................................................................................20

2
Executive
Summary
Wi-Fi is a mission-critical tool in virtually every Their imprecise readings can result in additional
industry sector. In business, retail, manufacturing, hours, or even days, of re-work that may result
healthcare, education, and beyond, users need in a larger hardware investment that not only
access to secure, reliable Wi-Fi to do their jobs. doesn’t improve performance but may diminish
it even further.
Having a spotty or slow network is no longer
acceptable. Wi-Fi professionals need to design These risks can be avoided with the
and deploy reliable Wi-Fi that meets customer Ekahau Sidekick®.
needs in a timely and cost-efficient manner.
Accurate site survey measurements are critical This application note details the results of
to making this possible. an external professional-grade lab comparing
the performance of Ekahau Sidekick and
Unfortunately, the traditional, commonly used USB-based Wi-Fi adapters Proxim 8494 and
USB-based Wi-Fi adapters provide inconsistent Comfast CF-912AC. Findings from these tests
and inaccurate measurements. This leaves show that the Ekahau Sidekick is a substantially
Wi-Fi professionals with an incomplete, often more accurate tool and will help boost the
false picture of the network performance. reliability of Wi-Fi networks with better
The problem is compounded when these measurement data.
adapters are employed to re-survey the site
after the network problems are fixed.

3
Risks of USB adapters have been used for Wi-Fi
measurement for years, but this is simply

Imprecise because purpose-built measurement devices

were not available. USB adapters were created

Signal Strength as add-on components for laptops lacking the

latest Wi-Fi technology. Their primary purpose

Readings has been to establish decent wireless data

connection, and not to measure RF signal
strength precisely. Thus, it’s unsurprising that
Wi-Fi professionals have a critical job to do
signal data is highly compromised when relying
and the last thing they need is their reputation
on these devices for accurate measurements.
to take a hit due to inaccurate measurement
data. In fast moving technology businesses,
Wi-Fi professionals care about doing good
professionals typically want to stay ahead
work and the last thing they want to have
of the curve when it comes to new and better
happen is to get a barrage of user complaints
tools and solutions.
about the network performance causing
re-work. It’s expensive and time-consuming
Using outdated technology puts them in an
to go back and correct errors forced by poor
unfortunate position with misleading data
signal readings during a site survey – if the
about the technical parameters of the network
source of the errors can even be found.
performance. By using traditional tools like
Without accurate tools to re-survey the site,
USB dongles and Wi-Fi adapters (for example,
Wi-Fi professionals run the risk of making
Proxim 8494 or Comfast CF-912AC) for signal
changes that only cost the customer more
strength measurements, the surveyor may or
money – without actually solving the problem.
may not be able to deliver sufficiently accurate
measurements. Since accuracy depends on
walking direction, posture, as well as the angle
in which the measuring device is held in relation
to access points, users can be lucky and achieve
reasonable results. However, the problem is
they can’t be certain that the measurements
are correct or repeatable which creates a false
sense of security during the design process.

4
Accuracy in Let’s look at an example.

Wi-Fi Design Below are two signal strength heatmaps.

In Image 1 the building is surveyed with the

Matters Ekahau Sidekick. Against the set performance

requirements, this network looks as if it will
perform well. A few areas exhibit slightly
If you’re dubious about this statement, consider
smaller margin (yellow areas), but overall the
what can happen when you design your Wi-Fi
minimum requirements are met.
network based on signal strength readings that
are inaccurate.

Image 1: An example of a heatmap with accurate signal strength measurements

5
 Falsely reported gaps in network coverage

Image 2: A signal strength heatmap of the same network, generated by a less accurate device

Now let’s look at another heatmap for the impacted the measured signal strength.
same network, floor and access points in In some locations the signal was measured
Image 2. This time the data is visualized by weaker than it actually was, simply due to the
readings from a less precise survey tool. direction the surveyor was facing. Imprecise
measuring devices can pick up signal strength
In this scenario, we see that network coverage differently depending on access point direction
appears to be good in most areas, but in other and resulting angle. If the surveyor had walked
areas the performance requirements look as a different way, the heatmap might look
if they were not met. different.

However, in reality, this is not the case. The If the Wi-Fi designer only had the heatmap
spotty signal coverage is not because the signal in Image 2 available, what would need to
strength was low, but rather because the meas- be fixed to solve the problem? Most likely
urement data was negatively affected by the the Wi-Fi professional would install a few
poor accuracy of the measurement device. additional access points (APs). In this specific
case there were originally 58 APs.
The direction in which the surveyor walked
versus the access point location clearly

6
To fix the falsely assumed coverage gaps they This is a situation no one wants to be in.
would probably plan to add 9 additional APs, Fortunately, the risks of inaccuracy in Wi-Fi
and with those they would expect that are balanced by the of benefits to doing the
the coverage gaps problems had been fixed. job right and conducting an accurate survey.

But, in fact, as shown in Image 1, the Good measurements enable a good design that
requirements were already met: The network equals good Wi-Fi. At a time when secure and
wasn’t bad, only the measurement data was. reliable Wi-Fi is mission-critical, Wi-Fi
All that would have been accomplished professionals have the opportunity to help
was making another 15% investment into their clients reap important benefits such as:
network infrastructure to fix an imaginary
problem. Plus, by adding extra access points, • Enhanced communication and productivity
they would also increase the overall in business, manufacturing and warehouse
interference level, degrading the data rates environments
and capacity for network users- not to mention • Boosted customer experience and loyalty
the hours spent installing more access points in retail establishments
that weren’t really needed. • Improved customer satisfaction in hotels
• Expedited access to data that can save lives
After deploying those new access points, in hospitals
if an imprecise tool was once again used in the • Increased access to knowledge and learning
follow-up survey, the data could again be spoiled opportunities in schools and universities
by inaccuracies, making troubleshooting difficult.
Wi-Fi professionals can create these benefits for
To summarize, less accurate survey device their customers by using tools that enable better
created several issues: Wi-Fi design through accurate signal strength
readings.
• Prompted additional hardware investment,
and generated unnecessary expenses
• Resulted in a slower network with overall
smaller capacity
• Cost the Wi-Fi designer wasted time
installing and testing additional hardware
• Created a troubleshooting nightmare
by using an inaccurate device
• Weakened the professional credibility
of the Wi-Fi designer

7
Accurate
Signal Strength
Readings:
The Key to Good
Image 4: Each network vendor has their signal strength
requirement guideline for great Wi-Fi design

Wi-Fi Networks
To reliably strike the right balance with signal
Signal strength is the key parameter to strength, network vendors provide design
signal-to-noise ratio (SNR) which dictates guidelines for network planning purposes.
the available modulation methods and However, in order to verify that a network
maximum bit rates. really meets these requirements, there needs
to be accurate data measurements. A variety
of factors can hobble the measurements and
Signal Strength Channel Noise,
(RSSI) Interference making them unreliable:

• RF environment fluctuations
• Various survey device antenna design
Signal-to-Noise Ratio (SNR) constraints
• Impact of surveyor behavior, including
the route taken during the survey, how
the device is carried, or at what speed
• Compromises in electrical or RF
Network Capacity Available
engineering of the measurement device
• Manufacturing variability due to
Image 3: Signal strength (RSSI) is the fundamental
component, material or assembly
technical metrics to design for
process inaccuracies
If the signal strength is weak it means
network capacity is limited. On the other Bad data resulting from any of these can
hand, unnecessarily high signal strength leads put Wi-Fi professionals in the undesirable
to unwanted network capacity limitations in position of making critical decisions based
the form of additional interference with other on guesses.
access points.

8
To illustrate what this looks like on a site Each star symbol in the heatmap legend
survey, consider one physical location on the below represents a single measurement in
floor plan in Image 5. To make it simple, as- the specific red circle location. We can see
sume the signal strength is measured several the wide range of dBm values measured by
times in the same location (circled Device A in green, compared with Device B in
in red). In a normal situation multiple red.
measures of the same spot in a site survey
would not typically happen but this
experiment can be revealing.

Image 5: Repeated survey device measurements of the same location generate different values.
Each cross in the heat map on the right represents a single RF measurement of the
space in the red circle in the floor plan on the left.

For Device A, the distribution and center It’s difficult from this data to conclude
point of the measurements on the dBm scale whether the network is performing well
are nicely packed mostly over a single-color or poorly, and within what margin. Do we
band (around yellow), while survey Device B’s need more access points? Or is this location
measurements are spread widely along the well-covered?
scale (from grey to green).
Fortunately, this uncertainty can be
For any professional Wi-Fi designer, eliminated from your site surveys. Using
it’s obvious that survey Device B is a survey device that offers consistently
not a very reliable data collection tool. accurate readings, Wi-Fi professionals
The measurement data for the very same can trust their measurements.
location ranges widely from good to bad.

9
External Testing the Ekahau Sidekick, the Proxim 8494,
and Comfast CF-912AC USB adapters.

Proves Ekahau The testing confirms that Ekahau Sidekick

consistently outperforms the adapters by

Sidekick is the a significant margin, proving that it’s the most

accurate survey device on the market.

Most Accurate How the Devices Were Measured

Survey Device Test setup is illustrated below. These tests

on the Market
were executed in a professional room-sized RF
isolated anechoic test chamber to eliminate
external noise, unwanted signals and multipath
To quantify Ekahau Sidekick’s accuracy, Ekahau components (i.e., reflections).
commissioned an external RF lab specialized
in product verification and validation services.
This lab conducted a series of tests comparing

Image 6: Test arrangement for the measurements in the RF laboratory

10
A laboratory-grade vector signal and was attached in the automatically
generator (Anritsu MS2692A) was used as adjustable turning table with two axes.
a transmitter to generate 802.11g 6 Mbps Axis one enabled horizontal rotation of
OFDM modulated Wi-Fi beacons. The signal the device (azimuth angle), simulated
generator was connected to a specially a variety of walking directions toward the
designed transmit (TX) antenna in which both transmitter. Azimuth angles were tested
vertical and horizontal polarization were able across 360 degrees. Axis two enabled
to be connected separately without physically elevation angle adjustment across 180
turning the antenna. The transmit power degrees, simulating the impact of the
level at the signal generator was set at 0 dBm. access point on different elevations. Angle
The attenuation/gain of the cabling and adjustment was always fixed at 15 degrees.
antenna were accounted for. During testing
it was possible to automatically set the TX The TX antenna remained in place in all
frequency to any Wi-Fi channel as well as DUT tilting, but the effect was the same as
any chosen polarization. if the TX antenna had varied its angles. With
all these angle variations, polarizations and
The Device Under Test (DUT) was placed Wi-Fi channels, there were several thousand
3 meters from the transmitting antenna, different test points covered.
escaping the effects of the near-field area,

Image 7: Test setup in the RF laboratory Image 8: Rotation table for device under test (DUT)

11
1 Key Finding:
st The following graph measures frequency
response – or measured signal strength as

Sidekick Offers a function of Wi-Fi channel, i.e. frequency –

for the Ekahau Sidekick. Each measurement

Unmatched per Wi-Fi channel is plotted as a small dot to

illustrate the distribution. Variation between

Precision the lowest and highest signal strength

measured on each channel is highlighted in
blue. The median curve is drawn in blue over
Using the test setup described above, the lab
the Wi-Fi bands, showing average signal
gathered measurement data, using a vertically
strength on that channel.
polarized transmitting antenna, to draw the
complete frequency response and its variation.

Image 9: Frequency response variation for the Ekahau Sidekick

The fundamental concept of accuracy, Numerically speaking, the variation in Ekahau

precision, is very visible in the graph. Sidekick is on average a bit over 5 dB, ranging
Precision represents the random variation from 4 dB (Ch1) to 8 dB (Ch64), which is
in the measurements, something that makes a rather narrow range of uncertainty in signal
the measured values spread around some strength measurement. This represents very
middle point when the measurement is good precision, especially considering that the
repeated. test set up simulates many different angles
from which access point signals would be
received in a practical survey.

12
To put this in context, the lab conducted the survey adapter, and lastly with the Comfast
same test on other typical survey devices: CF-912AC USB survey adapter, the lower
first with the Proxim 8494 USB adapter, cost option. Their frequency response graphs
traditionally considered the reference quality are below.

Image 10: Frequency response variation for the Proxim 8494

Image 11: Frequency response variation for the Comfast CF-912AC

13
With both USB adapters the variation is much that cause the received signal to vary highly,
wider. In the case of Proxim 8494 in Image 10, depending on direction and angle of the
it is on average 26 dB (19 dB to 35 dB). And in adapter. In other words, how accurately
the case of Comfast CF-912AC in Image 11 it the adapters measure signal strength largely
also is approximately 25 dB (17 dB to 42 dB). depends how they are held by the user during
the survey. Walking direction in relation to
Precision of both adapters is mostly \AP location further impacts the precision
compromised by poor antenna patterns of signal strength measurement.

Image 12: Average variation over Wi-Fi channels in dBm

14
2 Key Finding:
nd The setup repeated previous measurements
but replaced the laboratory signal generator

Sidekick’s and special antenna with a commercial Cisco

AP3802 802.11ac access point. According to

Omni-directional the AP’s specs, it contains 12 antennas placed

in cross-polarization.

Antennas Enable Transmit power (emitted) was measured,

Precise Readings, indicating what absolute signal levels to expect.
The device was also rotated over both axes:
Regardless of azimuth and elevation.

AP Direction Image 13 and Image 14 show two channels:

Channel 6 in the 2.4 GHz band and Channel
In light of previous test results, a second test 52 in the 5 GHz band. The antenna pattern
was conducted to determine what happens is plotted in both horizontal and vertical
when access points are installed below and planes. The azimuth (rotation) angle is graphed
above the area where the survey device is on the top and measures the view downwards
typically carried. How would the three devices from above the device during the survey. This
perform when the signal was received from view is a 360-degree polar graph, where each
above, below or behind, for example, a bench? presented angle shows a different relational
direction towards the access point.

2.4 GHz (Ch 6) 5 GHz (Ch 52)

Image 13: Antenna pattern of Ekahau Sidekick over azimuth rotation angle

15
 Image 14: Antenna pattern of Ekahau Sidekick over elevation angles

The distance from the center is the signal From the curves, one can conclude that
strength measured in the corresponding angle. Ekahau Sidekick has very circular antenna
The ideal antenna pattern curve is a perfect patterns, with variation over angles within the
circle. 4 dB range (-1 dB to 3 dB). This range is small
enough for Ekahau Sidekick to function
Image 14 graphs, elevation angle, practically as omni-directional. The graphs
is the view from the side during the survey. also show how accurately Ekahau Sidekick
This is similar to the polar graph, but now measures compared to the reference signal
only shows angles from +90 to -90 degrees. level (absolute truth).
The extreme ends represent cases where the
access point is straight above or below the In other words, it doesn’t matter where the
survey device. And zero degrees point shows access point sits relative to the surveyor or the
where the access point is on the same level direction the user is walking while surveying.
(same elevation) as the survey device. Again, The signal strength is always reliably obtained
the ideal antenna pattern curve would be precisely and accurately when using the Ekahau
a perfect half circle. Sidekick.

16
3 Key Finding:
rd Only a limited variation in the signal strength
is allowed for each device. If the device passes

Sidekick Units all these RF tests, it is accepted for customer

shipment.

Function To illustrate production consistency, units were

Consistently randomly chosen from the production line and

tested for frequency response as previously
described.
Production of the Ekahau Sidekick is
designed to ensure that each device provides
Image 15 shows the median frequency curve
measurements that closely mirror those
of all of the tested units. The ideal result would
of every other Sidekick. This is achieved by
be identical curves. The test shows a small
testing every unit on the production line to
variation, all within a magnitude of 2 dB, which
a stringent set of performance requirements.
in practical terms is negligible and proves the
consistency of Ekahau Sidekick units.
Ekahau verifies the RF for each antenna
separately and compares it to a reference
device unit.

Image 15: Frequency response curves of six randomly chosen Ekahau Sidekicks

17
The Sidekick also consistently delivers dBm In the top graph, the blue bar shows how
readings within a narrow band. Image 16 below accurately the Ekahau Sidekick reported signal
compares the accuracy of the three survey strength. Proxim 8494 and Comfast CF-912AC
devices in terms of dBm readings. Using one would have reported the same but with clearly
given location, the graph shows how the higher variance. In some readings they would
different survey devices would behave in have measured the signal correctly, but it’s
a typical survey scenario. The red line shows more likely they would have reported bad data.
actual signal strength in that single location.

Image 16: Comparison of survey tools in terms of their measurement variation around the actual signal

18
Conclusion: tools that are equally accurate and comparable,
it enables individuals to share their work

Sidekick is to help expedite Wi-Fi design projects and

meet the network vendors design guidelines.

the Best Tool However, in order to verify that a network

for Wi-Fi really meets these requirements, there needs

to be accurate, consistent and comparable,
Professionals measurements.

Who Want
Consistently
Accurate
Survey Data
Unmatched precision is one of the greatest
benefits of Ekahau Sidekick. A user can trust
the signal strength reading in all conditions,
regardless of the direction the surveyor walks,
or where the APs are physically located.
The Ekahau Sidekick offers:
This dramatically reduces the time Wi-Fi
• Unmatched precision
professionals spends and enables them to
• Omni-directional antennas which enable
conduct extremely accurate surveys in much
precise readings, regardless of AP direction
less time. It also allows surveys to be to be
• Consistency between Sidekick units
delegated to those with less expertise freeing
• Narrow band dBm readings
up Wi-Fi professionals for other projects.

Wi-Fi is a mission-critical tool in every industry.

Achieving these same results reliably with
Wi-Fi professionals need to design and deploy
USB adapters can be challenging since it
reliable Wi-Fi that meets customer needs in a
requires the surveyor to ensure that the
timely and cost-efficient manner. The Ekahau
adapter antenna is always in acceptable
Sidekick accurate site survey measurements
orientation toward the access points.
are critical component to making this possible.
When a team surveys a larger network, using

19
About Ekahau
Wi-Fi is like electricity in today’s business world. and Ekahau Analyzer redefines the future of
Work stops when the Wi-Fi is down. That’s why troubleshooting through faster, easier, and more
Ekahau is used by the world’s biggest brands accurate network health validation.
(New York Yankees, Amazon, Google, Microsoft,
Harvard University, and more) and for the most Ekahau is headquartered in Reston, Virginia
important events, including Super Bowls and has much of its R&D and product related
and product launches. Ekahau Connect functions in Helsinki, Finland.
revolutionizes Wi-Fi planning, analysis and
troubleshooting; Ekahau Sidekick sets the
industry standard for enterprise Wi-Fi
measurement; Ekahau Survey for iPad and
iPhone changes the game for Wi-Fi site surveys;

Copyright © 2020 Ekahau. All rights reserved. No part of this publication may be reproduced, distributed, or transmitted in any form or by any
means, including photocopying, recording, or other electronic or mechanical methods, without the prior written permission of the publisher,
except in the case of noncommercial uses permitted by copyright law.

20
Ekahau Headquarters
1925 Isaac Newton Square E.
Suite 200, Reston, VA 20190
Tel: 1-866-435-2428
Americas: [email protected]

Ekahau Europe
Jaakonkatu 5
00100 Helsinki, Finland
Tel: +358-20-743 5910
EMEA/APAC: [email protected]