Manual - QualiPoc Handheld
Manual - QualiPoc Handheld
QualiPoc
Handheld
Manual
Release 18.0
(ÜI_ÌJ)
7825476226
Manual
Version 18.0
The software contained in this product makes use of several valuable open source software packages. For information, see the
"Open Source Acknowledgment" on the user documentation CD-ROM (included in delivery).
Rohde & Schwarz would like to thank the open source community for their valuable contribution to embedded computing.
© SwissQual AG
Allmendweg 8, 4528 Zuchwil, Switzerland
Phone: +41 32 686 65 65
Fax:+41 32 686 65 66
E-mail: [email protected]
Internet: http://www.swissqual.com/
Printed in Germany – Subject to change – Data without tolerance limits is not binding.
R&S® is a registered trademark of Rohde & Schwarz GmbH & Co. KG.
Trade names are trademarks of the owners.
SwissQual has made every effort to ensure that eventual instructions contained in the document are adequate and free of errors and
omissions. SwissQual will, if necessary, explain issues which may not be covered by the documents. SwissQual’s liability for any
errors in the documents is limited to the correction of errors and the aforementioned advisory services.
Copyright 2000 - 2018 SwissQual AG. All rights reserved.
No part of this publication may be copied, distributed, transmitted, transcribed, stored in a retrieval system, or translated into any
human or computer language without the prior written permission of SwissQual AG.
Confidential materials.
All information in this document is regarded as commercial valuable, protected and privileged intellectual property, and is provided
under the terms of existing Non-Disclosure Agreements or as commercial-in-confidence material.
When you refer to a SwissQual technology or product, you must acknowledge the respective text or logo trademark somewhere in
your text.
SwissQual®, Seven.Five®, SQuad®, QualiPoc®, NetQual®, VQuad®, Diversity® as well as the following logos are registered trade-
marks of SwissQual AG.
Diversity ExplorerTM, Diversity RangerTM, Diversity UnattendedTM, NiNA+TM, NiNATM, NQAgentTM, NQCommTM, NQDITM, NQTMTM,
NQViewTM, NQWebTM, QPControlTM, QPViewTM, QualiPoc FreeriderTM, QualiPoc iQTM, QualiPoc MobileTM, QualiPoc StaticTM, Quali-
Watch-MTM, QualiWatch-STM, SystemInspectorTM, TestManagerTM, VMonTM, VQuad-HDTM are trademarks of SwissQual AG.
Contents
1 Introduction.......................................................................................... 13
1.1 QualiPoc Android Versions........................................................................................14
1.2 Service Tests............................................................................................................... 14
1.3 Device Support............................................................................................................14
1.4 Post-Processing Software..........................................................................................15
1.5 Related Documents.....................................................................................................15
3 Using QualiPoc.....................................................................................31
3.1 QualiPoc Workspace...................................................................................................31
3.1.1 Menus........................................................................................................................... 33
3.1.1.1 Main Menu.................................................................................................................... 33
Help Videos................................................................................................................... 33
3.1.1.2 Actions Menu................................................................................................................ 34
3.1.2 Cell Info Banner............................................................................................................ 35
3.1.3 Monitors........................................................................................................................ 37
3.1.3.1 Managing the Contents of a Monitor............................................................................. 39
Filtering the Contents of a Monitor................................................................................ 39
Customizing the Contents of a Monitor......................................................................... 40
3.1.3.2 Creating a Custom Monitor........................................................................................... 44
Adding a Monitor........................................................................................................... 44
Annex.................................................................................................. 404
D Dropped Calls.....................................................................................445
Glossary..............................................................................................449
Index....................................................................................................460
1 Introduction
QualiPoc Handheld release 18.0 has been designed for handheld radio network optimi-
zation and quality assessment. This software supports a variety of devices and tech-
nologies including GSM, GPRS, EDGE, WCDMA, HSDPA, HSUPA and LTE. Due to
the ease of use, you can use QualiPoc to collect data and voice services statistics.
QualiPoc fully supports Android motions and gestures as well as touch and double-tap-
ping.
Please consult Chapter F, "Customer Support Center", on page 448 for the best
method to contact us.
2. Touch the icon, and then touch "Create license context" (1):
3. Send the file to your contact at SwissQual for the generation of the license.
Your contact at SwissQual sent you an <IMEI>.WibuCmRaU file. Execute the following
procedure for updating the license:
Follow Chapter 2.1.1, "Request the License Creating a License Context", on page 16
and Chapter 2.1.2, "Update the License", on page 17, each time you have to update
the license, e.g. if you want to add functionalities that require a license.
If you try to start a campaign containing a test whose license is expired, the following
error message is displayed:
As an alternative to the previous methods, i.e., creating a license context and updating
the license, you can check if licenses (created for you by SwissQual support) are avail-
able for your QualiPoc device.
2. Touch the icon, and then touch "Check for license updates" (1).
3. Select the ticket (containing the licenses) you want to apply (2).
QualiPoc changes the color of the items' labels depending on the license status, e.g.,
red when a floating license item is expired and not returned yet, black when you can
request the floating license or light gray when the item is already licensed as a static
license:
1. In QualiPoc, touch the overflow icon , and then touch "About > Licenses".
3. Long touch one of the available license items (1) and touch download icon (2).
4. Select the license validity period (3) and touch "Request" (4):
Note: The license pool administrator can approve the license request for a different
period than the requested one.
5. The request is pending until the license pool administrator approves or rejects it.
QualiPoc displays:
Note: You can close this window. QualiPoc checks the approved licenses accord-
ing to the synchronization interval. A clock icon is displayed besides the requested
floating license, until the license pool administrator approves it.
If the license pool administrator enables the "Auto approve" function for the corre-
sponding units' pool, the request is immediately approved: refer to
Manual - SmartLicenser.pdf.
6. When the license pool administrator approves the license, the license gets activa-
ted:
"Floating Licenses" tab displays the item with its expiry date:
To return a floating license before the expiry date, follow this procedure:
1. In QualiPoc, touch the overflow icon , and then touch "About > Licenses".
3. Long touch the license you want to return (1) and touch upload icon (2).
● Ensure that you enable the internal GPS on the phone if you want to use this
option.
● If you want to use an external GPS device, go to system settings of the phone,
touch "Developer options" and then touch "Allow mock locations"
You can pair a Bluetooth GPS device with the phone and then select the device in the
"Map" settings. In this case you can disable the internal GPS to save battery power.
3. Touch a version in the list (3), and then touch "OK". Wait for the installation to be
completed:
Note: QualiPoc supports the "OTA" update (to new versions only) within the same
release even if the maintenance period expired.
If you do not have the "Update" option, contact our support center.
Please consult Chapter F, "Customer Support Center", on page 448 for the best
method to contact us.
3. Copy the *.apk file onto your phone, for example, copy the file to [sdcard]/
QualiPoc/.
5. Open a file manager on the phone and go to the folder that contains the *.apk
update file.
If you cannot run the application, go to the system settings of the phone, touch "Secur-
ity", and then enable the "Unknown Sources" option.
To update SQUAD
1. Launch QualiPoc.
2. Touch the menu icon at the top of the screen and touch "About > Update".
3 Using QualiPoc
QualiPoc makes full use of the smartphone touch functionality so you can easily switch
between the monitors, zoom in or out in the map monitors, and scroll easily. The appli-
cation also has a toolbar, which you can use to access a variety of functions.
For a description of the types of measurement campaigns that you can create in Quali-
Poc, see Chapter 5, "QualiPoc Tests", on page 235.
► To start QualiPoc, touch "Apps", and then touch the QualiPoc icon.
– Actions menu
– Main menu
● Navigation bar that contains the monitors for your measurements, for example, the
"Status" monitor
● Context menu that contains commands that are specific to the screen or Quali-
Poc monitor you are in
If you want to customize the workspace, see Chapter 3.2.4.1, "Customizing a Work-
space", on page 133.
For more information on the menus, see Chapter 3.1.1, "Menus", on page 33.
3.1.1 Menus
The main QualiPoc commands are available through the menu icon at the top of the
screen as well as the physical menu button of the device .
Item Description
"Device Manager" Add or select a device, for example, a Bluetooth GPS receiver or a scanner.
"About" Opens a screen where you can view information about QualiPoc or update QualiPoc
Help Videos
SwissQual provides optional instructional videos that you can either download when
you start QualiPoc.
► To access the "Help" menu, touch Menu , touch "Help", and then touch the video
that you want to watch.
You can access the Actions menu with the down arrow at the top of the screen.
The toolbar allows you to quickly perform the following actions when you monitor a
test.
Table 3-2: Description of the icons on the QualiPoc main toolbar
"Freeze" Freezes the monitors until you touch the icon again.
"Screenshot" Captures the screen and saves the image on the SD card (in the
QualiPoc/Results folder) in *.PNG format. If you are in recording or
testing mode, the screenshot is added to the MF file.
"Add photo marker" Captures a photograph with the phone camera and saves the photo-
graph on the SD card in the QualiPoc/Results folder. If you are in
recording or testing mode, the photo marker is added to the MF file.
Not supported in Freerider II or Freerider III mode.
The Cell Info banner is at the top of the screen and displays the values that you select.
b) Swipe to the screen that contains the parameter that you want to add, for
example, "Network Info", and touch the parameter(s).
c) Touch "Done" at the top of the screen, and then touch "Save".
Note:
● To restore the default selections, touch the overflow menu , and touch
"Restore defaults".
● You can only have two title values.
3. To change values that appear on the banner, touch "Customize banner values" in
Figure 3-10.
a) If the list contains 16 values, touch the selected parameters that you want to
replace.
b) Swipe to the screen that contains the parameter that you want to add, for
example, "Network Info", and touch the parameter(s).
c) Touch "Done" at the top of the screen, and then touch "Save".
Note:
● To restore the default selections, touch the overflow menu , and touch
"Restore defaults".
● The banner can display a maximum of 16 values.
3.1.3 Monitors
The QualiPoc workspace has several customizable monitors where you can follow
your measurements. You can change the layout of the monitors, add or remove param-
eters as well as add or remove monitors.
Table 3-3: Description of the default monitors that are available in QualiPoc
Monitor Description
"Status" Includes general information about the operator, technology, GPS, and general test results statistics
Test Displays the summary of the on-going tests including KPI bar chart
"Technology" Displays detailed information of the data technology that the QualiPoc device is currently using, for
example, LTE and WCDMA
"Cells" Provides an overview of serving and neighbor cells status and coverage. The content of this monitor
depends on the main technology that the mobile phone is connected to
"Coverage" Displays serving and neighbor cell coverage. The content of this monitor depends on the main technol-
ogy that the mobile phone is connected to
"Signaling" Displays a list of signaling headers including the option to decode each signaling message
Monitor Description
"IP" Displays the HTTP, FTP, TCP, DNS and ICMP messages that have been captured including the option
to decide the messages
"Events" Displays a list of voice and data call related events as well as Wi-Fi scanning results
"Map" Displays the current position, route and BTS information on a map based on Google maps, Open
Street Map, and several other map tile providers
"Wi-Fi" Displays information about the Wi-Fi network that the QualiPoc device is connected to
"Wi-Fi Scan" Displays information about the scanned Wi-Fi networks within range of the QualiPoc device, including
the one the device is connected to
You can filter and customize the contents of any QualiPoc monitor.
► To filter the contents of a monitor, touch the search icon , and enter the search
term.
Note: To specify additional filters, touch the context menu , and then touch "Set-
tings".
► To clear the contents of a monitor, touch the context menu , and then touch
"Clear".
The amount of customization depends on the monitor that you are in.
► To customize a monitor, touch the context menu at the top of the monitor and
touch "Customize".
► To add and remove items, touch the check boxes in front of the items.
► To rearrange the list, drag the rearrange icon next to the name of the item up or
down in the list.
This option is not the same as technology "Forcing". For more information, see Chap-
ter 3.2.7, "Forcing", on page 142.
The "Auto" option populates the monitors with information from the radio technol-
ogy that is currently available.
"Display Technology" icon is green when the selection is different than "Auto"
When the workspace contains multiple monitors, a different technology can be defined
for each one of them.
Use this functionality in multiple frame monitors to check technologies during handover.
Adding a Monitor
To add a monitor
1. Touch the shortcut menu icon at the top of the navigation bar and touch "Add
Monitor".
Note: If you copied a monitor configuration, the configuration appears at the top of
the list, for example, "RSRP (Copied)". For a description on how to copy a monitor
configuration, see "Copying and Pasting Monitor Configuration" on page 49:.
If you have already created a custom monitor, this monitor appears at the bottom of
the list, for example, "CPU". For a description on how to create a custom monitor,
see "To create a custom monitor" on page 135:
3. On the "Add layout", touch the layout that you want to use.
Note: The single pane layout creates a monitor that displays parameters at the top
and a real-time chart at the bottom. The multi-pane options allow you to add up to
three monitors.
4. To rename the monitor, touch the name, and enter the new name.
5. To select a custom icon for the monitor, touch the X beside the monitor name, and
touch an icon.
6. To change the color of the navigation bar icon for the monitor, touch the box beside
the name of the monitor, and touch a color.
7. Touch "OK"
Note: You can also change the name of the monitor as well as the color of the
monitor icon, for example, green.
For a more detailed description, refer to Chapter 4.5, "Monitoring Scanner Data",
on page 210.
The "Status" and "Log" monitors provide general information about the current Quali-
Poc status and active tests. The status monitor displays information about the network
in use, GPS position, and test results. The Log monitor lists the actions that are per-
formed by the active engine, which runs the test.
QualiPoc displays results in the form of KPIs and statistics. KPIs are test-dependent,
for example the call setup time for a call to any number test and throughput for an
HTTP transfer test. Statistics represent the number of successfully completed tests as
well as average, minimum, and maximum KPI results.
QualiPoc updates the monitor in real time.
The "Technology" monitor automatically displays the information that is relevant to the
technology in use. For example, when the smartphone performs a GSM to WCDMA
handover, the WCDMA monitor automatically replaces the GSM monitor.
This monitor displays information for the following technologies:
● "LTE"
● "WCDMA"
● "GSM"
● "CDMA"
● "EVDO"
Data Monitors
QualiPoc automatically displays the relevant technology information in the data moni-
tors when LTE DL, LTE UL, HSDPA, HSUPA, GPRS/EDGE.
Where available, these monitors also contain PDP context information, that is, APN, IP
address and NSAPI (only for GSM).
Note:
When QualiPoc is "Idle", the "Number of carriers DL" is set to 1. When a running
task uses carrier aggregation, the "Carrier Aggregation DL" is set to "Active" and
the number of carriers is shown. The carrier aggregation icon in the upper right cor-
ner is visible for 30 seconds after the last carrier aggregation activity.
When carrier aggregation data becomes available, QualiPoc displays a "Carrier
aggregation" message when you open the "Technology" monitor.
● To specify the carrier data to display, touch the "Carrier Aggregation" icon ,
and then touch a carrier.
LTE DL Monitor
The "LTE DL" monitor contains LTE download data information, that is, throughputs,
resource block count, modulation, and so on.
► To filter PCC, SCC, SCC-2/3/4, or Sum/Average values, touch the "Carrier Aggre-
gation" icon when carrier aggregation becomes available.
QualiPoc automatically groups the carrier aggregation values on the "LTE DL"
according to he carriers that you select, for example, "PCC".
► Touch a value to view more details, for example, in a chart. Then, touching the
overflow menu icon, switch between "Line chart" (1) and "Bar chart" (2):
For more details about LTE carrier aggregation, refer to Chapter A, "About LTE Carrier
Aggregation", on page 404.
The following table defines the mapping between the modulation scheme and the MCS
index:
Table 3-4: Mapping between modulation scheme and MCS index
The "Signaling" monitor is a list monitor that displays the header information of signal-
ing messages. You can disable protocol or message group items in the monitor set-
tings. QualiPoc writes the signaling information to the measurement file independent of
the filter settings. You can also view detailed signaling information in a pop-up window.
► To save the contents of a signaling message, touch and hold the screen, and then
touch "Save".
QualiPoc saves the file in the following location: /mnt/sdcard/QualiPoc/
Layer3 messages
3.1.3.8 IP Monitor
The "IP trace" monitor is a list monitor that displays header information from HTTP,
FTP, TCP, DNS and ICMP packages. If you want, you can disable protocol items in the
monitor settings. You can also specify a text filter to customize what you see on the
monitor.
QualiPoc updates the monitor in real time.
The "Events" monitor lists and notifies all most important events, for example Call
States, that QualiPoc traces during the tests.
QualiPoc assigns each event a unique index number and displays events in the follow-
ing locations:
● "Events" monitor
● "Map" monitor
● Line charts: QualiPoc displays all events for which you enable "Charts" (under
"Notification properties") as a marker line on those charts.
Figure 3-50:
On "Events" monitor, you can switch between list and table view, by touching the fol-
lowing icon (1)
By touching Settings under "Events" monitor, or Events, directly from "QualiPoc Set-
tings", define multiple event profiles and select the active profile.
The following table lists the event specifications and notification properties:
Table 3-5: Event specifications
"Signaling message":
● "Protocol discriminator", e.g., "LTE RRC" or "IMS SIP"
● "Message type prefix", e.g., "CCCH" or "INVITE"
● "Message type", e.g., "RRCConnectionReject" or
"Response: 403 Forbidden"
● "Direction": "Uplink", "Downlink" or "Unknown"
"Monitored parameter":
● "Monitored parameter": Any customizable parameter
● "Condition", e.g., "Equals"
● "Argument": value to compare
"Marker":
● "Marker Type", e.g., "Call Marker", "Info Marker", "Text
Marker", "Photo Marker", "Screenshot", "Waypoint"
● "Marker message"
"Test result"
● "Test KPI Type", e.g., "Call status" or "Call cause"
● "Condition", e.g., "Equals"
● "Argument": value to compare
● "Test Type": a list of accepted test types
● "Technology": a list of accepted technologies
The "Map" monitor displays your measurements on outdoor maps or indoor floor plans.
Map Commands
Table 3-6: Description of the items on the Map toolbar
"Map" For a description of the items on the "Map" menu, see the "Tools" entry in Table 3-7.
Last position update Shows the time that the last position information was received
Item Description
"Use GPS Device" Uses the GPS device to determine the current location
"Add Manual Location" Disables GPS location mode. Touch and hold the map to set your current location.
"Online mode" Automatically downloads map tiles for the current view; however, some map providers only par-
tially download tiles.
In offline mode, only cached map tiles are shown.
"Layers" Select floor plans, outdoor routes, and map providers. You can also open the editors for these
features.
"Tile cache manager" Select, create, or delete a cache for the map tile sets that you download..
Item Description
"Tools" ● "Go to location": Goes to the address or coordinates that you enter.
This command preserves a history of the locations that you enter. You do not need an Inter-
net connection to go to a location that is stored in the history.
● "Restart tracking here": Restarts the tracking from the current waypoint
Removes the current interpolation from the measurement file and restarts the route from
the currently selected waypoint without interpolation.
● "Reset tracking": Deletes the currently tracked route
The tracking value markers are now enabled with the zoom level starting at 16 and are dis-
abled for lower values. When temporarily without GPS coverage, that is, less than 1
minute, the tracking lines show interpolated tracking values.
● "Reset Rotation": Rotates the map back to the default orientation
● "Navigation": Shows the track from your current location to the selected origin on the floor
plan or the outdoor route
You can also access these tools through the "Map" menu.
Map Settings
► To access the map settings, touch the map context menu icon , and touch "Map
settings".
For a description of the "Map settings" screen, see Chapter 3.2.1, "Map Settings",
on page 129.
Map Types
QualiPoc supports outdoor maps and indoor floor plans.
Outdoor Maps
You can use several different map providers for your outdoor measurements, for exam-
ple, Google Maps and Open Street Map.
Depending on your QualiPoc version, you might be prompted to update Google Play
services when you open the "Map" monitor. To update Google Play services, follow the
instructions, and then restart your phone.
Alternatively, you can check that you are running the approved version of Google Play
services under "Settings > Apps":
► Use the plus (+) and minus (-) to zoom in and out of the map,
Tip: You can also double-tap the map to zoom in.
► To change the orientation of the map, touch and touch "Reset rotation".
Note: To restore the default map orientation, touch the Compass icon.
► To mark your position on the map, touch and hold the map.
► To delete a marker, touch the marker, and touch the "Undo" icon .
► To zoom in and zoom out of the map, use the touch capabilities of the smartphone.
► To automatically center the map on the current location, touch and hold the zoom
level icon .
QualiPoc saves the positions that you mark in the measurement file. You can load
these markers in the NQDI post-processing software. If you want, you can load
another map during the measurement. When you reload a map, QualiPoc also
reloads the previous tracking list.
Using Layers
The "Layers" screen allows you to customize indoor floor plan, outdoor routes and map
providers.
The "Ïndoor route" item is only available if you have defined a route for the selected
floor plan. For more information, see "Creating Indoor and Outdoor Floor Plans"
on page 76.
You can perform the following actions in the "Floor plan" editor:
● "Add floor": Adds a new floor/level to the current floor plan
● "Add floor using camera" Adds a photograph of the floor from the gallery of the
phone
● "New floor plan": Creates a new empty floor plan
● "New floor plan using camera": Creates a new floor plan from a photograph that
you take with the camera of the phone
● "Import new iBwave project": Imports the floor plan from an iBwave file
2. Touch the pencil icon beside "Floor plan" and in the list, touch the floor plan that
you want to create the route for.
5. Type a name for the route, touch "Create blank route", and then touch "OK".
6. Touch the floor plan to add the waypoints for the route.
Waypoints have the following colors:
● Green: Starting waypoint
● Orange: Intermediate waypoint
● Red: End waypoint
7. Use the various tools in the route editor to create the route, and then touch the
"Done" check mark (✔) at the top of the screen.
Drag handle to
reorder waypoints
Deletes a waypoint
Map automatically
centers on the
waypoint
that you select
Tap to add
comment
Current waypoint
action with Undo
option
2. Touch the "Floor plan" menu , touch "New floor plan", and then touch "Simple
Floor Plan".
3. Touch a floor plan location in the list, for example, "Load an image file".
Note: For the "Take a photo using the camera" option, point the phone at the floor
plan, for example, a floor plan that is displayed on the wall, touch the camera icon
, and then touch "Save".
If required, you can also edit the photograph.
● To crop the photograph, touch the "Edit" mode list at the top of the screen,
touch "Crop", and then drag the anchors.
● To correct distorted perspective, touch the "Edit" mode list at the top of the
screen, touch "Perspective", and then drag the anchors.
When you are done, touch the check mark (✔) at the top of the screen, and then
touch "Yes".
4. Assign a "Level" number to the floor plan as well as a name, and then touch "OK".
2. Touch the "Floor plan" menu , touch "New floor plan", and then touch "Geo-refer-
enced floor plan".
3. Touch a floor plan location in the list, for example, "Load an image file", and follow
the instructions for the image or iBwave project that you want to use.
4. Assign a "Level" number to the floor plan as well as a name, and then touch "OK".
Note: QualiPoc automatically uses the current location of the phone to position the
floor plan.
If the image contains the location in the meta data, click "Yes" to use this informa-
tion to position the image on the map.
● Touch the "Done" check mark (✔) at the top of the screen.
● To delete the floor plan, touch the X.
2. Touch the pencil icon beside "Floor plan" and in the list, touch the floor plan that
you want to edit.
3. Use the various tools on the screen to edit your floor plan.
Lock
Move
Anchors to
manipulate
the floor plan
Floor properties
Delete floors
2. Touch the pencil icon beside "Outdoor route", touch "Add Route", and touch an
option in the list, for example, "Create blank route".
Note: If you do not see "Add Route", touch the route menu and touch "Add route".
6. Touch the map where you want to add the remaining waypoints for the route.
7. Use the various tools in the route editor to create the route, and then touch "Done"
at the top of the screen.
Exchanges start
and end waypoints
Rearranges waypoints
in a more efficient order
Route types
(Recalculates
route when you
select a different
route type)
Only available
when you select
a waypoint
Map Provider
You can change the map provider for the "Map" monitor, for example, from Google to
Open Street Map.
Tip: To quickly open the "Layers" screen, swipe down over the map context menu
icon .
2. Touch a provider in the list.
Note:
The following map providers are available by default:
● "Google Maps (Normal and Hybrid)"
● "HERE Maps/Normal (Day)"
● "Open Street Map/Standard"
2. Touch the check box of the providers that you want to add to the list.
3. (Optional) Customize the map provider settings or add a new map provider.
● To edit the current map provider, touch the edit icon beside the map provider.
● To add a new map provider that is not on the list available providers, touch the
edit icon beside the provider, touch the plus (+) icon at the top of the list of
providers, and then touch "Add".
Note: If you are unfamiliar with the parameters, do not add a new map provider.
► To restore the default map provider, touch the edit icon beside the map provider,
touch the overflow menu icon at the top of the screen, and touch "Restore con-
figuration".
Tile Cache
The "Tile cache" allows you to select, create, or delete a cache for the map tile sets
that you download. Then, working with offline maps, you use all the available band-
width for data tests.
In "Online mode", QualiPoc automatically downloads missing map tiles from the Inter-
net, with preference given to a Wi-Fi connection.
► To view cached areas on the map, touch the map context menu and in the "Tile
cache" area, touch "Show cached areas."
2. Touch the plus sign (+) at the top of the screen and type a name (1) for the cache.
3. (Optional): Touch "Copy tiles from" (2), touch a cache in the list, and then touch
"OK"
Refer to "Storing Tile Cache on SD Card" on page 93 for setting the "SD Card
root directory URL".
2. Touch the download icon at the top of the screen and touch an option, for exam-
ple, "Download visible map area".
2. Touch "Tile caches" and then touch the map tile caches that you want to export.
3. Touch the menu icon at the top of the screen and touch an export method.
1. Touch the map context menu icon and touch "Settings ".
2. Under "Tile cache" section, touch "SD Card root directory URL".
3. Touch the SD card name (1) in the tree, and then touch "Select <SD card name>"
(2)
4. Create a tile cache following the steps described at "To create a new tile cache set"
on page 90 and consider step 4 as mandatory.
2. Touch the gear icon at the top of the "Event values" screen and touch "Custom-
ize info values".
3. On the "Info values" screen, touch the value that you want to change, for example,
"Network Info: Cell signal level".
4. On the "Pick parameter" screen, touch a category in the "Group" list, and then
touch the parameter in the "Value" list.
Note:
● To reset the parameters to the default values, touch the reset icon .
Tip: Use the search box to quickly find a parameter.
► To access the BTS settings, touch the map context menu icon , touch "Settings",
and then touch "BTS settings".
Note: To access this screen from the main QualiPoc screen, touch the menu icon
at the top of the screen, touch "Settings", touch "Map settings", then touch "BTS
information".
Setting Description
"BTS info file" Loads the file that contains the BTS information.
You can copy the file to any location on the SD card of the phone.
The BTS Info File must be in CSV format where each row corresponds to one
cell ID. Use the following syntax for a BTS Info File:
● WCDMA: Name,Technol-
ogy,UARFCN,PSC,Lon,Lat,MCC,MNC,LAC,CellId,Direction
● GSM: Name,Technology,BCCH,BSIC,Lon,Lat,MCC,MNC,LAC,CellId,Direc-
tion
● LTE: Name,Technology,EARFCN,Phy-
CID,Lon,Lat,MCC,MNC,TAC,CellId,Direction
"BTS LTE cell identi- Use eNB or CellID as cell identifier (Figure 3-100).
fier"
When the "BTS information" option is enabled, the following BTS icons appear on the
map toolbar. The serving cell is indicated by a blue circle on the map.
► To view the complete BTS information for a cell, touch the cell, and then touch the
information balloon above the cell (Figure 3-104).
Note: If the location has more than one cell, touch the cell icon , and then touch
the other cell.
► To lock the phone on the UARFCN cell, touch "Set preferred UARFCN", and let the
phone reboot.
Note: This setting also forces the phone to use WCDMA technology.
Setting Description
"High accuracy" Uses GPS, Wi-Fi and mobile networks to determine the current location.
Use this location method if you use the "Fused location provider" under "GPS Device".
Refer to Table 3-11.
"Power saving" Uses Wi-Fi or mobile networks to determine the current location.
"GPS only" Only disable this setting if you are using an external Bluetooth device.
The Wi-Fi monitor displays information about the Wi-Fi hotspot that the QualiPoc
device is connected to:
The "Wi-Fi Scan" monitor displays information about the scanned Wi-Fi networks
within the range of your QualiPoc device.
Touch on the main workspace to display the "Wi-Fi Scan" monitor. Touch ">" (1) to
expand the Wi-Fi hotspot's information (2). If the Wi-Fi hotspot uses multiple access
points (with different channels), all of them are displayed. The Wi-Fi access point ven-
dor is available (3):
By touching the overflow icon , you can switch to a chart display, either "Chart 2.4
GHz" (1) or "Chart 5 GHz" (2). The chart displays the channel usage for the selected
band:
For a description of the IP call logging options, see Chapter 3.2.9, "Advanced Analysis
Settings", on page 153.
Real-time Transport Protocol (RTP) is a general purpose protocol for streaming audio,
video, and other data over IP networks. RTP is responsible for voice coding, that is,
analog to digital conversion and compression, jitter management, and packet
sequence ordering.
A-to-D conversion
codec compression
and RTP packet Network
Network
construction
In a VoIP call, each RTP packet carries a small audio sample, which is typically 20 ms.
RTP assigns a packet number and time-stamp to each packet.
Packet numbers and time stamps enable correct packet sequencing at the receiving
end.
Jitter measures the variance of the arrival time of the RTP packets. If the packets
arrive in equal time intervals, the jitter value is 0, that is, jitter-free.
Sequence No 61 62 63 64 65 66 67
Time stamp 4620 4640 4660 4680 4700 4720 4740
Other headers hdr hdr hdr hdr hdr hdr hdr
Payload (data)
Time
Figure 3-113 is an example where the jitter value is greater than 0. Jitter that is less
then 100ms can be solved with jitter-buffers. Larger jitter values degrade the listening
quality.
Sequence No 61 62 63 64 66 67
Time stamp 4620 4640 4660 4680 4720 4740
Other headers hdr hdr hdr hdr hdr hdr
Payload (data)
Time
RTP Parameters
The "IP Call" monitor contains the following Real-Time Protocols (RTP):
● "RTP jitter": Statistical variance of the RTP data packet inter-arrival time
The recommended value is below 100ms. Jitter problems can be solved with jitter
buffers.
● "IPDV" (Instantaneous packet delay variation): Instantaneous time deviation
between the arrival of successive packets
For example, if packets are transmitted every 20 ms and the second packet is
received 30 ms after the first packet, the IPDV = −10 ms.
● "PDV" (Packet delay variation): Difference in the end-to-end one-way delay
between selected packets in a flow
The "PDV" is usually the largest variation in delay for a selected time period.
On "IP Call" monitor, "Frame Rate DL/UL" and "Codec DL/UL" parameters are also
available for devices with Exynos chipset.
SIP Messages
You can view SIP messages on the "Signaling" monitor.
To view the details of a SIP message, touch the message on the "Signaling" monitor.
The site acceptance monitor permits to configure and launch a site acceptance test.
To create a project, click the "+" icon (1) under "Project" area. The "Create project" (2)
dialog shows up. Fill in the fields and touch "OK":
The information you enter populates the header of the site acceptance report.
For more information about the site acceptance report, refer to .
Touching the overflow icon (1), you can either "Create", "Duplicate", or "Delete" a proj-
ect. Touching the edit icon (2), you display the "Create project" dialog for edition:
Define the technology by touching the "Technology" field and selecting it in the list (1).
Optionally, define additional parameters related to the technology (2)
Technology Options
"LTE" "EARFCN",
"PCI"
"WCDMA" "UARFCN",
"PSC"
"GSM" "Band",
"BCCH"
To define additional sectors, touch the overflow icon (1). Touch "Add" to define addi-
tional sectors, "Remove" to remove sectors, and "Move up" or "Move down" (2) to rear-
range the order of the sectors.
FTP UL
HTTP UL
All advanced job settings are available, e.g. the fixed duration. For more information
about test configuration, refer to Chapter 5, "QualiPoc Tests", on page 235.
The site acceptance job is supposed to run for a defined amount of time. Define either
a duration or a number of cycles, otherwise the job cannot be saved.
Touch the edit icon (1) to edit a job. Touch the overflow icon (2) and then "Rename",
"Duplicate", or "Delete" to perform the respective modification on an existing job. Touch
"Create" to create additional jobs and then touch the "Job" field (3) to switch from one
job to another:
Different thresholds can be defined for specific technology and bands. Touch the over-
flow icon, e.g. for "LTE" technology under "Ping RTT [ms]" (1) and touch "Edit band
thresholds" (2). Define the thresholds, e.g. for "LTE Band I - 2100" (3):
Then and to populate the custom fields, edit the project under "Project" area (1) and
edit the corresponding fields (2):
The details about the achieved KPI values are only available in the acceptance report,
once the jobs executed according to the set schedule, duration, or cycles.
If you stop the job, by touching "STOP" icon before the set duration or before all cycles
are completed, the site acceptance report is not generated.
– The "General information" reporting the project details as defined under "Proj-
ect" area
– The "Measurement information & equipment" providing details about the overall
test results, i.e. the percentage of "Succeeded" and "Failed" tests, and the
device information
● Second section:
– The "Sector breakdown" reporting the overall statistics for each defined sector
● Third section:
– The "Performance" reporting the overall statistics in tables and charts to allow
comparison between sectors at a glance
● Fourth section:
– The "RF Data" reporting the main radio frequency parameters for each defined
sector
● Fifth section:
– The "KPI classifications" summarizing the defined thresholds for each test type,
technology, and band
Parameters Definition
"CPU usage (total) [%]" All processes are counted including system,
sqdiagd, and "com.android.phone"
"CPU load" "CPU load" gives the load average over the last 1, 5
and 15 minutes
"CPU usage (QualiPoc) [%]" All threads that are running inside the main Quali-
Poc application process (UI, RFTrace,
Audio Recording, and Download) are included
"CPU scaling rate [%]" "CPU scaling rate [%]" is the rate between the sum
of current used frequencies, and the sum of the
maximum frequencies of all CPU. A value above
100% means overclocking
3. Touch the "+" icon, and then select the desired content, for example "Standard (32
values)".
4. Enter a "Name" for the monitor, for example, "CPU", and then touch "OK".
5. Swipe to "Performance" tab, and check the desired parameters, for example the
full list as described above. Touch "Done" at the top left of the screen:
7. Touch the shortcut menu icon at the top of the navigation bar and touch "Add
monitor".
► To access the "QualiPoc Settings" screen, touch the menu icon at the top of the
screen and touch "Settings".
Setting Description
"Location services" This command opens the Android location services menu.
For more information, see "Location Service Settings" on page 101.
"Location provider" Touch "Internal GPS device" and select the GPS device to use for the map among (1):
● "Internal GPS device"
● "Fused location provider": Android interface providing the best available location out of all available
providers i.e., WiFi, GPS and mobile networks.
"Seamless Transition By default, this option that checks the GPS accuracy is set to 0 m. In that case, you cannot add waypoints
Condition" manually.
If the last valid GPS position is older than 2 seconds, or if the GPS accuracy is above the set threshold, you
can add waypoints manually.
Setting Description
"Show inactive cells" Displays inactive cells if the "BTS monitor" option is enabled.
"Online mode" Downloads missing map tiles from the Internet. Some of the map providers do not completely download
missing tiles, for example Google, which only partially downloads tiles.
"Offline mode on Disables "Online mode" when a campaign starts, which is particularly useful for data tests. Indeed, "Online
campaign start" mode" interferes with data tests, as the map tile being downloaded takes resources from the test in execu-
tion, which then results in lower throughput.
"On campaign start" Resets the tracking line when a campaign starts.
This option is enabled by default.
"On floor plan Automatically resets tracking when you start a campaign or change the floor plan
change"
"Default floor plan Specify the default floor plan type, for example, "Geo-referenced"
type"
"Volume keys to set Use the volume keys to move between waypoints
waypoint"
"Show cached Displays the download status of the map tiles in one of the following ways:
areas" ● Tile with green background: Cached map tile
● Gray background with "Map tile not cached"
When you select "Show cached areas", a slider appears on the map to change the zoom level of the
cached areas.
"SD Card root direc- Path of the SD card to be used for storing cached map tiles
tory URL"
3.2.2 Signaling
The Signaling screen lists the available filtering options for the "Signaling" monitor.
You can use these settings to filter out the signaling headers, for example, by group or
by subgroup.
3.2.3 IP Monitor
The IP Monitor screen allows you to selectively filter out messages that belong to the
DNS, FTP, HTTP, ICMP, RTCP, and SIP protocols.
3.2.4 Customization
The customization screen allows you to customize the QualiPoc Handheld workspace
to display your preferred monitors, to create and save different custom workspace con-
figurations. You can then load different workspaces for different monitoring tasks.
The Workspace editor provides you with an overview of the monitors in the current
workspace.
Tip: You can also access this menu through the shortcut menu icon at the top of
the navigation bar.
2. Touch the plus sign (+) at the top of the screen and touch the type of workspace
that you want to create.
● "Create empty workspace": Creates a workspace with no monitors
● "Create standard workspace": Creates a workspace with the default monitors
● "Copy current workspace"
3. In the "Workspace name" box, type a name, and then touch "OK".
4. To manage the workspace monitors, touch "Current workspace" at the top of the
screen.
● To add a monitor, touch the plus sign (+) at the top of the screen, and then
touch a monitor in the list.
● To remove a monitor, touch and hold a monitor in the list, and then touch the
"Delete" icon at the top of the screen.
● To reorder the monitors in the list, use the drag handle .
● To create a custom monitor, touch "Custom monitors" at the top of the screen,
and then touch the plus sign (+).
Note:
To manage the parameters in the available default monitors, touch "Predefined
Monitors".
● To add a parameter, touch a monitor in the list, touch a parameter category at
the top of the screen, for example, "Network Info", and then touch the check-
boxes of the parameters that you want to add.
● To remove a parameter, touch a monitor in the list, clear the checkbox in front
of the parameter name.
● To restore the default parameters, touch and hold a monitor in the list, and then
touch the "Restore" icon at the top of the screen.
5. Touch "Done" when you finish.
QualiPoc allows you to create a monitor with customized content for your workspace.
Note: If you do not see this option, swipe until you do.
2. Touch the plus sign (+) at the top of the screen and touch the type of monitor that
you want to add, for example, "Standard (32 values)".
Tip: To clone an existing custom monitor, touch and hold the monitor in the list, and
then touch the "Duplicate" icon at the top of the screen.
3. Type a name in the "Monitor name" box.
4. Touch a category at the top of the screen, and then select the checkboxes of the
parameters that you want to add.
► To delete a custom monitor, touch and hold the monitor in the list, and then touch
the "Delete" icon .
QualiPoc uses the information that you specify in a tag in the name of a measurement
file.
2. Touch the overflow icon at the top right of the screen and touch "Result
Browser".
3. Touch the overflow icon at the top right of the screen and touch "Tag setups".
b) Touch the "Pick color" icon at the top of the screen and touch a color.
2. Touch the overflow icon at the top right of the screen and touch "Result
Browser".
4. Touch the tag icon at the top of the screen and select the tags using the drop-
down menus.
5. Touch "OK".
2. Specify the information that you want to use for the filename.
a) Touch the overflow menu icon at the top of the screen.
b) Touch the information options that you want to view in the list.
Note: The "Flat view" option includes the path to the results file.
3.2.5 Events
For more information, see Chapter 3.1.3.9, "Events Monitor", on page 63.
3.2.6 Notifications
► To view the event history of the notification, touch the occurrence of the notification
in the list.
3.2.7 Forcing
On the Forcing screen,"" you can select the used data interface and the technology/
bands that you want to force the phone to use.
The forcing that you configure here applies to all the tests that you run, unless you
specify additional forcing options in a test or session configuration.
Note: This static data interface forcing is reapplied each time a campaign ends.
3. Touch the technologies to be forced, e.g. "LTE" (2). Optionally, touch "Band forcing"
(3):
a) Touch the bands to be forced (4)
b) Touch "OK" (5)
Note: The list of available frequency bands for the technology depends on the
capabilities of the device.
4. Touch "Done" (6)
If you experience any issues with forcing and/or advanced forcing functionalities, do
not try solving them by performing a factory reset on the phone. Contact our Customer
Support Center instead.
Please consult Chapter F, "Customer Support Center", on page 448 for the best
method to contact us.
The "Advanced Forcing" option allows you to lock a phone to a specific technology,
that is, static forcing, such as LTE EARFCN, LTE PCI, WCDMA UARFCN, WCDMA
PSC, and GSM BCCH.
For a complete description of the current device support of advanced forcing features,
see the 18.0 Release Notes.
This feature is only supported in Handheld mode and does not add any information to
the measurement file, that is, you will not see this information in NQDI.
You can use advanced forcing as campaign forcing. As with static advanced forcing,
when you apply advanced forcing, a Forcing dialog box remains open. This process
can take up to 30 seconds to complete. On some phones, a reboot is required. While
the forcing is on, the "Stop campaign" command is available. Again, on some phones,
the "Stop campaign" action initiates a reboot. For the affected phone models, see the
18.0 Release Notes.
When a campaign with advanced campaign forcing is running, the "Forcing" menu is
not available. Furthermore, campaign forcing overwrites any existing static forcing. At
the end of the campaign, the campaign forcing is reset and, if set, the static forcing is
applied. For example, if you configure static forcing and then start a campaign
sequence that contains at least one campaign that is configured with advanced cam-
paign forcing, that particular campaign uses the advanced campaign forcing while the
other campaigns in the sequence use the static forcing.
If the selected cell has poor coverage, the device might take longer than 25 seconds to
camp on the cell.
4. Type the number of the channel that you want to lock, e.g. 10588 (4), and then
touch "OK" (5)
Example:
The locked PSC is the only PSC that appears in the active set list, although the locked
PSC is weaker than others.
Example:
Although the locked PCI signal is weaker than one of the neighbors, PCI remains as
the serving signal.
If you experience any issues with forcing and/or advanced forcing functionalities, do
not try solving them by performing a factory reset on the phone. Contact our Customer
Support Center instead.
Please consult Chapter F, "Customer Support Center", on page 448 for the best
method to contact us.
QualiPoc needs a confirmation when you switch to the following operation modes:
● "Freerider Slave": QualiPoc wait for the master device selection.
● "Remote Probe (SmartMonitor)": QualiPoc wait for the QR code scanning and the
phone number entry.
For setting up the correct communication on operation mode changes, QualiPoc
restarts when you switch from:
● "Freerider Master" to any operation mode
● any operation mode to "Remote Probe (SmartMonitor)"
● any operation mode to "Local Probe (SmartBenchmarker)"
● any operation mode to "Local Probe (ROMES)"
► To customize the Device ID of your QualiPoc device, touch the menu icon at the
top of the screen , touch "Settings" > "Unit Configuration" > "Select device ID", type
the new ID, and then touch "OK".
Note: NQView uses this ID in "Replay" mode to distinguish between the different
FR Slave devices of a Freerider II and Freerider III system when you load Freerider
II or Freerider III measurement files.
Auto Compression
The "Auto Compression" option saves the results in the compressed *.sqz file format.
If you disable this option, QualiPoc saves the results in the uncompressed in *.mf file
format.
The "Advanced analysis settings" screen allows you to configure additional QualiPoc
Handheld settings.
● "Set max Thrpt for...": Allows you to set the maximum throughput in kbps for differ-
ent technologies.
This value is mostly used for charts and color coding.
● "Log captured IP packet": Enable this option to display the packet details in the IP
monitor
Note that this option is disabled by default; you only need it for real time packet
details' decoding in the IP monitor. To have packet details available in NQDI,
enable PCAP recording while configuring a campaign.
● "Raw IP Call Trace Logging".
As this option can degrade the measurement performance of the phone, you should
only enable Raw QC trace logging for troubleshooting a problem.
QualiPoc supports the enhanced voice services (EVS) codec developped by 3GPP,
and intended for VoLTE release 12. The support of playing and recording 48 kHz voice
samples is part of the introduction of the codec. For more information about the
enhanced voice services (EVS) codec, refer to http://www.3gpp.org/ftp/Specs/archive/
26_series/26.441/26441-c00.zip, and particularly to "References" chapter.
3.2.10 Appearance
Specifies the theme that QualiPoc Handheld uses and provides an option to disable
the screen timeout, that is, the "Keep screen on" option.
The "Keep screen on" option overrides the system screen timeout settings, for exam-
ple, you cannot press the power button to turn the screen off. If you select the "Allow
screen to be dimmed" option, QualiPoc Handheld uses the Android "Screen timeout"
setting to dim the screen.
● Signaling Settings
● BTS Settings
● Tile caches
● Tile providers
● Text markers
You export the QualiPoc Handheld configuration files over Bluetooth and Wi-Fi, and
over the Internet through Email, and Dropbox
Some devices do not support Wi-Fi. To use the Email option, you need to configure the
Email server settings on your phone. For Dropbox support you need the Dropbox appli-
cation on your phone.
3. Touch the settings that you want to export to the configuration file.
b) To export the files off the phone, touch the share icon at the top of the
screen, enter a name for the file, touch "Export",touch a service in the list, for
example, "Email", and follow the instructions.
2. Touch the menu icon at the top of the screen and touch "Settings" > "Import
Configuration".
3. Use the icons on the navigation toolbar at the top of the screen to go to the direc-
tory that contains the configuration file, touch the name of the file, and then touch
"OK".
Note: This process overwrites the relevant configuration settings on the phone.
Allows you to create, export, and import custom text markers that you can add during a
measurement.
► To search for an existing text marker, touch the Search icon , and start typing the
name of the marker.
► To edit a text marker, touch and hold the name in the list.
► To delete a text marker, touch and hold the marker, and then touch the trash icon
at the top of the screen.
Tip: Touch additional markers to expand the selection.
This section describes how to prepare and import text markers in the text marker edi-
tor.
● You can export and import text markers through the "Import/Export Configuration"
menu. For more information, see Chapter 3.2.11, "Import/Export Configuration",
on page 156.
● When you import a text marker file, QualiPoc deletes the existing markers.
2. In QualiPoc Handheld, touch the menu icon at the top of the screen and touch
"Settings" > "Text markers".
3. Touch the overflow menu icon and touch "Import from a text file".
4. Locate the text file, for example, Markers.txt and touch "Select".
QualiPoc overwrites any existing text markers.
You can add custom text markers to the measurement file during a measurement cam-
paign.
For a description on how to create and delete a text marker, see Chapter 3.2.12, "Text
Markers", on page 160.
3.2.13 Apps
QualiPoc allows you to specify the version of the YouTube App that the phone uses.
Available KPIs
The following tables describe the KPIs that you can measure with each version of the
YouTube App.
20621 Data - YouTube - Playback Video Tace: Displaying Flash, Stream: Clip end
reached
QualiPoc supports Ookla Speedtest App version 3.2.16 and 3.2.32. The test fails if this
version is not installed.
The only supported versions are FCC Speed Test version 1.122 and 1.123.
For more details, refer to "To install FCC Speed Test" on page 313.
Opens a menu where you can update QualiPoc Handheld to the latest version as well
as configure the display of update warnings.
For a description on how to update Handheld, see Chapter 2.5, "Updating QualiPoc
Software", on page 27.
● When you migrate old files, QualiPoc renames the files to *.bkp.
● If inside a campaign, a test cannot be migrated, QualiPoc removes this test
from the related campaign:
Example of tests that cannot be migrated:
– Dropbox or Facebook tests require an access token that you define under
"Settings > Apps". In older tests, the token is a parameter of the test itself.
● If the migration fails, the unconverted files remain. To prevent QualiPoc from
prompting you each time you open the campaign editor, check "Do not show
again" box.
2. Touch the "Add job" icon , enter a name for the job, and then touch "OK".
3. Touch "Add test" and touch a test category, and then touch a test.
4. Touch and specify the basic settings for the test, for example, the name of the
"Host".
Tip:
● To undo your recent changes, touch the main menu , and touch "Revert cam-
paign".
This option reverts the campaign settings to the last time that you started Quali-
Poc.
● To remove the campaign, touch the main menu , and touch "Reset cam-
paign".
5. Specify additional test settings.
● Touch the name of the test, for example, "HTTP Browser".
The settings that you specify here override the QualiPoc "Forcing" settings that
you specified in Chapter 3.2.7, "Forcing", on page 142
● To select an access point for the job, touch the "Access points" icon .
● To enable packet capture for the measurement, touch the "Packet capture" icon
.
6. (Optional) To specify the scheduling options, touch the icon (1), and touch
"Scheduling" (2):
● To change the name of the job file in the QualiPoc/Jobs folder, touch the
drawer icon at the bottom of the screen, touch the context menu for the job
, and touch "Rename."
You can configure forcing options in a single test or a session with multiple tests.
These settings override the forcing options that are specified in the "Forcing" entry in
the "QualiPoc Settings".
● "Flight mode on/off": Runs once at the start of a single test or, if configured, at the
start of the first test in a test sequence.
If you use this setting in a test that is lower in the sequence, the procedure runs at
the start of each cycle.
► To stop a campaign, touch the main menu and then touch "Stop campaign".
The following conditions prevent a measurement campaign from starting on the phone:
● Battery level < 10%
● < 150 MB of free space on SD card
The following conditions cause a running campaign to stop:
● Battery level < 5%
● < 100 MB of free space on SD card
If the phone is connected to the charger with a USB cable, the battery might not charge
fast enough to compensate for the power consumption of tests that use HS and LTE
technologies. In such a scenario, the phone can suddenly turn off when the battery
level drops below 5% despite being connected to a charger.
You can view the battery level and free space warnings on the "Log" tab.
Figure 3-198: Low battery level and low storage warnings on the Log tab
● By touching the overflow icon (1), you refresh the list, you get all connected
NCM results, or you switch to the "Result Browser" (see "To manage measure-
ment results using "Results" menu" on page 175 for more details on the result
browser). Touch the back button to switch from "Result Browser" to "Results"
menu
● When you touch one result, the following options are available:
Merge scanner (see * below) and device data or compress *.mf file to *.sqz
file (if auto-compression is not enabled in the Unit configuration (1). Upload (4),
share (5), tag (6) and delete (7) a measurement file. Replay the device file (2).
Replay the scanner file (3) if available and only before merging, without GPS
coordinates. Export survey data (8)
* When accessing the results menu, the device checks if any unmerged scan-
ner file is available, and in this case allows to merge all of them:
2. To manage measurement results, touch the menu icon , and then touch
"Results". Touch the overflow icon on top right and touch "Result Browser", which
allows to check the device's memory as a Windows browser:
● To sort the list of results touch the overflow menu icon .
● To delete results, touch and hold a result in the list, and then touch the delete
icon .
You can touch more than one result.
● To upload a measurement file, touch and hold the results file, touch the
"Upload" icon at the top of the screen.
● Touch the back button to switch from "Result Browser" to "Results" menu
In addition to manually uploading a result file to a server, you can also configure Quali-
Poc to automatically upload result files to an FTP or HTTP server.
3. In the "Result Files Upload Connection Profile" area, touch "Select connection
type", and then touch "FTP" or "HTTP".
Note:
If you want to use the HTTP post method to upload the files, touch "HTTP form
upload". Use the following format for the host name: HostName/
PostScriptFileName, for example, 82.220.1.20/post.php. If you want to use a
custom script file on your server, you need to edit the properties in the following
file: \sdcard\QualiPoc\Settings\Upload\httpform.properties. You
can configure the POST method to use file or text form input.
4. Touch "Auto upload".
When QualiPoc starts uploading the file, the phone status reports "On hold (file trans-
fer)".
You can export the survey data from your measurements to a *.CSV file. To export
survey data from an iBwave file, see Chapter 3.4.3.2, "Exporting Survey Data from
QualiPoc to iBwave Mobile Apps", on page 188.
The export process uses templates to select the measurement parameters. If you
want, you can also create and save a custom export template.
2. Stop the campaign, touch the main menu , and touch "Results".
3. Touch and hold the measurement file, touch the context menu , and touch
"Export survey data".
5. To export the data with a predefined template, touch a template in the list, for
example, "Default (Cell signal level)", and touch "OK".
6. (Optional): Create and use a custom template to export the survey data.
a) Touch the plus sign (+) beside "Template".
b) Swipe to the category of parameters that you want to include, for example,
"LTE Cell", touch the parameters, and then touch "Done".
You can share QualiPoc measurement results with the iBwave Mobile apps.
You can only export survey data that you added to an iBwave *.ibwc file that you
imported into QualiPoc.
5. In the list of results, touch the iBwave export icon beside the survey data that you
want to import into iBwave Mobile Planner.
6. In the iBwave Mobile app, click the file, and then click "Import".
You can export scanner data from QualiPoc measurement files, containing the iBwave
project (floor plans) and manually entered map positions (on the floor plans).
2. Click
4. Select "Scanner data" option and the technologies you want to export by checking
the corresponding checkboxes accordingly
5. Click "OK". The exported scanner file name (*.ibwc) consists of the iBwave proj-
ect name (previously imported into QualiPoc) and of the following suffix: "Scanner"
6. Click one of the iBwave app icons to open the file in the corresponding iBwave
Mobile app
After opening the file into the iBwave app, for instance iBwave Mobile Note, the data is
parsed, which requires a couple of minutes.
iBwave Mobile Note lists and checks all available scanner data. Uncheck the data you
do not want to import.
Click "Import" to start the import process.
4 Using a Scanner
QualiPoc provides an easy scanner configuration and detailed scanner result views.
You can use the following scanners with QualiPoc Handheld:
● Rohde & Schwarz TSMA scanner
For a TSMA scanner, you only need to perform the following configuration steps once.
WLAN access point is always on except when QualiPoc is running a measurement.
For a PCTel IBflex scanner, you need to perform these steps each time that you start
QualiPoc or the IBflex scanner.
● Connecting a Scanner...........................................................................................195
● Creating a Scan.................................................................................................... 199
● Recording and Transferring Scanner Data........................................................... 208
● TSMA/PC Battery Consideration...........................................................................209
● Monitoring Scanner Data...................................................................................... 210
● Exporting and Importing Scanner Configuration Profiles...................................... 217
If you do not have the correct license to use the scanner with QualiPoc, contact our
support center.
Please consult Chapter F, "Customer Support Center", on page 448 for the best
method to contact us.
2. In QualiPoc, touch the main menu , and then touch "Device manager"
3. Touch the plus sign (+) at the top of the screen and touch "NCM"
5. Touch "[Disconnected]", touch the TSMA scanner in the list, for example,
"TSMA-900012"
If you do not have the correct license to use the scanner with QualiPoc, contact our
support center.
Please consult Chapter F, "Customer Support Center", on page 448 for the best
method to contact us.
USB data
connector COM WiFi/BT
(COM) USB
Power switch
GPS
SD LED
2. In QualiPoc, touch the main menu , and then touch "Device manager".
3. Touch the plus sign (+) at the top of the screen and touch "PCTEL SeeGull".
5. Touch "Scan devices" at the bottom of the screen and wait until the scanning proc-
ess stops.
Tip: Touch a default scan template in the list, for example, "GSM Scan, BSIC".
Note: Repeat this step for each scan that you want to configure.
You can define a channel range only for GSM technology. You cannot define chan-
nel ranges, when you configure LTE and WCDMA scans, but just single channels,
and multiple channels for the same band:
If you want to configure a scan that uses Automatic Channel Detection, see Chap-
ter 4.7, "Automatic Channel Detection", on page 218.
If you are configuring a PCTel IBflex scanner, do not change the default scanner
"Name" or enable the "Save results to SD-Card" option in the configuration.
For a complete description of the IBflex configuration options, see Chapter 4.2.1,
"IBflex Scanner Configuration Options", on page 203.
5. If you want to create a new profile, touch the plus sign (+) beside the profile list,
enter a Name for the profile, and then touch "OK".
6. Touch "Apply", touch "OK" on the "Apply scanner configuration" screen, and then
touch "Done".
You need to take the following considerations into account when you configure an
IBflex scan.
The performance of the PCTEL IBflex scanner, that is, the scan rate, when the BCCH
Layer 3 scan and C/I options are enabled, can be very poor if all of the GSM bands
and channels are scanned. The maximum number of allowed channels is 2560. The
Layer 3 scan works on a dwelling time basis, that is, the scanner remains on a channel
for the duration of the dwelling time value to collect and report Layer 3 data.
► To optimize the GSM Layer 3 performance of the IBflex scanner, enter "Dwelling
time" of 3 in the scanner configuration.
Note: As the "Dwelling Time" for a GSM scan is defined as a multiple of 12 GSM
frames, the 3 value is equivalent to 166ms.
● "UARFCN"
● "RSSI"
● "Time Reference"
● "CPICH Ec/Io"
● "SIR"
The remaining parameter availability depend on whether the "BCCH Layer 3" option is
enabled or not.
Figure 4-22: BCCH Layer 3 enabled (right) and BCCH Layer 3 disabled (left)
You can set a maximum of 24 channels for an LTE scan; however, some LTE bands do
not allow all configurable bandwidth and the validity of the LTE channels depends on
the bandwidth that you select.
Among other parameters, the LTE "Scanner" monitor displays the bandwidth that you
set in the scan configuration and the real EARFCN cell bandwidth.
If the bandwidth that you set in the configuration ("Scan BW") is lower than the mea-
sured bandwidth (Cell BW), some Layer 3 information might be incomplete or missing.
Figure 4-23: LTE Signal (Sync) on the right and LTE Signal (Ref) on the left
You can view the following MIMO parameters on the "LTE Signal (Ref.)" monitor:
● CN: Channel Condition Number
● Estimated CQI and Throughput for:
– L1cl: Single layer closed-loop spatial multiplexing (rank-1 precoding)
MIMO
data
► To view the RSSI, RSRP, and RSRQ information for each antenna as well as the
averaged value, touch the gear icon on the "LTE Signal (Ref.)" monitor, and touch
"Tx1/Tx2".
MIMO measurement can also be performed by using two Rohde & Schwarz TSMA
scanners.
If you are using a TSMA scanner, you need to transfer the data from the TSMA PC to
your QualiPoc Device. The scanner data is contained in two files:
● A position file, generated directly on the QualiPoc Device. The position information
is part of the mf file generated on the QP device.
● A scanner file.
Only the scanner file must be transferred and merged to the QualiPoc Device mf file.
To record ROMES file, i.e. with a *.rscmd extension, check "Include SME results
(RSCMD)" in "Device manager - Scanner settings". The file is zipped (and part of the
scanner *.sqz archive), together with the *.mf file.
As *.rscmd file is 10 times larger than the *.mf file, do not enable the feature unless
really needed
Perform "Apply scanner configuration" to the scanner to enable or disable the RSCMD
file recording.
The same procedure also applies when TSMA/PC is switched off by pressing the
power button during a measurement.
Note that the scanner measurements are not resumed after a new start.
QualiPoc only creates a measurement file for the scanner data if you select the "Start
Scanner Measurement" check box in the "Device Manager" before the measurement.
However, QualiPoc always displays real-time measurement data on the "Scanner"
monitor.
If you use a mutliple monitor layout, be aware that the higher load on the Bluetooth link
might make real-time monitoring less responsive. The higher load does not have an
impact on the scanner data files.
Locked channel
(click to lock or
clear selection)
You can select up
to 6 channels
Min, Max
and Avg
value over
the past 60
seconds
● If you want to see a table instead of a chart, touch the context menu icon for
the monitor and disable the "Chart" option.
● To display a channel even in the absence of data, touch and hold the channel.
The channel turns light grey.
The context menu for the "Scanner" monitor has the following commands:
● "Select rows": Specify the parameters to display in the lower part of the monitor for
each scanned channel
Each technology has different parameters.
● "Reset rows": Reverts the RF values to the default values
● "Change timeout": In bar chart mode, the channels are persistent until new values
arrive from the scanner
You can adjust the "Persistency timeout". The default value is 5 seconds.
In line chart mode, QualiPoc does not save the history when you switch between
scan type.
● "Clear selection": Clears the current selection.
● "Reset min/max/avg": Resets the minimum, maximum, and average values
Selected channels
The following procedure describes how to transfer TSMA scanner data to your Quali-
Poc Device.
You do not need to perform these steps for the IBflex scanner, for which QualiPoc
automatically adds the scanner data to the QualiPoc measurement file.
QualiPoc only creates the measurement files if you select the "Start Scanner Measure-
ment" check box in the "Jobs" menu before you start a measurement.
2. If you want to merge the scanner files with the QualiPoc measurement files, touch
"Merge now".
Note: When you merge the files, QualiPoc deletes the original scanner file from the
QualiPoc/Results/<Job name>/<Job start datetime>/<Scanner>
folder. You can also access the "Merge now" command on the "Results" screen.
2. Touch a job in the list, touch and hold the scanner, and then touch "Export all sur-
vey data".
► To monitor the battery level of a scanner, Touch the "NCM" status tab at the top of
the screen.
► To export a scanner configuration profile, touch the menu icon at the top of the
screen, touch "Settings" > "Import/Export Configuration" > "Export Configuration" >
"Scanner configuration profiles", and touch the configuration profiles that you want
to export.
► To import a scanner configuration profiles, touch the menu icon at the top of the
screen, touch "Import/Export Configuration" > "Import Configuration", and locate
the scanner configuration profile file.
You can use this feature on Rohde & Schwarz TSME, TSMW, and TSMA scanners. All
bands supported by the Rohde & Schwarz scanners can be used in the ACD measure-
ments.
d) In the "Band" list, touch the band that you want to scan.
e) The only settings that you can edit (and that is applied to the channels added to
a profile) are:
● "BCCH Layer 3"
● "Meas. Rate (Hz per channel)"
You can monitor ACD scanner measurements in real time on the "Scanner" monitor.
Note: The bandwidth that is displayed only correlates with the other channels in
the same band/row. For example, in Figure 4-44, the bandwidth for "LTE 6200" is
10.0 MHz while the bandwidth for "LTE 1301", "LTE 1651", and "LTE 1850" is 20
MHz.
You can add reconfigure a scan configuration with the found channels either directly or
apply the changes later with a configuration file that you create on the "Scanner" moni-
tor.
● To add a single channel, touch the channel on the monitor, for example, "LTE
6200", and then touch "Add to configuration".
3. In the "Select configuration to add channels" list, touch "Create new configuration".
● To create a scan configuration profile that you can apply later, touch "Update".
Note: QualiPoc automatically names the profile, for examples,
ACD - 2016-02-09 08:06:50, and adds the profile to the "Scanner configura-
tion profile" list that you can access in the "Device Manager".
3. Click a scan configuration in the list, and then in the "Scanner configuration profile"
list, click the ACD profile that you want to apply, for example,
ACD - 2016-02-09 08:06:50.
For both WCDMA and LTE, you can analyze Automatic Channel Detection (ACD)
scanner data on the "ACD Scanner" sub-tab of the "Analysis" tab.
Depending on your needs, you can group the measurements by any of the columns.
The values in the "Status" column have the following definitions:
● 0 = Found
● 1 = Confirmed
● 2 = Active
To calculate the load of a cell, the scanner decodes the physical downlink control chan-
nel (PDCCH). One of the main objectives of the PDCCH is to inform the connected UE
which downlink resources are used to carry their traffic on the physical downlink
shared channel (PDSCH). This allocation information is found in a message called
downlink control information (DCI). With the different transmission modes (MIMO,
Transmit Diversity, etc.) the format of the DCI changes.
The downlink allocation analyzer can decode the PDCCH of an eNodeB and looks for
valid DCI messages sent to UE having active downlink traffic data. By analyzing these
messages, the DLAA can determine the following about the eNodeB:
● The amount of downlink resources allocated to each active UE
● The total amount of used downlink resources used on the eNodeB
● The transmission mode used by each UE
Based on the information found in the different DCI, the following values are calculated
and displayed in DLAA scanner monitor:
● Average cell throughput ("Avg Cell Thp")
● Average throughput per connected UE ("Avg RNTI Thp")
● Number of UE connected to the cell ("Num RNTI")
● Average resource block usage ("Avg RB usage")
● Average modulation and coding scheme ("Avg MCS")
These values are calculated averages, so you only see if the own UE throughput devi-
ates a lot from this average.
1. Touch the scanner in the "Devices" list to access the scanner profile and its set-
tings.
4. If needed, edit the observation intervals. In the above screenshot, the "1st Obser-
vation interval" is set to 20 seconds. This interval is a sliding window showing the
results of the calculations during the last 20 seconds.
5. On the "Scanner" monitor, you can switch from one observation interval ("Observa-
tion time") to another:
Figure 4-53: DLAA monitor with a 20 seconds interval (Freerider III view)
Figure 4-54: DLAA monitor with 300 seconds interval (Freerider III view)
To use the RF Power scan, you must install the R&S TSMx-K27 option on the scanner.
2. Start the creation of the scan by following the procedure described in "To create a
new scan" on page 199 and reach step 3.
3. Touch "Any" under "Technology". The only available "Scan type" option is "RF
Power".
3. QualiPoc displays one of the defined sweeps at a time. Touch the sweep name (1)
to select the sweep you want to monitor (2).
The scanner measurement file only contains the current measured value, i.e., "Power
dBm". QualiPoc does not save "Peak dBm", "Avg dBm" and "Min dBm" values.
5 QualiPoc Tests
QualiPoc supports a variety of test types, including call, streaming, and social media
tests. For greater control when you analyze your data in NQDI Classic, you can also
group the tests in sessions. To run a test, you need to add it to a measurement cam-
paign, which can consist of single test, an action, a session, or a sequence of tests and
sessions.
For a description on how to create a campaign, see Chapter 3.3, "Creating and Run-
ning a Measurement Campaign", on page 165
● Call Tests...............................................................................................................236
● Video Call Tests.................................................................................................... 257
● Streaming Tests.................................................................................................... 265
● Data Transfer Tests...............................................................................................293
● Social Media Tests................................................................................................ 319
● Performance Tests................................................................................................ 341
● Messaging Tests................................................................................................... 346
● Other Tests............................................................................................................384
● Actions.................................................................................................................. 384
● Sessions................................................................................................................388
The double ended call test establishes a CS call between the following A-Side and B-
Side devices:
● Two QualiPoc Android phones
● QualiPoc Android phone and a Diversity Call Server
If you want to use a Call Server as the B-Side device for a double ended call test,
see the Application Note - Diversity Call Server.pdf document.
● QualiPoc Android phone and a Diversity Smartphone without an ASM
The double ended call campaign can only run on devices with Snapdragon S3 pro-
cessors or higher.
Table 5-1: Description of the settings for a Double Ended Call Test
Setting Description
Setting Description
"External B unit" If you enable this option, QualiPoc sends a stop call to the B-side device, or you can manually
stop the B-side. If you disable this option, QualiPoc does not send the stop call.
if the B-side is a Diversity voice call server, the "External B unit" option must be flagged other-
wise the B-side will not be stopped.
"Remote Job Number" Unlike the job name, the value that you enter is transferred to a Diversity unit during the con-
figuration call.
"Sample Frequency" Plays a sample each time that the interval that you specify elapses
"Wave file option" Select which recorded samples have to be saved in the measurement file:
● "All"
● "None"
● "LQ"
"Wave filter" Set the LQ threshold below which samples are saved. The field is editable if "Wave file option"
is set to "LQ".
QualiPoc Android supports the following double ended call measurement scenarios:
● QualiPoc Android to QualiPoc Android:
– Manually configure the campaign in QualiPoc on the A-side and B-side phones.
– Manually start the campaign in QualiPoc on the B-side and A-side phones,
respectively.
For more information, see Chapter 5.1.1.2, "Creating and Running the Campaign on a
QualiPoc Phone", on page 239.
● QualiPoc Android to Diversity Call Server (PSTN/ISDN) / Android Smartphone
with or without ASM/PMW/TCM:
– Add and configure the Diversity Call Server in NQView.
For more information, see "Creating a Call Server in NQView " on page 249.
– Export the configuration of the Call Server from NQView and import the config-
uration on the Call Server.
– Export the B-Side test from QualiPoc
– Manually configure the campaign on the QualiPoc phone.
For more information, see Chapter 5.1.1.2, "Creating and Running the Cam-
paign on a QualiPoc Phone", on page 239.
– Copy the exported B-side test to ...\Task\Predefined Jobs folder in the
Diversity Call Server.
● Diversity Android Smartphone with or without an ASM/PMW (Audio SlideIn
Module / Phone Mounting Wall) to QualiPoc Android:
– Add and configure the Diversity smartphone . For more information, see the
Manual - NetQual - NQView.pdf document.
– Manually configure the campaign on the QualiPoc phone. For more informa-
tion, see Chapter 5.1.1.2, "Creating and Running the Campaign on a QualiPoc
Phone", on page 239. Some Diversity settings are slightly different than the
QualiPoc counterparts. In such cases, consult the setting information in the
paragraph below the relevant step.
– Add the QualiPoc phone as a mock DTMF Call Server in NQView.
For more information, see "Creating a Call Server in NQView " on page 249.
– Create the measurement task in NQView with the Diversity smartphone as the
A-side device and the QualiPoc phone, that is, the mock DTMF Call Server, as
the B-side device.
For more information, see "Creating the Double Ended Call Measurement Task
in NQView" on page 251.
– Manually start the campaign on the QualiPoc phone.
For more information, see "Starting the Campaign on the QualiPoc Phone"
on page 248.
– Start the measurement task in NQView.
For more information, see "Starting the Measurement Task in NQView"
on page 255. A Diversity smartphone only supports the DTMF campaign trans-
fer method. The Diversity smartphone must be the A-side device and the Quali-
Poc phone must be the B-side device.
The settings that you specify for the measurement campaign on the A-side device
must be identical to the settings on the B-side device, except for the respective phone
numbers and test direction.
c) Touch "Phone number", enter the number for the B-side phone, and then touch
"OK".
d) Touch "Call duration (s)", or alternatively leave it unchanged as the field can be
updated under "Window Timings".
e) Touch "Algorithm" and select the algorithm to be used for calculating the quality
scores.
f) Touch "Reference file" and select the speech sample to be used.
Note: The "Pause" setting is only available when you manually configure a cam-
paign in QualiPoc. Furthermore, the value must be 0 in any mixed test scenario, for
example, when the test uses a Diversity unit as the B-Side device.
5. Touch the "Window Timings" icon , touch the timings that you want to configure,
and touch "Done".
For a test that involves a Diversity unit, specify the same Window timings as you
did in Figure 5-19 for the intrusive campaign in NQView.
Note: If you select "Exclude Call Setup" time from the "Call Duration", the trigger
point is the next occurrence of the network Connect message.
QualiPoc receives the Connect messages after the following events:
● GSM: Received in Downlink after a Channel Request sent (U)
● UMTS: Received in Downlink after a RRC Connection Request (U)
b) Touch "Call direction" and touch the call direction, for example, "Call B to A".
For a test that involves a Diversity unit, the call direction is the "MOC:MTC"
ratio in Figure 5-19 that you specified for the intrusive campaign in NQView.
● For a "MOC:MTC" ratio of 1:0, touch "Call A to B"
● For a "MOC:MTC" ratio of 0:1, touch "Call B to A"
● For a "MOC:MTC" ratio of 1:1, touch "Alternating Call Sequence"
● For 2 MOCs followed by 1 MTC, that is, MOC - MOC - MTC and then MOC
- MOC - MTC, touch "2:1"
● For 2 MTCs followed by a MOC, that is, MTC-MTC-MOC and then MTC-
MTC-MOC, touch "1:2"
e) Touch "Reference file" and touch a sample file for the test.
For a test that involves a Diversity unit, use same reference sample that you
selected in Figure 5-20 for the test in NQView, for example, "English (U.S.)
IRS" for the AM_fm_IRS.wav reference sample.
f) Touch "Sample frequency", enter one of the following sample frequencies, and
then touch "OK":
● 12.5: For tests that use the "SQuad08" and POLQA algorithms.
The sample frequency is the time difference between the start times of the
two subsequent samples. A sample frequency of 12.5 seconds in QualiPoc
corresponds to the combined 6 second "Record hang-over" that you speci-
fied in Figure 5-20 in NQView and the 6.5 second duration of the SwissQ-
ual reference samples.
● 25: For tests that use the "SQuad08 (WB)" and "POLQA (WB)" algorithms.
QualiPoc on slower phones requires the longer time to calculate the MOS
results in a wideband double ended call measurement campaign.
7. If the campaign is for a Diversity Call Server, transfer the configuration to the
server.
a) Copy the device XML configuration file from the Call Server to the following
location on the phone:
/sdcard/QualiPoc/LandUnit/Config
b) In QualiPoc, touch and hold "Double Ended Call" on the jobs screen, touch the
context menu , and touch "Export B-Side job".
c) Enter the phone number for the A-side device and touch "OK".
Note: The name of the *.ini job file is derived from the "Remote job number"
parameter in Figure 5-11. In this case, the file name would be job_100.ini
► To start the campaign, touch the menu icon , touch "Campaigns", ensure that the
"Double Ended Call" campaign is loaded, and touch "Start" .
► To load the job, touch the drawer icon , touch the "Double Ended Call" job that
you created, and then touch the drawer again.
The following sections describe how to use NQView to configure the following features
for a double ended call test:
● Call Server: Required for the QualiPoc Android to Diversity Call Server (PSTN/
ISDN), Diversity Android Smartphone without an ASM to QualiPoc Android, and
Diversity Smartphone in an ASM to QualiPoc Android scenarios
● double ended call Measurement Task: Required for the Diversity Android Smart-
phone without an ASM to QualiPoc Android, and Diversity Smartphone in an ASM
to QualiPoc Android scenarios
● Starting the Measurement Task in NQView
For the Diversity smartphone to QualiPoc phone scenario, the following sections
assume that have already configured the Diversity smartphone for the test. For the
QualiPoc to Call Server scenario, the following procedure assumes that you have
already installed the ISDN or PSTN devices and the respective Windows drivers on the
PC that hosts the Call Server.
2. Add a PC unit.
a) Right-click "Hardware", point to "Add unit", and then click PC.
b) Type a "Name" and "Computer name" for the unit, for example, QPAndroid.
3. Create a subscriber profile for the phone device or PSTN or ISDN card.
a) Click "System configuration" on the Navigation panel and click the plus sign (+)
beside "Subscriber and access points".
b) Click the plus sign (+) beside an operator in the tree, right-click a provider, and
then click "Add subscriber".
c) Add the subscriber information, click "Apply", and then click "OK".
4. Add the QualiPoc phone or the PSTN or ISDN card as device to the DTMF Call
Server.
a) Right-click the unit in the tree, point to "Add device", and then click the type of
device, for example "Mobile" for a QualiPoc phone or "ISDN" for a Diversity
device.
b) Type a name for the phone.
c) In the "Model" list, click the type of phone or ISDN or PSTN model.
d) In the "Subscriber" list, click the profile that you created in the previous step.
If you are creating a mock Call Server for a QualiPoc phone, the subscriber
number is the only value that needs to be identical to the QualiPoc setting.
e) Click "Apply" and click "OK".
3. In the "Device A/B side" area, select the A-side and B-side devices.
Table 5-2: A-side and B-side devices' selection according to scenario
QualiPoc to Diversity Call Server (PSTN/ QualiPoc phone (mock Call Server) Diversity Call Server (PC)
ISDN) scenario
Diversity Android Smartphone without an Diversity Android Smartphone QualiPoc phone (mock Call Server)
ASM to QualiPoc
Diversity Smartphone in an ASM to Quali- Diversity Android Smartphone QualiPoc phone (mock Call Server)
Poc scenarios
b) Click the yellow asterisk in front of the "Job" list, and then click "Intrusive
job".
c) In the "Name" box, type a name for the job in the following DTMF job transfer
format, where xyz is the "Remote job number" that is described in Table 5-1:
● job_xyz
d) Type a value in the "Record Hang-Over" box.
● 6000 for Narrowband tests
● 18500 for Wideband test
e) In the "Call duration" box, type the same "Call duration" value that you speci-
fied on the QualiPoc phone, see Figure 5-5.
f) Configure the following values so that the "Overall duration of defined tests"
value below the "Timings" area is less than the "Call duration" value.
● "Test sequence repetition"
● "Average call setup time"
Click "Apply" to calculate the "Overall duration of defined tests" value.
g) In the "MOC:MTC ratio" box, specify the call direction, for example, 1:1.
QualiPoc does not use the MOC:MTC ratio to define the call direction, but
rather uses A-side and B-side. As a result, a MOC:MTC ratio of 1:0 corre-
sponds to the A to B call direction setting in QualiPoc and a 0:1 ratio corre-
sponds to B to A. However, the MOC:MTC ratio of 1:1 corresponds to the"Alter-
nating Call Sequence" call direction in QualiPoc.
h) In the "Timings" area, select "Use call duration to abort call".
If you do not enable this option, the measurement task will not run correctly.
i) Specify the remaining timings, click "Apply", and then click "OK".
5. In the "Intrusive test" window, specify the settings for the speech test.
a) Type a name for the test.
b) In the "Test type" list, click one of the following types:
● "Speech"
● "Speech POLQA"
● "Speech-Wideband"
● "Speech-Wideband POLQA"
c) In the "Direction" area, click a direction for the reference sample.
You need to select the same direction for all of the reference samples that you
use. Samples with alternating directions must start with a B to A direction; oth-
erwise NQView does not accept the configuration on the task level.
d) In the "Reference sample" list, click the speech sample that you want to use.
e) In the "Save WAV files" area, click an option.
f) Click "Apply" and then click "OK"
7. In the "Measurement task" window, specify the "Duration" and the number of
"Cycles" for the task.
3. Click the green arrow in the "Start" column in front of the task that you created.
The "Answering Station" test starts a measurement device in answering station mode.
Once in this mode, another device can initiate MOC DL testing to the answering sta-
tion.
If you want to use a QualiPoc device as an Answering Station for a Diversity device,
you need to specify one of the following "Record Hang-Over" values when you config-
ure the job in NQView:
● 6000 ms for powerful devices
● 18500 ms for less powerful devices
Table 5-3: Description of the main settings for an Answering Station test
Setting Description
A Call to Any Number test sets up a simple Circuit Switch (CS) call and outputs the
main test-related KPIs. This simple test requires you to input the following settings.
Table 5-4: Description of the settings for a Call to Any Number single CALL test
Setting Description
"Number of cycles" Number of times to repeat a single test before the test ends
5.1.4.1 Installation
On "Call Tests", touch on the WhatsApp tests. The configuration is the same as for the
other "Call Tests"
If the video call cannot be established, the voice call is not established instead.
The configuration call is still done via voice call.
The evaluation of video telephony is characterized by:
● The application of the full-reference video quality measure VQuad (ITU J.341)
● The parallel analysis of video and speech
Line video calls require Line application to be installed on the phone.
To configure a video call test, select the desired test under "Video Call Tests"
A reference video is inserted in all video call tests, but no video evaluation is per-
formed:
● Video is inserted from both sides.
● Video insertion starts in sync with sending of the first voice sample.
● Video is inserted continuously with a 12.5 seconds video sample repeated in a loop
until the end of the test.
To get a deeper insight, and for example, to check if the video is successfully transmit-
ted, activate "Video Call Debug Output" option under "Advanced Analysis Settings".
The configuration of a speech double ended video call test is identical to the speech
double ended voice call test.
For more information, refer to "To create a Double Ended Call measurement campaign
in QualiPoc" on page 239
To configure the A-side, define the parameters for "Video Call to Answering Station"
To configure the B-side as answering station, go to "Actions" and then "Video Answer-
ing"
To configure the video call to any number, configure the following parameters
This test is available even if the video call license is not installed.
QualiPoc "Log" monitor displays the video MOS and the speech MOS in parallel.
1. "Setup Video Call" in "Info" column indicates that the video call is initiated.
2. "CONNECT" message in "Info" column indicates that the video call is established
To check if the video call setup is successful, go to "System Trace Log" tab
"Setup Video Call", "DL video stream found", and "CONNECT" in "Info" column, indi-
cate that the video call setup is successful
DirecTV Now is one of the most popular applications for watching live and on-demand
TV in the United States. To emulate the user perception, DirecTV Now application, and
not an API, is used.
3. Enable the "Root compatible version" (3) to perform tests on a rooted device
4. Fill in "Username" and "Password" (4); these credentials are your DirecTV Now
service credentials:
Enter the full channel name with all its special characters, like it appears in DirecTV
Now app.
"Log" and "Test" tabs show the overall test behavior and the main KPIs.
Facebook Watch is a streaming service, currently only available in the United States,
for Facebook users. For testing the service, you must install Facebook app and set a
valid account.
1. Launch QualiPoc.
3. Touch "Apps".
4. Under "Facebook settings", touch "Version", download and install the available ver-
sion.
Facebook settings
3. Touch "Apps".
If "App Updates" is not visible on your device, e.g., on Samsung S5 (G900F), ensure
that you disable the automatic updates of apps in Play Store.
● Autoplay: Launch "Facebook" app, touch the menu icon (1) and under "Help &
Settings" area, touch "App Settings" (2) and set "Autoplay" to "On Mobile Data and
Wi-Fi Connections" (3).
Settings Description
"Link" Refers to the video that Facebook Watch streams, e.g., https://m.face-
book.com/story.php?story_fbid=344914869264856&id=344464935976516
"Display duration (s)" Defines how long the video is streamed starting from the first frame. The
maximum value is 600 seconds.
"Maximum test duration Defines a maximum duration from test start. In any case, the test is interrup-
(s)" ted if "Maximum test duration (s)" is reached.
"Stream lost timeout The test fails if the stream freezes for longer than the set value. The maxi-
(s)" mum value is 14400 seconds.
"Connection timeout The test fails if the first frame after pressing the video play button does not
(s)" appear within the set value. The maximum value is 240 seconds.
"Max setup time (s)" Defines the maximum allowed time from the test start until the Netflix app is
ready to start playing a movie. It covers the time needed to launch the app,
log in, select a profile, until the video play button is ready to be pressed. The
maximum value is 240 seconds.
5. Specify the remaining parameters for the test, e.g., the number of "Cycles", and
then touch icon or "Start".
The generic video test starts the VMON algorithm and allows you to evaluate the video
streaming quality of any video streaming application and analyze the VMON results in
NQDI.
1. On "Add test", touch "Generic Video Test" under "Streaming Tests" section.
3. Define how to start and stop the application of interest and how to start the video
streaming:
a) Using scripts for automatically starting and stopping the video streaming.
Configure Linux shell scripts as follows:
● Use only LF as end of line character.
● Use an appropriate tool to transfer the file to the phone.
● Ensure that you have the permission to execute the script files (chmod
command).
Examples:
● Touch "Generic Video Test" (1). Touch "Start script" (2) and locate your
script:
b) Manually starting the application and the video streaming after you start
the campaign.
● In that case, you do not define scripts. Touch "Start script file source" (or
"Stop script file source") (1) and check that "No file" (2) is selected. When
you start the campaign, QualiPoc displays a popup and asks to start the
video:
● When the set duration is about to expire, QualiPoc displays a popup with a
five seconds countdown timer:
The generic video test provides the following information on "Log" and "Test" monitors:
● "Resolution"
● "Video - Intermediate MOS"
● "Freezing": value in percentage
Limitations
Depending on the application in use, the generic video test may not work or it may
report unreliable values:
● "Amazon Prime": VMON does not see the video.
● "Vodafone TV Italy": the test checks for rooted phones with the global fuse bit.
● "SAT1 TV": a location error occurs.
Netflix is one of the most used applications for video streaming. To emulate the user
perception, Netflix application, and not an API, is used.
To install Netflix
1. Touch "Apps" (1) on "QualiPoc Settings"
Note: If needed, Google Play Service is updated during the application download.
3. You need a valid subscription for running the tests. Fill in the following fields
accordingly:
● "Username"
● "Password"
● "Profile"
Note: According to the subscription type, different functionalities are available, e.g.
the number of simultaneous users.
Although you can leave the "Profile" field empty, in case several profiles are
attached to the account, Netflix decides which profile is used. It could delay the
start of the video, and even lead to a failed test if "Max setup time (s)" is reached.
3. Set durations and cycles. See "Additional setting recommendations" on page 284
for additional settings description.
To get the "Video ID", use the share icon (5) in the test settings. Netflix application
opens (you need to log in first). Touch the sharing icon in Netflix (3) to share the Video
ID in the QualiPoc test configuration.
Check "Run video MOS evaluation" (6) to enable the video MOS evaluation. If you
uncheck the box, or if video MOS scores are not provided, freezing statistics are provi-
ded.
Netflix uses encryption for rendering HD resolution (i.e. resolution greater than
480p), preventing VMON algorithm from accessing the video frames. As a conse-
quence, we are not able to provide video MOS scores in case Netflix streams HD:
uncheck the box.
For most of the phones and regions, the video resolution does not exceed 480p and
video MOS is calculated.
Uncheck "Close app after test" (4) to leave the application running in the background:
● The application usually provides a lower resolution on test start
● Leaving it opened for next cycles gives higher probabilities of higher resolution
since the test is already started
● As a side effect, small IP traffic is generated while other tests are running
● "Display duration": the maximum value is 600 seconds. To get the playout KPIs, it
has to be longer than the video duration
● "Start video time": it defines when the video playback starts, e.g. for a video that
lasts 600 seconds, setting "Start video time" to 500 means that the video is
streamed starting from the 500th second.
When Netflix streaming test is running, no manual interaction with the device is
allowed. Set a number of cycles or a duration to manage test stop. A proper message
is displayed to avoid the user to interfere with the ongoing tests:
"Test" tab (1) displays the overall statistics and "Log" tab displays the information rela-
ted to the test behavior, e.g. the version in use (2), the display resolution (3), the inter-
mediate MOS (4), etc.
The same KPIs as for YouTube test are reported, but not all them are supported. For
more information on YouTube KPIs, refer to Chapter 5.3.5, "YouTube Video",
on page 287.
If the traffic is encrypted, i.e. when HTTPS is used, some KPIs are not populated.
You cannot use copyrighted videos or videos that have had embedding disabled.
You can select the YouTube app version for your test. For more information, see Chap-
ter 3.2.13.1, "YouTube App Version", on page 163.
You can also share a link from the Android YouTube application with QualiPoc.
"Run video MOS evaluation": Calculates Video MOS from IP parameters such as "IP
throughput" or resolution in use.
2. Search for the video in the YouTube app, touch the context menu beside the video,
and touch "Share".
For tests running on QualiPoc Handheld (and Freerider Slave), three indicators are
available:
● Video - Buffering started
● Video - Buffering ended
● Video - DL Progress (value expressed as a percentage)
To get the highest possible resolutions, it is important to play videos in full screen.
Initial and maximum window size is always Landscape. Resizing while testing is possi-
ble.
On top-left of YouTube video, a toggle permits to switch from Landscape to Portrait
Window size is indicated as soon as available on the right of the toggle. Window sizes
are defined as follows:
● Landscape: it is identical as a full-screen size but the height does not exceed
1200p
● Portrait: the width is limited by the screen width in portrait mode
FTP Transfer DL and UL tests establish a Packet Switch call, execute an FTP transfer,
and measure the test- related performances. You need to enter the following settings to
configure an FTP test.
To add the port number, type a colon (:) at the end of the address, and then type the
port number. Only QualiPoc Handheld uses this number.
Table 5-5: Description of the basic settings for FTP DL and UL single DATA tests
Setting Description
"FTP active mode" Check this box to use the FTP active mode. If you uncheck the box, FTP passive mode is
used.
To prevent an overall test duration from being shorter than a minimum duration, set a
minimum test duration.
If the test finishes before reaching the minimum test duration, an additional pause
duration is added to reach this minimum duration.
The minimum test duration applies to both successful and failed tests.
The maximum test duration cannot be smaller than the minimum test duration. A vali-
dation message prevents you from starting a campaign if such an error arises.
For both FTP UL and FTP DL tests, you must set the "Maximum test duration" at least
to seven seconds if you check "Maximum duration as fixed duration".
The timings' validation is done when the campaign starts.
FTP tests support FTP over SSL, that is, host addresses that start with FTPS and
FTPES.
► To use FTPS or FTPES, use the following formats for the host address when you
configure the test:
● ftps://ip_host_address
● ftpes://ip_host_address
Note:
● The default command port number for FTPS is 990 and for FTPES is 21. To
use a different command port number, add the a colon (:) and the number to
the end of the address, for example, ftps://80.74.152.241:992, where
992 is the custom port number.
● In NQDI Classic, the encrypted FTP protocol is not displayed on the "Protocol
Info" tab
The HTTP Transfer Download (DL) and Upload (UL) tests establish a Packet Switch
(PS) call, execute an HTTP transfer, and measures the test-related performances. You
need to enter the following settings for these tests.
Table 5-6: Description of the settings for HTTP Browser Transfer DL and UL single DATA tests
Setting Description
"URL" URL is the concatenation of the IP address of the host and the
file that you want to upload (for HTTP UL) or download (HTTP
DL):
If you want to use the HTTPS protocol for the test, use the fol-
lowing format for the URL:
https://user:[email protected]/put/10MB_inttest.dat
"Upload data source" (for HTTP UL) File that you want to transfer:
For HTTP UL:
● "Upload data source": two options are available
– "Local file": select a local file to be uploaded
– "Auto-generate local file": auto-generate the file to be
uploaded (under
\QualiPoc\Reference\Generated folder)
If the file is not already available under
\QualiPoc\Reference\Generated, it is generated
when the test starts; the generation time is not part of
the set test duration
"Force DNS lookup" If you run the test towards the same web page, the device
accesses it without resolving the URL name against the DNS,
by keeping the IP address in the cache; it subtracts the DNS
host resolution time from each test. To avoid this issue, and thus
to repeat the DNS request, check "Force DNS lookup" option.
If you check this option, NQDI reports KPI 31100 under "Analy-
sis" tab.
"Number of cycles" Number of times to repeat a single test before the campaign
ends
To prevent an overall test duration from being shorter than a minimum duration, set a
minimum test duration.
If the test finishes before reaching the minimum test duration, an additional pause
duration is added to reach this minimum duration.
The minimum test duration applies to both successful and failed tests.
The maximum test duration cannot be smaller than the minimum test duration. A vali-
dation message prevents you from starting a campaign if such an error arises.
To add and configure a Capacity DL/UL, touch "Capacity DL/UL" (1) under "Data
Transfer Tests" (2). Select either "GET" or "PUT" (3) to define the direction, and
respectively download or upload a file.
Capacity DL/UL tests can execute up to 10 parallel HTTP or FTP downloads at once:
When you select "PUT" for the "Operation", "Upload data source" field (1) is displayed
and allows two options for uploading the file:
Table 5-7: Description of the settings for a Capacity DL/UL single DATA test
Setting Description
"URLs" HTTP or FTP address of the site that you want to download or
upload
"Force DNS lookup" If you run the test towards the same web page, the device
accesses it without resolving the URL name against the DNS,
by keeping the IP address in the cache; it subtracts the DNS
host resolution time from each test. To avoid this issue, and thus
to repeat the DNS request, check "Force DNS lookup" option.
If you check this option, NQDI reports KPI 31100 under "Analy-
sis" tab.
Ensure that the total download size of the reference files is large enough to last for the
duration of the test.
Using up to 10 URLs is useful for measuring high throughputs, e.g., in carrier aggrega-
tion tests with MIMO 4x4.
For "Capacity" tests, you must set the "Maximum test duration" at least to seven sec-
onds.
The timings' validation is done when the campaign starts.
To configure a Capacity DL/UL test using the FTP protocol, enter the URL as follows:
ftp://user:pw@FTPhost/filename. In addition, ensure that you:
● Use different filenames for avoiding writing conflicts.
● Replace % character by %25 in the credentials, for example: replace ftp://user-
name:pwWith%[email protected]/1GB.dat by ftp://username:pwWith%25Char-
[email protected]/1GB.dat.
The following limitations apply to the use of the FTP protocol:
● FTP active mode is not supported.
● Secured connections, i.e., FTPS/FTPES are not supported.
● You cannot mix HTTP and FTP URLs.
● HTTP Capacity SubTest AccessTimes messages are not written since they are
HTTP specific.
● ISPConfig information is not written. Only the Capacity HTTP writes the ISPConfig
information of the first HTTP transfer.
● The reported traffic is taken from the application level while in the HTTP transfer it
is taken from the TCP level.
● MultiSocket KPIs are not available.
The section describes how to configure a smartphone test for the Dropbox cloud-based
storage service.
For more information on the Dropbox test, see the
White Paper - Cloud Storage Service Testing for Dropbox.pdf docu-
ment.
The Dropbox test requires a Dropbox developer account and an access token.
c) Use the browser "Back" button to cancel the Dropbox app download and to
return to the previous page
d) Optionally, i.e. if you did not receive any verification message yet, click "Send
email for verification"
e) Log in to your email account, open the verification message from Dropbox, and
then click "Verify your email"
Note: You do not need to download the Dropbox app.
3. Create an app for the Dropbox test:
a) On the "Create a new app on the Dropbox Platform" page, click "Dropbox API"
on "1. Choose an API" area
b) Click "App folder – Access to a single folder created specifically for your app."
on "2. Choose the type of access you need"
c) Enter a name for your app in "3. Name your app"
d) Check "I agree to Dropbox API Terms and Conditions"
e) Click "Create app"
f) In the "Development users" area, click "Enable additional users", and then click
"Okay" in the "Limit raised to 500 users" dialog box
g) In the "OAuth 2" area, click "Generate"
h) Copy the access token to a text file and save the file
i) Sign out.
Note: You need the access token to configure the Dropbox test.
4. (Optional) Create a subfolder for the Dropbox download test
a) Go to https://www.dropbox.com and sign in again
b) Click "Apps" and click your app
c) Click "New folder" icon (1), enter a name, e.g. Download (2), and press [Enter]
This procedure requires the access token to the developer account that you created in
Figure 5-79.
3. On the "Create job" screen, touch "Data Transfer Tests" group, and then touch
"Dropbox Transfer"
c) Touch "Dropbox access token" and enter the token that you created in Fig-
ure 5-79.
c) To add another action to the test, touch the plus sign (+) at the top of the "Test -
App - Actions" screen.
Note: The maximum size for the file to be uploaded is 150 MB.
QualiPoc automatically generates the files for the "Upload File" action in the follow-
ing location:
/QualiPoc/references/DataUpload/Generated/
The files are not compressible.
6. Touch the back button and touch the check mark ✔ at the top of the screen to save
the campaign.
You can monitor a Dropbox test on the "Log" and"Test" monitors.
5.4.5 Ookla
QualiPoc can use the Ookla Speedtest Mobile App to test the performance of an Inter-
net connection. For more information about the installation of the app, see Chap-
ter 3.2.13.2, "Ookla Speedtest App Version", on page 164.
The Ookla Speedtest performs the following tests:
● "Ping"
● "Download": Uses a predefined duration that you cannot change in QualiPoc
● "Upload": Uses a predefined duration that you cannot change in QualiPoc
4. (Optional) Touch "Server ID" to enter the ID of the server to which Ookla app con-
nects to perform the test. Touch icon to connect to http://www.speedtest-
server.com/ and search for a server.
Note: If you keep the default value, i.e., 0, the app tries to pick up the most con-
venient server, i.e. the server taking the shortest time for a response.
For more information on the server's selection, refer to https://support.speedt-
est.net/hc/en-us/articles/203845410-How-does-the-Begin-Test-button-select-a-
server-.
5. (Optional) Touch the plus sign (+) to add an additional "Execute Test".
7. Specify the remaining parameters for the test, for example, the number of "Cycles",
and then touch "Done".
When QualiPoc runs the test, the Speedtest App is in the foreground. QualiPoc starts
the App and presses the "Begin Test" button.
Do not close the Speedtest App during the test, that is, do not try to access any other
App on the phone, including QualiPoc, otherwise the test will fail.
FCC SpeedTest measures the packet loss (%) and latency (ms) with UDP transfer. In
addition, FCC SpeedTest measures the upload and download speed (Mbps).
The test requires an external application to be installed from QualiPoc settings.
The only supported versions are FCC Speed Test version 1.122 and 1.123.
3. Touch "FCC Speed Test Version", download and install the application
The test opens and configures the FCC Speed test App and measures the required
parameters. When FCC speed test is running, no manual interaction with the device is
allowed. A proper message (1) is displayed to avoid the user to interfere with the ongo-
ing tests:
The available KPIs are the same as for Ookla Speed Test, i.e. 10470, 20470, 30470,
31000, 31100.
New KPIs are available on the "KPI Report Generator":
● "Integrity - Data - Application Latency FCC"
● "Integrity - Data - Application Packet Loss FCC"
● "Integrity - Data - Application Throughput FCC downlink"
● "Integrity - Data - Application Throughput FCC uplink"
A Facebook test requires an App ID and an App token, which you can obtain when you
create a Facebook App.
● Alternatively, log in (in a new window) to the email account that you provi-
ded on the signup form, open the confirmation message from Facebook,
and then click "Confirm Your Account".
Note: As Facebook updates its user interface regularly, some of the reported
screenshots may slightly differ from the ones you get while performing the registra-
tion steps. We apologize for the inconvenience.
3. Register as a Facebook developer and create your first app:
c) Verify your account by entering your phone number (1), and then by clicking
"Send as Text" (2).
d) If requested, reenter your Facebook password (3) and click "Submit" (4).
e) Enter the confirmation code that you receive by SMS in the dedicated area (5)
and click "Verify" (6).
f) Edit the "App Name" (1) at your convenience and click "Next" (2).
Note: You need these references when you configure a Facebook test.
3. On the "Create job" screen, touch "Social Media Tests", and then touch "Face-
book".
4. Specify the details of the Facebook App that you created in Chapter 5.5.1.1, "Cre-
ating a Facebook App", on page 320.
a) Touch and enter the "Name" of the App.
b) Touch and enter the "App ID".
c) Touch "App Token" and enter the access token for the App.
5. Touch "Actions" and touch an action on the "Select action type" screen.
● For the "Create Post" action, touch the type of post, and then touch "OK".
● For the "Open post" action, specify the download options if the post contains a
picture, and then touch "OK".
You can use the "Log" monitor to view the start and end of Facebook actions and the
"Test" monitor for the overall test execution time, including the times for single actions
and sequences of actions.
5.5.2 Browsing
An HTTP Browser test establishes a Packet Switch (PS) call and performs a browsing
test to output test relevant results. For this test QualiPoc application uses the same
web engine as the built-in browser does. To run the test you need to specify the follow-
ing settings for an HTTP Browsing test.
If you run the test towards the same web page, the device accesses it without resolv-
ing the URL name against the DNS, by keeping the IP address in the cache; it sub-
tracts the DNS host resolution time from each test. To avoid this issue, and thus to
repeat the DNS request, check "Force DNS lookup" option.
If you check this option, NQDI reports KPI 31100 under "Analysis" tab.
The HTTP Browser test supports HTTP traffic compression according to the following
HTTP standards:
● All requests must have the accept-encoding=gzip header
The value can contain additional options to gzip.
● If an HTTP request contains the accept-encoding=gzip header, the server can
decide whether to return a compressed gzip response.
This header is not a command. Instead, the server decides whether the compres-
sion makes sense or not. In general, the server compresses text files, such as,
*.txt, *.html, and *.csc, but not images that are already in a compressed for-
mat, for example, *.jpg.
► To check compression if PCAP recording is enabled, use Wireshark you can check
if all request have the correct accept-encoding header and there are some respon-
ses with header “Content-encoding=gzip”
You can use Wireshark to verify HTTP compression if you have enabled PCAP files.
Look for the correct accept-encoding header as well as Content-encoding=gzip
headers.
Table 5-8: Description of the settings for an HTTP Browser single DATA test
Setting Description
"Number of cycles" Number of times to repeat a single test before the campaign
ends
To prevent an overall test duration from being shorter than a minimum duration, set a
minimum test duration.
If the test finishes before reaching the minimum test duration, an additional pause
duration is added to reach this minimum duration.
The minimum test duration applies to both successful and failed tests.
The maximum test duration cannot be smaller than the minimum test duration. A vali-
dation message prevents you from starting a campaign if such an error arises.
Instagram is a social networking app for sharing photos and videos from a smartphone.
Everyone who creates an Instagram account has a profile and a news feed. Posted
videos and photos are displayed on your profile. Your followers access your posts in
their own feed, and conversely.
The Instagram test performs the following actions:
● "Post Picture"
● "Post Video"
● "Comment Post"
● "Delete Post"
SwissQual provides default media for performing the actions. Refer to step 5.
To install Instagram
1. Launch QualiPoc.
3. Touch "Apps".
5. Touch the version number that you want to install under "Version", download and
install the application:
Note: Some devices like HTC10 or LG G5 are shipped with a preinstalled Insta-
gram version, and automatic update that must be disabled.
The supported versions are 10.4.0.669 and 11.0.0.12.20.
4. Enter your full name and a password, and then touch "Next":
Note: Remember the password, you have to use it in QualiPoc. Refer to step 4
5. Enter a username, and then touch "Next".
Note: Remember the username, you have to use it in QualiPoc. Refer to step 4
6. Skip the next step: "Find Facebook Friends To Follow".
1. Launch QualiPoc.
3. Touch "Apps".
5. Under "General Settings", activate "Default Media" (3) to test Instagram using the
media provided by SwissQual:
3. A picture is automatically added to the actions' list (4). Touch "+" to add supple-
mentary actions (5):
Note: Limit the number of images and videos to 170 (85 pictures + 85 videos per
day) to avoid getting blocked by Instagram.
4. Configure the durations, cycles, and pauses.
5. Press "Start".
"Live monitoring" reports the logs of the Instagram test on "Log" panel. The execution
of each single action is reported, i.e. "Action 1 ended" (1):
The postprocessing application NQDI displays the results under "Analysis" tab:
● If an action uploads a file, NQDI reports the corresponding filename and the size of
file:
– "Post picture" uploads a picture.
– "Post video" uploads a video.
● "Social media" tab displays the following:
The graph displays colored bars, core and "init" durations being differentiated:
The average throughput is shown for all actions containing picture/video upload.
5.6.1 Ping
A Ping test establishes a Packet Switch call and pings the host that you specify to eval-
uate the Round Trip Time (RTT). You need to specify the following settings for a Ping
test.
Setting Description
"Cycles" Number of times to repeat a single test before the campaign ends
To prevent an overall test duration from being shorter than a minimum duration, set a
minimum test duration.
If the test finishes before reaching the minimum test duration, an additional pause
duration is added to reach this minimum duration.
The minimum test duration applies to both successful and failed tests.
The maximum test duration cannot be smaller than the minimum test duration. A vali-
dation message prevents you from starting a campaign if such an error arises.
Ping test implemented in QualiPoc and Freerider III support IPv6 address.
IPv6 entry has the following format [2a00:1450:4009:810::200e].
Additionally, the IPv6 packets are displayed in the IP monitor and filtered as ICMP
packets
The IPv6 source and destination addresses are visible in the decoded packet
Network Performance test aims at checking the network connectivity continuously, and
provides peak performance indications. It is a combination of Iperf3 test, that runs con-
tinuously to check the network connectivity, and capacity tests (get or put) that are exe-
cuted for a short time with a set interval time. For a detailed description of the test,
refer to Application Note - Network Performance Test.pdf.
3. Set the "Iperf Host" that corresponds to the Iperf3 server in use
The "Test" tab reports the statistics for the capacity test (1). The "Log" tab reports the
intermediate throughputs (2) and the connectivity percentage (3), corresponding to the
amount of time, during both the capacity and Iperf3 test, when the available throughput
is above the "TCP floor bandwidth"
For a list of available KPIs and the application examples, refer to the corresponding
chapter in Application Note - Network Performance Test.pdf.
Line is an internet-based messaging application which allows to make voice and video
calls, send text messages, pictures, videos, audio files and stickers.
The scenario is a double-ended text, photo, and sticker test from one Friend to
another.
5.7.1.2 Installation
Installing
The supported versions are Line 6.2.2 and Line 7.5.2.
To install Line
1. Touch and touch "Settings".
2. Touch "Apps".
Limitations
● Current implementation supports only one friend.
● Manually create the friend on the phone.
The Line test objective is to test the successful sending and receiving of text mes-
sages, photos and stickers, and to measure the time to perform these actions.
Basic Function
The message flow consists of the following steps:
● The sending side sends an initialization message which contains:
– A test identifier used for linking send and receive sessions
– The number of following messages
● The receiving side sends the finalization message.
3. On "Test - App - Actions" screen, a "Send Text (initial)" action is already configured
and cannot be edited nor moved
It notifies the "Line Receive" test that a "Line Send" test has started and transmits
the required information. For more information on the message flow, refer to "Basic
Function" on page 353.
5. Touch "Send Text" and start writing your message, or touch "Send Sticker" or
"Send Photo"
Note: Send Text action allows a maximum of 21 text messages of up to 258 char-
acters.
Job validation shows an error if a "Send Text" action does not contain any text.
For both "Send photo" and "Send sticker" tests, there is a limit of one photo or one
sticker action per test.
"Send photo" action always sends the same black photo, emulating user's behavior
picking up a photo from the gallery. "Send sticker" action always sends the same
sticker picking up a sticker from the sticker folder.
One test contains a maximum of 24 actions.
7. On "Line Send" screen, define Friend name. Touch "Friend name" and enter the
name of the Friend
"Line send" test is ready. Configure "Line Receive" test (refer to "Line Receive
Test" on page 359. Make sure that both devices are time-synchronized, for a cor-
rect calculation of message durations in postprocessing.
Parameters Description
1 ID sent in the initialization message used for linking sending and receiving side.
Parameters Description
3 For notification message: Send notification. For other messages: the name of the action
as defined in the test.
5 Throughput in kbit/s.
6 Type of action.
7 Time when the sending side received the confirmation that the receiving side has
received the message
Parameters Description
1 ID sent in the initialization message used for linking sending and receiving side.
4 This field is populated when "Messaging Type" is "Receive Photo" and corresponds to
the picture download duration on the receive side
5 Throughput in kbit/s.
6 Type of action.
7 Time needed for the message delivery. It excludes the time needed to send the mes-
sage (Duration field on the sending side). It is calculated as: Delivery duration = Time
(receiving side) – Time (sending side) – Duration (sending side).
Delivery duration is displayed only when Line Send and Line Receive files are impor-
ted.
Delivery duration is correctly computed only when Line Send and Line Receive are
time-synchronized.
The chart displays bold lines representing the time when the receiving side receives
the message:
Table 5-12: Description of the settings for MMS Send and Receive single MESSAGE tests
Setting Description
At the beginning of the test, QualiPoc deletes the contents of the inbox.
Table 5-13: Description of the settings for SMS Send and Receive single MESSAGE tests
Setting Description
Setting Description
Table 5-14: Description of the settings for a Email Send and Receive single DATA test
Setting Description
"Outgoing mail server name" and "Incoming mail server name" Address of the email server
The scenario is a double-ended text and photo test from one Contact to another.
5.7.5.2 Installation
Installing
The only supported version is WhatsApp 2.17.24
To install WhatsApp
1. Touch and touch "Settings"
2. Touch "Apps"
If a different version than 2.17.24 is already in use on the device, WhatsApp test is not
supported.
Do not use special characters for the contact name since it causes problems reading
the name.
Configuring WhatsApp
Disable all "Media auto-download" on WhatsApp "Data usage" screen.
2. Press "Data usage" and deactivate all options under "Media auto-download":
Limitations
● The current implementation supports only one contact.
● Manually create the contact on the phone.
● The application must stay in the foreground.
● The use of the international prefix, e.g. +41 for Switzerland, is required for the defi-
nition of the contact phone number.
● Only one send photo action per test is allowed. The photo is a predefined 375 kbit
image
Save the contacts according to your needs, either on the device or on the SIM card.
If the SIM card changes, WhatsApp asks to repeat the verification steps.
3. On "Test - App - Actions" screen, a "Send Text (initial)" action is already configured
and cannot be edited nor moved.
It notifies the "WhatsApp Receive" test that a "WhatsApp Send" test has started
and transmits the required information. For more information on the message flow,
refer to Chapter 5.7.5.3, "Text Message and Photo Tests", on page 372.
6. Touch "OK". The messages are added to the actions' list and you can combine
both. Refer to "Limitations" on page 371 for checking the limitations.
7. On "WhatsApp Send" screen, define Contact name. Touch "Contact" and enter the
name of the Contact.
"WhatsApp send" test is ready. Configure "WhatsApp Receive" test (refer to "Creat-
ing a WhatsApp Receive Test" on page 378). Make sure that both devices are
time-synchronized, for a correct calculation of message durations in postprocess-
ing.
Recommendations
Synchronization
● Send and Receive side datetime must be synchronized, otherwise the End-to-End
delivery time is affected by the time difference
● "WhatsApp Receive" test must be started first
● Since "WhatsApp Receive" test must be ready for reception of new messages, set
its "Maximum test duration" to 0 (indefinite). To prevent "WhatsApp Receive" test to
block endlessly, if ever a message is never received, we do set the Receive time-
out. The Receive timeout is used for text message reception (except start mes-
sage) and for photo download. If any expected message is not received within the
receive timeout, the test fails with "Receive timeout". If the photo is not downloaded
within the receive timeout, the test also fails with "Receive timeout".
● In "WhatsApp Send" test, there is no "Send timeout" because we use the "Maxi-
mum test duration" to prevent "WhatsApp Send" test to block endlessly.
Example:
Any of the following blocking actions are canceled when the "Maximum test duration" is
reached
● Waiting for a message to be sent to the WhatsApp servers (single tick appears)
● Waiting for a read confirmation (double tick appears)
● Waiting for the SQ Test Done message
Parameters Values
Parameters Description
1 ID sent in the initialization message used for linking sending and receiving side.
3 For notification message: Send notification. For other messages: the name of the action
as defined in the test.
4 Time from the beginning of an action and the read confirmation time (double tick) for this
action:
5 Throughput in kbit/s.
7 Time when the sending side received the confirmation that the receiving side has
received the message.
Parameters Description
1 ID sent in the initialization message used for linking sending and receiving side.
4 This field is populated when "Messaging Type" is "Receive Photo" and corresponds to
the picture download duration on the receive side
5 Throughput in kbit/s.
Parameters Description
7 Time needed for the message delivery. It excludes the time needed to send the mes-
sage (Duration field on the sending side). It is calculated as: Delivery duration =
Receive time – Send start time.
For photos, also the photo download time is reported.
The chart displays bold lines representing the time when the receiving side receives
the message:
WhatsApp Statistics
WhatsApp Send and Receive actions statistics are available in the App Test statistics
report.
5.8.1 Idle
An idle test does not perform an active test. Instead, the test monitors the phone and
produces a results file that only contains information that the phone gathers, that is, L1,
L3, and so on.
You can use the job to check what a phone does while in idle mode or to emulate some
aspects of scanner functionality.
5.9 Actions
You cannot use actions in a sequence of tests.
● Answering............................................................................................................. 384
● Video Answering................................................................................................... 385
● WhatsApp Answering............................................................................................386
● Upload...................................................................................................................387
5.9.1 Answering
The "Answering" action sets up a Circuit Switch (CS) call to act as an answering sta-
tion. This station can be part of the network, that is, an automatic voice announcement
number in MSC, a Diversity Call Server that is running as an answering station, or
another QualiPoc device running in Answering Station mode, that is, single CALL test -
Answering Station. Currently, the test outputs the main test-related KPIs and MOS val-
ues of the speech in the downlink.
Setting Description
For speech quality tests, you can use the SQUAD08 or POLQA P.863 and P.501 algo-
rithms.
You need a valid QualiPoc license for the algorithm that you want to use.
The "Video Answering" action puts the B-side device (of a "Video Call to Answering
Station" test) in answering station mode. The device will pick up incoming calls and
play selected speech sample.
Setting Description
The "WhatsApp Answering" action puts the B-side device (of a "WhatsApp Call to
Answering" test) in answering station mode. The device will pick up incoming calls and
play selected speech sample.
Setting Description
5.9.4 Upload
The Upload test uploads the results files to the server that you specify in the test set-
tings.
This test uses the "Result files upload connection profile" that you configure in the
"Results Files Tagging/Upload".
This test uploads the files from the results folder that you define in the unit configura-
tion settings.
3. Touch "Connection type" and specify server options in the "Result files upload con-
nection profile" area.
5.10 Sessions
A "Session" is a container for tests that is useful for post-processing analysis in NQDI
Classic.
You can add the following types of sessions:
● "Data Session": Multiple data tests that are run sequentially
● "Parallel Session": Multiple tests are run in parallel; it contains one call test (one
"Call to Any Number" only) and a maximum of 3 data tests
● "Call-Data Session": see below.
2. Touch "Multi-RAB PS Execution" (2) for defining the "Speech (CS)" and "Data
(PS)" tests' parameters, and which of the cycles are executed with packet
switched, and which are not (3)
3. "Delayed start" (4) allows you to set a delay between the start of the "Speech (CS)"
and the "Data (PS)" part of the test:
2. In the list, select a file, touch the Play icon besides the device's name of the file
that you want to replay.
2. Touch a measurement file (1), and then "Export Survey Data" (2) under "Exports"
section:
You can only export survey data that you added to an iBwave *.ibwc file that you
imported into QualiPoc.
5. In the list of results, touch the iBwave export icon beside the survey data that you
want to import into iBwave Mobile Planner.
6. In the iBwave Mobile app, click the file, and then click "Import".
You can export scanner data from QualiPoc measurement files, containing the iBwave
project (floor plans) and manually entered map positions (on the floor plans).
2. Click
4. Select "Scanner data" option and the technologies you want to export by checking
the corresponding checkboxes accordingly
5. Click "OK". The exported scanner file name (*.ibwc) consists of the iBwave proj-
ect name (previously imported into QualiPoc) and of the following suffix: "Scanner"
6. Click one of the iBwave app icons to open the file in the corresponding iBwave
Mobile app
After opening the file into the iBwave app, for instance iBwave Mobile Note, the data is
parsed, which requires a couple of minutes.
iBwave Mobile Note lists and checks all available scanner data. Uncheck the data you
do not want to import.
Click "Import" to start the import process.
Note: QualiPoc exports the data as a Zip file, which contains *.CSV, *.tab, and
image files.
When you load multiple measurement files, NQView uses the device ID to distinguish
between the devices. NQView automatically assigns unique device IDs when you con-
figure a system, for example, a Benchmarker II system. For a QualiPoc Device in
Handheld mode or Freerider mode, you need to manually assign device IDs on the
phones. For more information, see the Manual - QualiPoc Handheld.pdf docu-
ment.
Annex
A About LTE Carrier Aggregation
LTE Carrier Aggregation or channel aggregation enables multiple LTE carriers to be
used together to provide the high data rates that are required for 4G LTE Advanced.
Carrier aggregation has the following characteristics:
● Download (DL) and upload (UL) resources come from aggregated resources of two
or more Component Carriers (CC), which can be of different bandwidth sizes as
well as on different LTE bands
● Maximum number of aggregated component carriers is five, which results in the
100Mhz of maximum aggregated bandwidth
● Number of UL CCs is always equal or smaller then the number of DL CCs
The easiest way to arrange aggregation is to use contiguous component carriers within
the same band, that is, intra-band contiguous component carriers. Non-contiguous
allocation can be intra-band CCs in the same band or inter-band CCs
CA has been initially specified for the following combinations of EUTRA bands and
CCs:
● CA bandwidth class: indicates a combination of maximum ATBC and maximum
number of CCs
– Class A: ATBC ≤ 100, maximum number of CC = 1
– Class B: ATBC ≤ 100, maximum number of CC = 2
– Class C: 100 < ATBC ≤ 200, maximum number of CC = 2
– Classes D, E, F are still in a study phase
Aggregated Transmission Bandwidth Configuration (ATBC) = Total number of
aggregated Physical Resource Blocks (PRB)
The 20Mhz band has max 100 RBs, 10Mhz band 50 RBs, and so on.
● CA configuration: Indicates a combination of E-UTRA operating band(s) and CA
bandwidth class, for example:
Inter-band, non-contiguous f
Band 1 Band 2
White UE Black UE
eNodeB
Primary Serving Cell (PSC), Primary Component Carrier (PCC), RRC connection and data
Secondary Serving Cell (SSC), Secondary Component Carrier (SCC), user data
Secondary Serving Cell (SSC), Secondary Component Carrier (SCC), user data
For UEs that use the same set of CCs, can have different PCC.
CIF
LTE-Advanced eNodeB
Primary Serving Cell (PSC), Primary Component Carrier (PCC), RRC connection and data
Secondary Serving Cell (SSC), Secondary Component Carrier (SCC), user data
2. In the "Control" console of NQView, add a call server to the "System Configura-
tion".
a) On the Navigation panel, click "System configuration".
b) Right click "Hardware", point to "Add unit", and then click "PC".
c) On the "General" tab, select "Enabled", and specify the following information:
● In the "Name" box, type the name for the call server.
● In the "Computer" name box, type the Windows computer name of the call
server.
● In the "Time synchronization" list, click "Internal sync".
● In the "NQComm" control list, click "Diversity FTP".
● In the "Unit control" list, click "Diversity FTP".
● In the "Job transfer send" and "Job transfer listen" lists, click "None".
● In the "NQComm result" list, click "Diversity FTP".
Note: Do not select the "DTMF scan" option. Do not select "The device is an
answering station" option in the "Answering station" area.
4. Create an intrusive speech job for the call server.
a) On the Navigation panel and click "Tasks and Jobs".
b) Expand "Job definitions", right-click Intrusive, and then click "Add job".
c) In the "Name" box, type a name for the job, for example, Answering Station
IT_clip_08.
d) In the "Record hang-over [ms]" box, type 18500.
e) Clear the "Use call duration to abort call" check box.
f) In the "MOC:MTC" ratio box, type 1:0, click "Apply", and then click "OK".
5. Create a task that involves the call server and an A-side device.
If your system does not have an A-side device, add one as a placeholder device
for the task.
a) Right-click "Tasks" in the tree and click "Add task".
b) In the "Name" box, type a name for the task, for example, Android Speech.
c) In the"Device A/B" side area, assign the devices.
● In the first list, click you're a-side device.
● In the second list, click the call server that you created.
d) In the "Job sequence" area, click the green plus sign .
e) In the "Job" list, click the job that you created, and then click "Save".
f) In the "Measurement task" window, click "Apply", and then click "OK".
g) Right-click the task in the tree, click "Export B-side task" file, browse to a loca-
tion, and then click "OK".
h) Copy the B-side task file to the following location on the call server:
b) If the call server is not connected to NQView, you need to complete the follow-
ing steps:
● Right-click the unit on the "System configuration" panel, point to "Export
configuration", and then click "Unit only".
● Copy the .config file to the call server, for example, with a USB stick.
● On the call server, click "Stop" on the "Control" menu in Diversity Supervi-
sor.
● On the "Tools" menu, click "Import Configuration", locate the .config file
for the unit, and then click "Open".
● On the "Control" menu, click "Start".
Note: If you see error messages, restart Diversity Supervisor.
If you want to quickly change the audio clip, that is, reference sample, for the job, you
can edit the B-side task file.
2. In the "Tests" section at the end of the file, you can modify the following parame-
ters:
● TestName_0: You can enter Speech or Speech POLQA
● TypeOfTest_0: You can enter Speech or Speech POLQA
● ReferenceSample_0: You can change the first two letters of the file name to
use a different language. For example, if the current reference sample is
IT_fm_IRS.wav, you can change the first two letters from IT to EN for the
English language audio file.
You can change the answering machine back to a call server with a simple Windows
Registry edit.
C.1 Introduction
A Diversity Call Server is a computer that can control fixed-line PSTN or ISDN devices
as well as mobile phone devices. A fixed-line Call Server is also known as a Land Unit.
A Call Server is typically used as the B-Side in a Diversity or QualiPoc call quality mea-
surement job.
You can configure a Call Server with the following software:
● NetQual NQView on the controlling PC
● Diversity Supervisor on the Call Server
During the export process, NQView does not validate if subscribers or phone numbers
are assigned to the devices. If you try to run a measurement task on a device that does
not have these assignments, the task fails and you receive an error message about the
missing assignment.
c) Go to the location where you want to save the *.config file, and then click
"OK".
Note:
If you want to view the contents of the configuration file, change the file extension
from *.config to *.zip, and then open the ZIP file. This file contains individual
XML files.
c) Wait until only the "SuperVisor" tab remains open, and then click "Import Con-
figuration" on the "Tools" menu.
Diversity Supervisor does not validate the configuration file during the import
process. If the configuration file contains an error, the server enters an error
state during system startup.
Figure C-2: Import configuration file for voice or video call server
d) In the "Open" dialog box, locate the configuration file, for example,
PCM8000000.config, and then click "Open".
e) In the "Confirm" dialog box, click "Yes", and in the "Info" dialog box click "OK".
b) In the "Subscriber" dialog box, type the "Name" and the "Phone number" of the
ISDN card, click "Apply", and then click "OK".
a) Right-click the Call Server, point to "Add device", and then click "ISDN".
3. Wait until only the "SuperVisor" tab remains open, and then click "Visibility Options"
on the "Tools" menu.
4. In the "Measurement Engines" list, click "Visible", and then click "OK".
6. Dial each ISDN line and verify that the call activity on the "Log" tab, for example,
the "Incoming configuration call".
The measurement test must run entirely on the smartphone and only DTMF job trans-
fer is supported.
● In the measurement task settings, select the "Run the task directly on the
smartphone" check box.
You can configure a Call Server in NQView and transfer the configuration directly to the
server or you can save and transfer the configuration file offline.
b) In the "Subscriber" dialog box, type the "Name" and the "Phone number" of the
ISDN card, click "Apply", and then click "OK".
a) Right-click the Call Server, point to "Add device", and then click "ISDN" or
"PSTN".
b) In the "Model" list, click a device, for example, "Eicon ISDN Diva Server".
c) In the "Subscriber" list, click the subscriber profile that you created for the card.
d) In the "Channel" list, click the Channel number for the ISDN device.
e) Select "DTMF scan", click "Apply", and then click "OK".
f) Repeat these steps for each additional ISDN/PSTN device.
If you do not have a direct connection to server, you can create and export a Call
Server configuration file from NQView, and then transfer the file to one or more Call
Servers.
During the export process, NQView does not validate if subscribers or phone numbers
are assigned to the devices. If you try to run a measurement task on a device that does
not have these assignments, the task fails and you receive an error message about the
missing assignment.
c) Go to the location where you want to save the *.config file, and then click
"OK".
Note:
If you want to view the contents of the configuration file, change the file extension
from *.config to *.zip, and then open the ZIP file. This file contains individual
XML files.
c) Wait until only the "SuperVisor" tab remains open, and then click "Import Con-
figuration" on the "Tools" menu.
Diversity Supervisor does not validate the configuration file during the import
process. If the configuration file contains an error, the server enters an error
state during system startup.
Figure C-22: Import configuration file for voice or video call server
d) In the "Open" dialog box, locate the configuration file, for example,
PCM8000000.config, and then click "Open".
e) In the "Confirm" dialog box, click "Yes", and in the "Info" dialog box click "OK".
You can add ISDN/PSTN devices to an existing Call Server with Diversity Supervisor.
Diversity Supervisor is part of the Diversity Benchmarker software that runs on the Call
Server.
4. On the "Tools" menu, point to "Call Server Configuration", and then click "Configure
PSTN / ISDN Devices".
5. Add a device.
a) Right-click your computer name in the tree and click the type of call device that
you want to add, for example, a PSTN Device.
Note: Repeat these steps for each device that you want to use.
6. On the "Control" menu, click "Start".
You can verify the Call Server configuration with Diversity Supervisor.
3. Wait until only the "SuperVisor" tab remains open, and then click "Visibility Options"
on the "Tools" menu.
4. In the "Measurement Engines" list, click "Visible", and then click "OK".
6. Dial each ISDN line and verify that the call activity on the "Log" tab, for example,
the "Incoming configuration call".
You can use a B-Side mobile Call Server with QualiPoc Freerider III and Diversity A-
Side devices.
You can use Diversity Supervisor to configure the B-Side Call Server for a QualiPoc
Freerider III speech double ended job.
2. Connect the B-side device to the computer and wait for the automatic hardware
detection to add the device to the "Device Status Panel".
c) In the "Info" dialog box click "OK" and wait until the icon on the "Device Status
Panel" turns green.
d) Hold your mouse the phone icon on the "Device Status Panel" and click the
edit icon .
e) Enter the phone number for the device and click the arrow ✔.
f) On the "Control" menu, click "Apply Configuration", and then click "OK" in the
"Info" dialog box.
4. On the "Control" menu, click "Start", and then wait until the device icon turns green.
a) On the FR Master, touch the menu icon at the top of the screen and touch
"Campaigns".
b) Select the campaign, touch the menu icon at the top of the screen, and then
touch "Export B-Side job".
c) Enter the phone number for the A-side device and touch "OK".
7. On the FR Master, touch a campaign in the list, and then touch "Start Campaign" at
the top of the screen.
8. On the Call Server, verify that the icon for the B-Side device is blue, that is, the
state is "Measuring".
Device is ready
Device is measuring
SQ-Diversity-Hotfix-16.3.x.x.xx-PPxx-General.zip
5. Locate the hotfix package, click "Open", and in the "Info" dialog box, click "OK".
Note:
The SQUALUpdater.exe automatically performs the update.
D Dropped Calls
If a call drops during a test and the Android Call app remains open until the end of the
specified call duration, QualiPoc does not mark the call as "Completed".
QualiPoc assigns the following dropped call states to calls that drop before the call
duration is reached:
● "Call Dropped (break)":
– Android call app detects the dropped call immediately and closes, which results
in an Android call idle state
– Android call app detects a delayed dropped call and reports the Android call
idle state as delayed
For example, a call is reported as idle as soon as the network connection is re-
established following an out-of-service situation and not at the point where the
network link is lost
● "Call Dropped (no active termination)": Android call app does not close when the
network connection breaks and continues to remain open until the call duration for
the test is reached
In such a situation, Android does not detect the dropped call and does not report a
call idle state.
E.1 Introduction
Diversity fixed duration TCP-based data tests, including FTP, HTTP, and Capacity
tests, provide information that is crucial to your mobile network optimization efforts.
The technology in a wireless network can vary from location to location. This variation
can affect the data transfer speeds of a typical static quality measurement during a
drive test, for example, when you drive from a high bandwidth to a low bandwidth area.
If the intent of your measurement campaign is to determine the comprehensive aver-
age throughput of the network, the campaign will fail due to the different download and
upload speeds in the high and low bandwidth areas in your network.
The problem arises when you base this calculation on the number of successful trans-
fers of a complete file while driving at a constant speed for the duration of the test. Due
to the different throughput rates, more transfers are likely to complete in a high band-
width area than in a low bandwidth area over the same amount of time. As a result, the
statistics tend to be weighted in favour of the high bandwidth values, which can eclipse
the low bandwidth values.
To solve this problem, SwissQual has developed TCP-based fixed duration tests.
E.1.1 Limitations
The fixed duration test does not calculate download success rates. That is, if a data
transfer successfully completes before the test ends, the test fails.
● ETSI TS 102 678 Speech and multimedia Transmission Quality (STQ); QoS
Parameter Measurement based on fixed Data Transfer Times
● Manual - NQDI - KPI Users Guide.pdf
● Manual - Diversity Data and Messaging Tests.pdf
The following KPIs are calculated for the FTP fixed duration scenario:
● 20310 Retainability FTP Uplink Fixed Duration
● 20311 Retainability FTP Downlink Fixed Duration
● 30310 Integrity FTP Uplink Fixed Duration
● 30311 Integrity FTP Downlink Fixed Duration
The following KPIs are calculated for the HTTP Transfer fixed duration scenario:
● 20411 Retainability HTTP Transfer Get Fixed Duration
● 20412 Retainability HTTP Transfer Put Fixed Duration
● 30411 Integrity HTTP Transfer Get Fixed Duration
● 30412 Integrity HTTP Transfer Put Fixed Duration
The following KPIs are calculated for the Capacity test fixed duration scenario:
● 20461 Retainability Capacity Get
● 20462 Retainability Capacity Put
● 20463 Retainability Capacity Get and Put
● 30461 Integrity Capacity Get
● 30462 Integrity Capability Put
● 30463 Integrity Capacity Get and Put
Glossary
Symbols
°C: Degree Celsius
A
A: Ampere
A-Side: All files coming from a measurement unit that initiated the first call of a test (A-
side calls the B-side)
B
B-Side: All files coming from a measurement unit that was waiting for a first incoming
call (B-side is called by the A-side)
There may not be B-side files for every test.
Backup drive: Portable USB storage drive where images are backed-up to and
restored from (either provided by SwissQual or utilizing customer’s own)
BM2: Benchmarker II
BM2GO: Benchmarker II Go
BR device: Backup and Restore drive that has the BR (Backup and Restore) utility
installed
C
Call Server: Diversity Call Server, which is a computer that controls PSTN or ISDN
phone lines or the B-Side mobile phones in a video call test.
Call Session: A Call session includes all data between the dial command to the device
and the call end. Normally, a call session contains exactly one call.
Clonezilla: Open Source Software to create and restore reference HDD image files
Collection Name: The name that can be assigned to measurement results before the
data import into a NQDI database.
D
DAC: Digital to Analogue Converter
Data Session: A Data session includes all data between the start of a data test and
the end of a data test.
Device Name: Name of the device that was used for a measurement (ISDN 0, Sam-
sung 5, …)
Diversity Files: A Diversity file has the extension sqz. Such files are created with the
Diversity Test System.
E
EMC: Electro Magnetic Compatibility
Eth: Ethernet
Exy: Projected or implemented values for the Samsung Exynos chipset phones sup-
porting ICD v4.90
F
Factory Image: Image that contains Windows and Diversity software that SwissQual
has pre-configured
File, Measurement File, Log File: Contains all the logged information between the
start and the stop of a measurement execution.
All the data from a file are assigned to sessions. We differentiate between A-side and
B-side files.
FW: Firmware
G
GLORIS: GLObal Rohde & Schwarz Information System
H
HANDO: Handover
I
IATA: International Air Transportation
Idle Session: An Idle session contains all data that are not allocated to either a data
session or a call session. For example, the data between two calls or that data before
the first data session.
IPC: Industrial PC
J
JLR: Junction Loudness Rating
K
kB/s: kilo Bytes per second
L
LAN: Local Area Network
Land Unit: Diversity Call Server, which is a computer that controls PSTN / ISDN
phone lines or the B-Side mobile phones in a video call test.
M
Maintenance Release: An interim patch, usually with minor bug fixes for specific cus-
tomer issues.
N
New version or Major Release: A major software release from SwissQual that
updates the entire Diversity software platform. The version number of a major release
ends with 0, for example, 18.0.0.0 or 18.0.
O
OLAP: Online Analytical Processing
P
PABX: Private Automatic Branch eXchange
Q
QC: Available in general with the current Qualcomm chipset phones
R
RAID: Redundant Arrays of Independent Disks
Reference Image: Backup image file that is created by you or a SwissQual CPM that
contains your custom settings and drivers.
S
S/W: Software
Session: A session can either be a call session, a data session or an idle session.
SwissQual distinguishes between the following types of sessions: IDLE, CALL , and
DATA
All data from a measurement file will be divided into one of these types of sessions.
A session is the duration of a measurement call from the dial command until the dis-
connect/release. For voice calls, the session type is CALL
A session can also be a GPRS/UMTS data test (like an FTP transmission). Then, the
session type is DATA
A session is also the time between two calls or between two data transmissions (ses-
sion type = IDLE).
Setup Time: Time between the start of a dial command until the successful detection
of a connection to the B-side (CC: CONN_ACK in case of ISDN, activity detection in
case of analogue PSTN
T
TCM: Test Device Containment Module
Test Id: Unique Identifier for a Test (SQUAD LQ, SQUAD SS, SQUAD NS, DTMF, FTP,
UDP, HTTP, …)
U
UPS: Uninterruptible Power Supply
V
V: Volt
Voice and Video Call Server: Diversity Call Server, which is a computer that controls
PSTN or ISDN phone lines or the B-Side mobile phones in a video call test.
VQEG: Video Quality Expert Group, an independent international forum for video qual-
ity evaluation metrics
W
W: Watt, unit of power
Index
A Double Ended Call .................................................... 237
Dropbox .................................................................... 306
Access point Email Send and Receive .......................................... 365
Select ........................................................................ 169 Facebook .................................................................. 319
Add FCC SpeedTest ........................................................ 312
Monitor ........................................................................ 44 FTP DL and UL ......................................................... 293
Photo marker .............................................................. 35 HTTP Browser .......................................................... 332
Text marker ................................................................. 35 HTTP Transfer DL and UL ........................................ 295
Text markers during measurement ........................... 162 Idle ............................................................................ 384
Advanced Analysis Instagram .................................................................. 334
Settings ..................................................................... 153 LINE test ................................................................... 359
Advanced forcing Load .......................................................................... 174
Settings ..................................................................... 144 MMS Send and Receive ........................................... 363
Altitude Network Performance ............................................... 343
icon ............................................................................. 69 Ping ........................................................................... 341
Android QA ........................................................................ 14 SMS Send and Receive ............................................ 364
Android RF ........................................................................ 14 Upload ...................................................................... 387
Answering Station Video Call Tests ........................................................ 257
Campaign ................................................................. 255 YouTube Service ....................................................... 287
Diversity Call Server ................................................. 407 Capacity DL/UL
Measurement files .................................................... 417 Single Data Test ........................................................ 298
Modify Diversity Answering Station .......................... 415 Carrier aggregation
apk Technology monitor ..................................................... 56
Update QualiPoc ......................................................... 27 Cell Info banner ................................................................. 35
App Testing Cells
LINE .......................................................................... 346 Icon ............................................................................. 38
WhatsApp ................................................................. 365 Monitor ........................................................................ 55
Clear
B Monitor ........................................................................ 40
Color
B-side Icon ............................................................................. 48
Configuration ............................................................ 426 Scanner Bar chart colors .......................................... 213
B-Side Compass
Configure device in Diversity Supervisor .................. 437 icon ............................................................................. 69
Delete device from Call Server ................................. 441 Compression
Battery Results files .............................................................. 152
Level ......................................................................... 174 Configuration
Level in scanner ........................................................ 216 B-Side smartphone ................................................... 426
BTS Call Server ........................................................ 419, 430
Settings and Information ............................................. 97 Call Server in NQView ...................................... 420, 427
Copy and paste monitor configuration ........................ 49
C Date and Time ............................................................ 27
GPS ............................................................................ 26
Call Server IBflex scanner ........................................................... 203
Add ISDN/PSTN device ............................................ 432 Verify ......................................................................... 424
Answering Station ..................................................... 407 Verify Call Server ...................................................... 435
Configure .................................................. 419, 427, 430 View contents of configuration file .................... 419, 431
Configure offline ................................................ 418, 430 Configure
Create for Speech Double-Ended campaign ............ 249 Call Server ................................................................ 427
Double Ended Call test ............................................. 238 Call Server offline ..............................................418, 430
Multiple systems ....................................................... 444 Mobile Call Server for Freerider III ............................ 437
Verify configuration ........................................... 424, 435 Connect
Call Test Connect IBflex scanner to QualiPoc ......................... 197
Double Ended Call .................................................... 237 Connect TSMA scanner to QualiPoc ........................ 195
Video Call Tests ........................................................ 257 Coverage
Call to Any Number Icon ............................................................................. 38
Single Call Test ......................................................... 256 Monitor ........................................................................ 55
Campaign Create
Answering Station ..................................................... 255 Call Server for Speech Double-Ended campaign ..... 249
Call to Any Number ................................................... 256 Capacity DL/UL test .................................................. 298
Capacity DL/UL ......................................................... 298 Custom monitor ........................................................ 135
Create and run .......................................................... 166 Custom monitor with performance parameters ......... 124
Create Double Ended Call campaign in NQView ......249 Diversity Answering Station ...................................... 407
G IMS
Settings ..................................................................... 153
Generic video test Indoor floor plans .............................................................. 74
Single data tests ....................................................... 277 Create ......................................................................... 76
Geo-referenced floor plan Indoor route
Create ......................................................................... 81 Create ......................................................................... 77
Google maps ..................................................................... 72 Installation
Google Maps QualiPoc ..................................................................... 16
Change map provider ................................................. 87 Security settings for QualiPoc ..................................... 30
Google Play Software hotfix .......................................................... 442
YouTube App requirements ...................................... 164 IP
Google Play Services Icon ............................................................................. 38
Update ........................................................................ 73 IP Call
GPRS/EDGE Monitor ...................................................................... 105
Data monitor ............................................................... 54 IP Monitor
GPS Settings ..................................................................... 132
Configuration .............................................................. 26 ISDN
External ....................................................................... 27 Add device to Call Server ......................................... 432
GPS accuracy
icon ............................................................................. 69 J
GSM
Layer 3 dwelling time ................................................ 203 Job
Stop .......................................................................... 174
H
L
Help
Videos ......................................................................... 33 Last position update
HERE Maps icon ............................................................................. 69
Change map provider ................................................. 87 Layer 3
HSDPA (Signaling) Monitor ...................................................... 60
Data monitor ............................................................... 54 GSM Layer 3 dwelling time ....................................... 203
HSUPA Layers
Data monitor ............................................................... 54 Map ............................................................................. 75
HTTP Layout
Browser Single Data Test ......................................... 332 Monitor ........................................................................ 44
Transfer DL and UL Single Data Tests ..................... 295 Level
HTTP post Battery ...................................................................... 174
Upload Measurement files ........................................ 182 License
Borrowing licenses ...................................................... 20
I License updates .......................................................... 16
Wibu license ............................................................... 16
IBflex scanner Licenses
Bar chart colors ......................................................... 213 Requesting a license .................................................. 21
Configuration options ................................................ 203 Returning a license ..................................................... 24
Connect to QualiPoc ................................................. 197 LINE
Create scan .............................................................. 199 Messaging tests ........................................................ 346
Export configuration profile ....................................... 217 LINE test
Export scanner survey data ...................................... 215 Create test ................................................................ 359
Get measurement results ......................................... 213 LINE Test
GSM Layer 3 dwelling time ....................................... 203 LINE Receive Test .................................................... 359
LTE MIMO data ......................................................... 206 LINE Send Test ......................................................... 354
LTE Scan Configuration ............................................ 205 Supported use cases ................................................ 347
Monitor data .............................................................. 210 Load
Record and transfer data .......................................... 208 Measurement campaign ........................................... 174
WCDMA parameters ................................................. 204 Location
iBwave Service settings on map ........................................... 101
Export QualiPoc to Mobile apps ....... 188, 190, 395, 397 Log
Map monitor ................................................................ 74 Icon ............................................................................. 38
Mobile ............................................................... 186, 393 Monitor ........................................................................ 52
Icon LTE
Change color .............................................................. 48 IBflex MIMO data ...................................................... 206
Idle IBflex scan configuration ........................................... 205
Test ........................................................................... 384 MCS index .................................................................. 59
Import MIMO 4x4 ................................................................... 60
iBwave floor plan .............................................. 186, 394 Monitor ........................................................................ 56
QualiPoc configuration settings ................................ 159
Text markers ............................................................. 161
T V
Tag setups Verify
Create ....................................................................... 137 Call Server configuration .................................. 424, 435
Select ........................................................................ 138 Video Call Tests
Task Video Call to Answering Station ................................260
Create Double Ended Call task in NQView ...............251 Video Call to Any Number .........................................262
TCP Video Double Ended Call .......................................... 259
Fixed duration tests .................................................. 446 VoLTE
Technology Monitor ...................................................................... 105
Icon ............................................................................. 38 VoWifi .............................................................................. 153
Monitor ........................................................................ 53
Technology forcing W
Enable ....................................................................... 142
Enable advanced ...................................................... 145 Waypoints
Technology monitor Map ............................................................................. 78
Carrier aggregation ..................................................... 56 WCDMA
Test IBflex parameters ...................................................... 204
Create Double Ended Call test on phone ................. 239 WhatsApp
Icon ............................................................................. 38 WhatsApp messaging test ........................................ 365
Monitor ........................................................................ 52 WhatsApp messaging test
Settings ..................................................................... 167 Current implementation ............................................ 366
Text markers Supported use cases ................................................ 366
Add during measurement ......................................... 162 Text message and photo tests .................................. 372
Create ....................................................................... 160 WhatsApp NQDI results ............................................ 380
Import ........................................................................ 161 WhatsApp receive test .............................................. 378
Theme WhatsApp send test .................................................. 373
Change appearance ................................................. 156 WhatsApp Messaging Test
Tile Cache ......................................................................... 90 WhatsApp Recommendations .................................. 380
Time WhatsApp Speech Test ................................................... 256
Configuration .............................................................. 27 Wi-Fi
Token Icon ............................................................................. 38
Dropbox .................................................................... 306 Monitor ...................................................................... 102
Facebook .................................................................. 320 Update QualiPoc ......................................................... 27
TSMA Window timings ............................................................... 170
Bar chart colors ......................................................... 213 Windows Registry
Create scan .............................................................. 199 Configure B-Side device ........................................... 426
Export configuration profile ....................................... 217 Windows Registry key
Export scanner survey data ...................................... 215 DWORD .................................................................... 444
Get measurement results ......................................... 213 Workspace ........................................................................ 31
Monitor scanner data ................................................ 210 Customize ................................................................. 133
Record and transfer data .......................................... 208
TSMA scanner Y
Connect to QualiPoc ................................................. 195
YouTube App version
U Set ............................................................................ 163
YouTube Service
UARFCN Single Data Tests ...................................................... 287
Set preferred on map ................................................ 101
Unit configuration Z
Operation mode ........................................................ 148
Settings ..................................................................... 148 Zoom Level
YouTube App version ................................................ 163 icon ............................................................................. 69
Update
Settings ..................................................................... 165
Updating
QualiPoc ..................................................................... 16
QualiPoc through a mobile or Wi-Fi network .............. 27
QualiPoc through a USB connection .......................... 29
Upload
Icon ............................................................................. 38
Measurement files to server ..................................... 181
Test ........................................................................... 387
USB
Update QualiPoc ......................................................... 29