Load Testing

Best Practices
Using WebLOAD
Table of Contents

Introduction....................................................................................................... 4
WebLOAD Components and Architecture...................................................... 5
WebLOAD IDE.............................................................................................. 6
WebLOAD Console...................................................................................... 6
Load Generator (LG)................................................................................... 7
Probing Client.............................................................................................. 7
WebLOAD Analytics.................................................................................... 7
WebLOAD Dashboard................................................................................ 7
PostgreSQL DB............................................................................................ 7
TestTalk........................................................................................................ 7
WebLOAD Deployment..................................................................................... 8
Planning Your Tests........................................................................................... 10
Building Agenda Using WebLOAD IDE............................................................ 12
Record.......................................................................................................... 13
Script Manipulation..................................................................................... 14
Agenda Tree Pane and JavaScript View............................................... 14
Toolbox Pane.......................................................................................... 14
Advanced Scripting - JavaScript, DOM, XML, and Java....................... 15
Correlation................................................................................................... 16
Parameterization......................................................................................... 18
Response Validation................................................................................... 19
Testing Your Script...................................................................................... 20
Table of Contents
Executing an Agenda Using the WebLOAD Console..................................... 21
Template...................................................................................................... 22
Basic Template Definition.......................................................................... 22
Mix................................................................................................................ 23
Template and Agenda Settings................................................................. 24
Schedule Your Virtual Users and Agendas............................................... 25
Probing Client and Real User Experience................................................. 26
Cloud Load Generators.............................................................................. 27
Performance Measurements Manager.................................................... 28
APM Tools Integration................................................................................ 29
Test Automation and Continuous Integratio........................................... 29
Load Test Results Analysis................................................................................ 30
Terminology and Meanings....................................................................... 30
Timers - Response Time, Hit Time, Transactions Time........................... 31
Throughput.................................................................................................. 32
Errors of Many Kinds.................................................................................. 33
Server Measurements................................................................................ 33
Analyze Your Test Results with WebLOAD Analytics..................................... 34
Building Templates and Portfolios............................................................ 35
Publish Charts and Reports....................................................................... 35
WebLOAD Dashboard....................................................................................... 36
Creating and Editing Dashboards............................................................. 37
Viewing Currently Running and Past Session.......................................... 38
Share Dashboards...................................................................................... 38
Playlist (Slideshow)...................................................................................... 38
 Introduction

This guide will help you plan, design and execute efficient load testing using WebLOAD.
It will help you:

Understand the Plan and implement

methodology and your load testing efforts
essential steps for with WebLOAD in the
conducting load testing. most efficient way.

If you are totally new to load testing I suggest that you read the 2 following resources below:

What is load testing? A primer.

4 types of load testing and when each should be used.

4
 WebLOAD Components and Architecture
WebLOADs key components include:

Integrated Development Environment (IDE) Analytics - for analyzing test results.

- for developing load scenarios. Dashboard - for viewing real-time results
Console - for managing and controlling tests. via the web and sharing with multiple
Load Generator - for generating load on your system. stakeholders.

System
Cloud
Under Test
Load Generators
IDE
Web
Servers

Console Application
Servers

On Premise
Load Generators

DB
Dashboard Analytics

5
 WebLOAD Components and Architecture

WebLOAD IDE
You create your scenario/script - called Agenda in WebLOAD - via the WebLOAD IDE recorder, or directly script it using
WebLOAD IDE editor. Using the IDE, you can define correlations, validations and parameterization, and define special
parameters that affect the behavior of your scenarios. If these concepts are new to you, dont worry, they are all clarified
later on in this document.
When you save your Agenda it is saved as a WebLOAD Project File (.wlp). It is recommended to test your created
Agenda in WebLOAD IDE prior to the real load test. If you save your Agenda after you run it in the WebLOAD IDE it will
be saved in WebLOAD Session file (.wls). While the .wlp file contains the agenda including all the recording information,
the .wls includes all the recording and execution information that is gathered by WebLOAD IDE during the execution of
the Agenda.

WebLOAD Console
Using the WebLOAD Console you define the test to be executed by defining a Template (.tpl).
A template, which represents a whole test, defines:
The agendas to be executed.
The number of virtual users to be used on a specific schedule.
The Load Generators (LG) machines and cloud LG machines.
Probing Client machines.
Performance Measurements of your servers to be collected during your test.
Once the test execution is completed, you can save the test results into a load session file (.ls).

6
 WebLOAD Components and Architecture

Load Generator (LG) WebLOAD Dashboard

The load generators are machines that create the load The WebLOAD Dashboard is a lightweight web server
on your system. Each load generator can run thousands that lets you see results of a currently running session
of virtual users, and WebLOAD lets you define many or past sessions. You can view data from a browser or
load generators per each test, so you can easily reach a mobile device, share results/views with your peers,
hundreds of thousands of virtual users in a single test. and create your own views of the data.
TIP The console itself also contains a load generator,
but it is recommended to have separate load generator
machines for large scale load tests. You can use the PostgreSQL DB
LG on WebLOAD Console for small scale tests and for
validating the tests before large scale tests. WebLOAD session results are saved in files (.ls). These
files are used by the console to view test results.
WebLOAD Analytics and WebLOAD Dashboard use the
Probing Client PostgreSQL DB to view test results. After or during the
test, test results are pushed to the DB, so that they can
The probing client is a concept of running a single be viewed by WebLOAD Analytics and the WebLOAD
virtual client on a single and dedicated machine Dashboard.
throughout the load session. The idea is to see how
the load affects a standalone virtual client that is not
related to the load overhead.
TestTalk
TestTalk is an internal component to WebLOAD which
WebLOAD Analytics is responsible for the internal communication between
all WebLOAD components. It must run on any machine
While the WebLOAD Console lets you see test that runs a WebLOAD component.
results during and after the test execution,
WebLOAD Analytics lets you analyze test results in
depth and create reports. WebLOAD Analytics is a
comprehensive reporting framework offering many
predefined and configurable charts and reports, which
can be emailed or printed.

7
 WebLOAD Deployment
A typical WebLOAD deployment consists of the
following:

WebLOAD Console TIP It is recommended to run TestTalk as a service

One or more machines that can coordinate a test, which on Windows or as a daemon on Linux. You can apply
should be installed on a Windows machine. WebLOAD the option during installation. Note that TestTalk
IDE, LG, and WebLOAD Analytics are part of the console service requires administrator rights.
installation.
PostgreSQL DB
Load Generator and probing client WebLOAD Installs the PostgreSQL DB as part of the
WebLOAD Console installation. This provides the ability
machines to work on the same machine with WebLOAD Console,
The number of Load Generators is not limited, and will WebLOAD Analytics and WebLOAD Dashboard.
depend on your needs. The load generator machine can
You can also work in a distributed mode, where you
be installed on a Windows or Linux machine, on premise
install several WebLOAD consoles, WebLOAD Analytics
or on the cloud.
and the WebLOAD Dashboard on different machines.
TIP There are also pre-installed Load Generators on In this case you may prefer to have a centralized
AWS cloud. If you have an Amazon account, WebLOAD can PostgreSQL DB installation, with all WebLOAD
start LG machine on Amazon automatically for you during components connected to it. This can be configured via
test initiation. It also stops the machine when the test the following settings:
ends.
WebLOAD Console Global
Options Database
Test Talk - Tools
TestTalk is WebLOADs internal communication WebLOAD Analytics
component. It is installed with all other components and - Window Preferences Database
uses ports 9000 and 9010 by default. Make sure that no
other application is using these ports, or that the firewall WebLOAD Dashboard - Attaching to the
is not blocking these ports. TestTalk ports can be changed PostgreSQL DB is done via dashboard.bat
via configuration file (WebLOAD.ini).

8
 WebLOAD Deployment

WebLOAD Dashboard
The WebLOAD Dashboard is typically installed as part The following diagram illustrates example of distributed
of the console machine but it can also be deployed deployment of WebLOAD:
on a dedicated machine. The WebLOAD Dashboard is
automatically attached to the local PostgreSQL.
In order to show currently running sessions - In
WebLOAD Console, go to Load Generators
WebLOAD Distributed & Probing Clients
Deployment Example
Tools Global options Database
Dashboard
Cloud
and set the checkbox Insert Statistics into
PostgreSQL database during the session.

IDE I Console I Analytics

On-
Premises
PostgreSQL

IDE I Console I Analytics

9
 Planning Your Tests
Before you get into your car, you always know where youre going. The same applies in load testing.
Planning is critical and prior to creating any test, you should ask yourself:

What is the What

What do What are the
load that s are you
you need For how measurement r
you want to expecte
to run? long? of success or d
simulate? failure? results?

All of these and more must be clear ahead of time. Otherwise, youll find yourself running around in circles
without making any real progress.
A full blown book can be written on planning load testing but here are a few essential guidelines:

Building Testing Environment

Build a testing environment that simulates your real life environment. For more information, see this
blog post: http://www.radview.com/6-tips-for-building-a-better-load-testing-environment/.

TIP Do not forget to simulate any periodical/background processes in your real environment. They
may affect your users while they are running.
TIP You may need to disable some features in your application. For example, if you have integration
with a payment system, you do not want your test to make a payment. Or if you simulate book ordering,
you do not want items to be shipped to virtual users!

10
 Planning Your Tests

Scenarios Planning Uptime Planning

Plan for your users scenarios. Make sure you cover the Test duration. How much uninterrupted uptime does your
following questions: system require? This affects how long your test should run.
A. How many users are working in parallel? For example, if you have an online store that needs to work
24/7, it may be smart to test it for a few weeks to ensure
B. Which scenarios are they running? What is the
response time or memory usage does not deteriorate
distribution of the scenarios between the users? during long runs.
C. From which locations? What is the distribution of
the scenarios between locations?
D. Which device are your users using? In which
distribution? Full Test vs. Component Test
E. What is the expected load during peak times? For
You may decide to test your system in several ways:
example, a certain day like Black Friday. Another
example may be stock buy/sell requests that may A. Testing the entire system from the cloud - this will
be higher at the beginning of day, or week. In other ensure that you are addressing all layers: the internet,
words, when you plan your test schedule, it should load balancer, web servers, web apps, etc.
be based on the behavior of your system in real life. B. Testing the system from your internal network,
For more information about planning and creating skipping the internet. You can even skip the load
scenarios see: http://www.radview.com/how-to-plan- balancer and test your system starting from your web
realistic-load-test-scenarios/. server.
C. Test specific layers inside your system, for example
web services or even a specific DB query.
Defining Success Criteria
Define success criteria that will be based on:
A. Successful transaction percentage
B. Expected response time
C. Expected response validation errors percentage
You may have different success percentages for
different transactions from different locations.
11
 Building Agenda Using WebLOAD IDE
Use the WebLOAD IDE to create Agendas to be later executed by the WebLOAD Console.

12
 Building Agenda Using WebLOAD IDE

Record
The most common usage is to record your agendas WebLOAD records your activity in Incognito mode in
using WebLOAD proxy recorder. When you click the Chrome (In-Private in IE), which means that your cache
record button, you can select which browser to use for and cookies are ignored. In this situation your activity is
the recording, and you can also identify your session as recorded as a new user who is doing an activity.
it was done by a browser or by a mobile device. TIP HTTP traffic is being recorded by WebLOADs
proxy, using the default port 9884. If this port is used by
another process, change it via

Tools Recording and Script Proxy

Generation Options Options

Tips
Begin/End Transaction. Transaction is an
important term in load testing, as it represents
a certain activity that you might want to measure, for
example, login, buy stock, etc. That activity can be
built from one HTTP request, or a few HTTP requests
or others. You might want to wrap the relevant HTTP
requests with Begin/End Transaction.
Filtering. The proxy recorder records all the traffic that
goes from the browser. There are redundant URLs that
you may want to filter out from your test. For example,
there are ads that are directed to an external site, or a
Make sure that a small toolbar named WebLOAD browser plug-in that performs some activity. WebLOAD
Recording is opened automatically where you can control can filter these activities from the recorded session.
the recording, add transactions, add messages, etc. Go to
Recording and Script URL
Tools
Generation Options Filtering

13
 Building Agenda Using WebLOAD IDE

Script Manipulation
Agenda Tree Pane and JavaScript View TIP Right click in your script to easily insert WebLOAD
variables and methods to your script.
You can see the recorded agendas via 2 main views: TIP for advanced users: WebLOAD has special
methods such as InitAgenda that runs once for each
Tree Pane on the left execution, or InitClient that runs once per each client,
JavaScript View on the right etc. You can create these methods by selecting these
Functions at the top of the JavaScript View, and write
These 2 views are correlated. Clicking on a specific node on your JavaScript special code. To learn more about
the tree will present the node related script on the JavaScript WebLOAD methods flow, it is recommended to drill
View to be edited. Clicking on the tree root will present the down into the documentation.
entire JavaScript code. To edit the entire script, press the full
script button.

TIP WebLOAD IDE has two working modes: edit mode

and execution mode. When you are in execution mode, you
cannot make any change to your Agenda as it affects the
execution. So, before executing, WebLOAD asks you to save
all your work and it moves you automatically to execution Toolbox Pane
mode. If you want to edit your Agenda, switch back to edit To manipulate the JavaScript code, you can also use the
mode. toolbox on the left panel. Just drag and drop a certain
building block to the tree. Once youre done, new node
will be added to the tree. The most useful building
blocks are the Begin/End Transaction and Set/Send
timer. All building blocks are also available in direct
scripting.

14
 Building Agenda Using WebLOAD IDE

Advanced Scripting - JavaScript, DOM, XML, & Java

WebLOAD uses the Standard JavaScript Language with many dedicated objects and methods that help create tests - starting
with Objects such as wlHttp, wlFTP and other protocols, wlGlobals for setting global variables, special methods for Messages
such as InfoMessage and ErrorMessage, Transaction Methods, etc.
WebLOAD also creates DOM for each Http response, which provides many capabilities to manipulate your response by
scripting special verifications, etc.
You also have direct access from JavaScript to Java, COM, and XML Objects. This lets you call external code, and enhance your
script with non-standard APIs and protocols.

Tips
It is recommended to go over the WebLOAD Scripting Guide doc, in
order to learn more about these scripting methods and many more.

In order to code in your script, you can add a code to any recorded
node, but it may be convenient also to drag and drop JavaScriptObject
to the tree, and you can code there anything youd like. This way you
can keep the structure of the tree while adding the JavaScript segment
you need.

You can save your reused JavaScript methods in a .js file, and when
needed use the IncludeFile method. A good example for such a
usage may be login and logout which are common to all application
activities.

15
 Building Agenda Using WebLOAD IDE

Correlation
Correlation is an important concept in Load Testing. It
addresses the conflict between the fact that servers keep
track of client sessions and add dynamic values to the clients
sessions on one hand, and the fact that these dynamic values
become static in a recorded script on the other hand. The
script needs to be changed in order to get rid of these values
and make the script dynamic values friendly. A good example
of this is SessionID, which is unique to every client. It cannot
use the recorded SessionID. Doing so will cause errors.

WebLOADs correlation engine helps you find the problematic

values within the recorded script and replaces them
automatically. The correlation uses a rule based engine that
has default rules, and can be enhanced with any new rule
that you find necessary. Once the rules are set correctly, you
do not need to deal with the dynamic values ever, since after
WebLOAD learns your application, the entire process is 100%
automatic.
Once the agenda recording is done, a correlation window
will be opened. If it is the first time you have recorded your
application, click on the button Automatically discover rules
and correlate script.
16
 Building Agenda Using WebLOAD IDE

This will open a screen with all fields which are suspected as TIP WebLOAD helps you define the
dynamic values that need to be correlated. Now, you can mark necessary rules for future recordings. It
which rule should be used. shows for each value whether it was found
by a predefined and Active rule. WebLOAD
also shows whether a value was found by its
enhanced automatic algorithm that scans
the pages and looks for more sophisticated
values - these values are presented as
Temporary. If you find a temporary rule as
one that should work for future recordings
as well, make it Permanent via the
dropdown menu.

TIP Many times, servers have a time

related dynamic value. If you execute the
script right after the recording (without
correlating), it might execute correctly, but
after an hour when the server changes
the dynamic value, your script will fail.
It is a good practice to test your script
after correlation, to make sure the value
replacements are done correctly. It is even
better to test your script again a few hours
later, or even a day after it was recorded and
edited, to make sure it still works correctly.

17
 Building Agenda Using WebLOAD IDE

Parameterization
Parameters are your way to create real life
scenarios. For example, you would like to create
a load test with 1000 different virtual users at
the same time. Youll need to create different
login details - username and password - for
every virtual user. Not using parameters may
cause errors in the best case or an inaccurate
test in the worst case.

The Parameterization Manager on the home tab

menu helps you manage your parameters. You
can get parameters from a predefined file, or
create dynamically dates, times, strings, etc.

Once your parameter is configured, it will be

automatically added to a WebLOAD variables list
and you are able to use it in your script view via

right click Insert Variable

similar to the way you add any other WebLOAD

variable to your script. You can always code it
directly as well.

18
 Building Agenda Using WebLOAD IDE

Response Validation
In load testing it is important to validate the correctness of the responses and not just keep track of performance. This
ensures that the server is functioning correctly, even under load. For more details, read the blogpost:
www.radview.com/blog/validation-during-load-testing-trust-but-verify/
WebLOAD lets you verify response values by coding validations directly in the script or by using the Response Validation
feature. When you are focused on a certain node, working in Page View or HTML View of each node, you can right click and
open the response validation window. You can then define validation for a certain value in the page, set a time limit to the
page, decide how to proceed when validation fails, etc.

TIP You can combine the response validation and

the parameterization manager. As part of validating
response values in your script, you can have a
predefined list of known values that you expect to
see in the response. For example, if you have 1000
different users for your bank application, each will have
a different balance you may want to validate.

19
 Building Agenda Using WebLOAD IDE

Testing Your Script

After you have made all necessary changes to your script, it is highly recommended that you
will execute the script several times to make sure it works properly. You may have made many
changes while developing the script, so before you load test your system with 10,000 virtual
users, you want to ensure it performs correctly.
In WebLOAD IDE you can run the script from start to end directly or you can use the Debugger
which lets you run the script step by step, set breakpoints, check each step, check temporary
values you have set, etc.

TIP When you run your script you can see side by side and compare the server
response during current execution and during the recording phase.

20
 Executing an Agenda Using
the WebLOAD Console
The WebLOAD Console lets you manage load testing execution by choosing the agendas, the load
generation machines, the load profile (virtual users throughout the test), etc.

Before defining test execution parameters, bear in mind your test goals and requirements. How many virtual users, which
activities, in which percentages, from which locations, etc. In addition, server performance measurement that you would like
WebLOAD to collect for you, etc. Here are a few tips:

TIP Test your system first in low volume with only one TIP Document your tests. Performance testing
Agenda (do not mix). It is easier to find the root cause in a is an iterative process and youll be running tests
simple test, and in most cases there are issues that can be multiple times, modifying settings and running again.
easily found this way. For example, it is far more difficult to It is easy to get confused without detailed tracking of
find root cause when you run a mix of 20 agendas, than when what were the goals and exact settings each run. So
running one agenda only. Start small and grow. Only after you document your tests - what was running, why it was
are satisfied with the low volume, increase it and mix it to your running, what was changed from previous test, etc. It
test targets. will save you a lot of time during the triage process.

TIP In the agile world you perform tests on the system TIP Plan enough time for running performance
while its being developed. You dont have to wait until you tests. Running tests, making changes to the
have full system to start testing it. You can test performance environment, fixing, re-running and analyzing results
in your first iteration, when you have one service ready, and consumes time.
move on from there to other services. You definitely do not
need to wait until the very end of your development when
performance testing at this point may be too late. With the
richness and flexibility of WebLOAD scripting you can test any
partial ready service and manipulate the test to your specific
condition.

21
 Executing an Agenda Using the WebLOAD Console

Template Basic Template Definition

The template definitions are built around the following
structure:

You begin execution by creating a Template in the WebLOAD

Console. The template holds the configuration details of the
test session: LG machines, schedule, scripts, etc. You can
create a template several ways:

Using a WebLOAD Wizard - The wizard goes through all

needed options for creating a successful test session. Below the load session you first add the agendas to run
in the test, and for each agenda you define the Load
Using the Goal-Oriented Test Wizard - which lets you define Generator that will run it. In the example above, there
a test while you have your target in mind. You define are two agendas defined - Registering and Searching.
the target of your test and the test will run automatically Two different load generators machines will execute
until it reaches the target. You do not need to define any each agenda.
scheduling - WebLOAD does that for you. For example, you
would like to test how many users your system will handle The wizards will create this structure as you progress
while your register transaction is still below 2 seconds - with your definitions. If you build your template
WebLOAD will load your system gradually and will notify manually, you should add agendas either by right
when it reaches your target. clicking the Load Session object in the tree, or by
clicking the Agendas selection in the edit bar. The same
Manually creating your template. way, you can add machines, schedule, change settings,
etc.

22
 Executing an Agenda Using the WebLOAD Console

Mix
In WebLOAD you can select several agendas and dedicate load Add agenda files to the mix, set their weight, and the
generators. But you can also define a mix of agendas to run other configurations. Once your mix is defined, save it
with a certain distribution between them, and easily define in a .mix file. From now on, you manage the mix entity
machines and schedule for all of them together rather than by and select it in your test, like any standard agenda.
one to one.
You can also add a few mix files and a few agendas in
First, define your mix by selecting the Mix Creation button the same test. For example, executing one mix from
from the console top edit bar. It opens the following window: a few machines, executing a second mix from other
machines, and specific agendas on yet other machines.
This powerful capability gives you the option to reach
the most enhanced agenda combination you need, with
the most enhanced configuration.

TIP Read the following blogpost to learn more about

distribution of your virtual users during the test: http://
www.radview.com/how-to-distribute-stress-in-load-
testing-scenarios/.

23
 Executing an Agenda Using the WebLOAD Console

Template and Agenda Settings

In addition to the basic template configuration, WebLOAD
Console lets you fine tune settings, such as sleep time,
browser cache, etc. It is possible to set options for all agendas
or for specific agenda only.

Under the Tools tab, youll find a few options:

Global Options - Parameters that reflect basic
configuration of WebLOAD Console, and options that
affects the activity of the entire test. For example, statistics
resolution, WebLOAD DB configuration, etc.
Default Options - These options are dedicated to the TIP Many options can be written in the JavaScript. If
agenda activity itself. The settings related to the protocols, an option appears in the script, it overrides any other
sleep time control, zip, SSL, browser cache, etc. The default option that appears in WebLOAD Console.
settings are used for each agenda that is added to your
test. TIP After you define all options and before you press
Options for the current test: the start button - check all your settings again and make
sure there are no mistakes. Load tests runs for a long
Agenda Options - When you add a mix or agenda to
time, and you do not want to discover after a few hours
WebLOAD execution tree, WebLOAD Console copies
that you misconfigured something and you wasted
the default options to the agenda options. So to
precious time.
change any setting of one agenda, change the agenda
options. TIP By default, WebLOAD records the sleep time
Current Sessions Options - When you make a (think time) between your clicks. You may want to run
change that will be reflected on ALL agendas that are your test with the sleep time as recorded, or you may
currently defined in your test, you can change it once want to change it dynamically during execution. In the
using the current sessions options. This is a shortcut, sleep time control in the Agenda Options window you
instead of going over each agenda options and making can manipulate the sleep to your needs, and it will
the change one by one. overwrite the sleep time in the agenda.

24
 Executing an Agenda Using the WebLOAD Console

Schedule Your Virtual Users & Agendas

Scheduling can be done in two ways:

Manual defining virtual users and times.

Using the load profiler which contains known profiles
like, steps, linear, random, etc. It helps you create
complex definitions easily.

Tips
Do not overload your LGs. WebLOAD console lets you You can dynamically change the number of virtual
define as many virtual users as you want for a specific users during test execution, overriding the templates
machine. Note that the machine can be weak and scheduling:
therefore cannot handle the number of virtual users
you defined. If one or more of your load generators is Session Throttle
overloaded during a test, the results may be worthless. Control
For more information, read the following the blogpost: You can change the number of virtual users.
http://www.radview.com/blog/how-to-to-detect-
overloaded-load-generators-in-load-testing. Session Freeze
Make sure that the LG machines are clean from other
jobs and currently running processes. This can reduce the You can freeze the progress of your session you
load used power, and skew results. continue testing with the current number of virtual
users and the template time does not continue.
You can combine profiles in your session. For example,
These two features are time savers. When you want
step increment, then perform ramp up profile, and
to investigate your systems behavior on specific load
more.
size, you can freeze, change the load, and continue
from where you froze your test - without the need to
stop the test, and execute it again.

25
 Executing an Agenda Using the WebLOAD Console

Probing Client and Real User Experience

Probing Client is a term introduced by WebLOAD and relates
to Load Generator of single client only. It is recommended to
use at least one probing client in each test for the following
reasons:

Your LG machines are doing a lot of work simulating You can also put several probing client machines in
many virtual users. This means that load machines may different locations so you can see the results from
be noisy. If you want to look at the response time different locations. A probing client can execute any
and transaction times, or any other timers without the agenda LG can execute, without any limitations.
overhead of the load generator, it is recommended to see
the results from a machine that runs only a single user. Another interesting way to use the probing client is by
This way you can see how a single user experiences your executing a real browser or mobile device. This way, you
server performance, without the noise. load your servers with Load Generators, and measure
the real user experience from a browser or from a real
A machine that runs a probing client, by definition, should mobile device. WebLOAD lets you run real browsers
not be loaded by itself. Thus, the probing client machine and devices by integrating with 3rd party functional
can act as a good indication whether your servers or your testing tools such as Selenium, Ranorex, Original
LGs are overloaded. For example, you see on a certain Softwares TestDrive, Perfecto Mobile, etc. WebLOAD
LG machine the response time goes up while increasing activates these tools, runs the browser activity, and
the load. Does it mean that your server reached its max collects performance statistics from the browser or
capacity? Not necessarily. Your LG may be overloaded the mobile device. This is also a great way to make
(bandwidth/memory/CPU). So, take a look at the probing sure that your functional tests pass/fail under load. To
client. If its response time increasing as well, it means that learn about each of the integrations, read WebLOAD
your server is choking. If not - your LG. documentation.

26
 Executing an Agenda Using the WebLOAD Console

Cloud Load Generators

You can Install WebLOAD LG machines on The following window opens, letting you define the Amazon
premise and on any cloud vendor, and mix machines to be used.
between machines in a single test.

WebLOAD also lets you run performance test via

special integration with Amazon EC2. WebLOAD
provides a preconfigured public Amazon Machine
Image (AMI), which lets you quickly generate
load with minimal setup using your own Amazon
account. You add those cloud LGs during the
template creation - just by adding LGs from cloud.
WebLOAD automatically creates and terminates
the cloud machines for your test. Your costs are
based solely on your cloud machines activities
during the test.

To set this up access:

WebLOAD Tools Cloud

Console Options

27
 Executing an Agenda Using the WebLOAD Console

Performance Measurements Manager

On the WebLOAD Console home tab you can see the Performance Measurements Manager (PMM). Using the PMM,
WebLOAD collects server-side performance data from operating systems, web servers, application servers, database servers,
etc. This makes it possible to see client side statistics (transaction time, for example) on the same graph with server metrics
and identify the root-cause of problems.
WebLOAD PMM enables direct correlation of your load scenario with data such as CPU, memory, capacity, processes, etc.
You can quickly track down bottlenecks and pinpoint the weak links in your system.

Server side measurements are collected by WebLOAD

Console during the test, and later are displayed as
part of WebLOADs results analytics reports. For more
information on the technologies WebLOAD supports,
see http://www.radview.com/technologies-supported.

TIP Do not forget to collect your server

measurements during your test as it helps triage
problems faster. Otherwise, you may need to run tests
again just because you didnt configure the PMM or
didnt collect the right information.

28
 Executing an Agenda Using the WebLOAD Console

APM Tools Integration

WebLOAD Integrates with APM (Application Performance Management) tools such as
AppDynamics, Dynatrace, and NewRelic. These tools provide deeper insight into the tested
application letting you drill down to the specific line of code associated with a performance
issue. To learn more see the WebLOAD documentation.

Test Automation and Continuous Integration

WebLOADs Jenkins integration enables running any performance test scenario via a regular
Build Step in Jenkins.

You can define success/failures criteria based on many factors such as failure of the entire
session, errors and warning, validations, performance measurements, etc. This provides the
flexibility to adjust and determine how changes in performance will affect the next step in your
continuous delivery pipeline.

Automated mails provide a daily summary of build performance status, comparing results to
the previous automated builds and to a predefined baseline.

29
 Load Test Results Analysis
Explaining all the nuances involved in analyzing performance test results requires a dedicated book.
The following, therefore, only highlights some of the key issues. For a more in-depth discussion,
view our webinar How to Interpret Load Test Results.

Terminology and Meanings

The diagram below illustrates the events taking place The following diagram displays the above and suggests
during each http request: reasons for an issue in each step.

DNS lookup, which is translated to an address via

the DNS.

A connection phase between the client and the

server.

The client sends its request to the server.

Time to first byte - represents the server

processing time and the network time. It means the
server worked when it received the entire request,
and finished when it started sending the response.
This theory is true for synchronous requests.

The complete response is sent back to the client

and represents the network time.

30
 Load Test Results Analysis

Timers - Response Time, Hit Time, Transactions Time

The timers are in general the first indication Do you expect hit time to change when
about your system. Of course, you should the load size is constant?
look for thresholds violations, but you may
find interesting behavior even before you
reached the violation.

Does it make sense that the time to first byte suddenly

improved significantly while the load size increased?

We can add more examples,

but you can use these
examples as a basic results
analysis that shows where
you should start looking.

31
 Load Test Results Analysis

Throughput
Throughput is also a measurement that tells a lot about your servers behavior. For example, when throughput drops
suddenly, or when it is steady where it should grow. Take a look at the following example how throughput is affecting
response time. The system behaves perfectly at the beginning. The load size grows while the response time stays at the
same level. But then, the throughput hit a limit. Once it reaches that limit, the response time grows. The reason, in this
case was a network configuration issue that limited the capacity.

Another way to look at throughput is

your response size expectations. For each
request there is an expected response. This
is important to make sure that during the
load test you get the expected response.
Otherwise your results may mislead you.
For example, suppose you expect 1 GB
as a response. You should check that you
are getting the expected size. If you are
getting 1MB it means that there is an issue.
The Response Validation helps you easily
measure the response size.

32
 Load Test Results Analysis

Errors of Many Kinds Server Measurements

We mentioned earlier in this document that you should As mentioned earlier, WebLOAD helps you collects server
validate the responses from the servers. This is a good measurements via its PMM and via integration with APM
habit, to check several types of errors that may occur tools. These measurements with correlation with the client
during the test. For example: measurement, gives you the ability to find root cause
easily. Take a look at the following example that shows
Server errors how memory behaves during constant load size.
Http errors
Validation errors - Just wrong values, or even corrupted
data
Do not forget to look at your log files. Are errors logged
there?

To summarize, as mentioned in the

beginning of this section, there are lot of
interesting measurements and behaviors
that you should look for. We tried to
shed light on some important ones that
will help you in your triage process.
33
 Analyze Your Test Results
with WebLOAD Analytics
WebLOAD Analytics lets you perform deep analysis of test results once it complete running.
WebLOAD Analytics provides many ready-made reports that contain many charts that can be used
immediately, but you can also create your own charts and reports to suit your specific needs.

On the top left panel, you can see the currently viewed report name and its charts - in this example,
Summary Report. You can select any chart to be viewed either from the top left panel, or by selecting
a tab on top of the Chart View.
You can select any report from the left-bottom Gallery panel. The Gallery panel is built from
Templates and Portfolios. A Template is a Chart definition, while a Portfolio, which is a collection of
Templates, is a Report definition. Note, that WebLOAD Analytics lets you see a full report with all its
charts, or one chart only. Just double click on a Template or Portfolio in the Gallery Panel.
34
 Analyze Your Test Results with WebLOAD Analytics

Building Templates and Portfolios

Use the Blank Template to build a new one. Double click and edit it via the settings tab
which is left of the chart view tab. Via the settings you can add measurements, zoom, change
axis, etc. While you edit the Template, you create a Chart on the fly. The new Chart is added by
default to the currently viewed report.
To save the Chart
Save Chart
for future use select File
as Template

You can also edit one of the predefined Charts, and save Save Chart
the new edited Chart as a new Template in the same way File
as Template

To create new Portfolio or update a Portfolio, right click in the Gallery tree or drag and drop a
Template into a Portfolio.
TIP Note that all the changes you make are done on the currently viewed report, and do not
affect any template or portfolio, unless you save your changes.

Publish Charts and Reports

Using WebLOAD Analytics you can create Reports to be sent to peers. Click on Preview button,
and then you can print it or save in several formats, such as doc, pdf, html, etc.

If you want to publish a full Report (and not a Chart only), use the Publish Report option
from the File menu.

35
 WebLOAD Dashboard
The WebLOAD Dashboard allows presenting and analyzing load tests results from any browser
or a mobile device. It is also a convenient tool for sharing information, working with colleagues
in parallel on the same tests results while each user sees different angles of the same test.

You can configure many Dashboards, each presenting different data. In the example above we
configured a dashboard named default. You can adjust the Dashboard you configure to your needs.
A dashboard is built with rows and panels. In the above example there are 3 rows. In the first row you
can see 3 panels.
A panel can be of several types: Graph, SingleStat, Text, Log. In the above example you can see four
graphs, one SingleStat, and one Log.

36
 WebLOAD Dashboard

Creating and Editing Dashboards

To edit a Dashboard, click its title.

You can add a new Panel to a row, by selecting To add a new row, select Use the icons on the top right
the green marker on left of each row. the add a row button at to open a different Dashboard,
the bottom right of each create a new Dashboard, etc.
Dashboard.

37
 WebLOAD Dashboard

Viewing Currently Running and Past Sessions

You can view any session - whether it is currently running or not. Select sessions to view
using the + sign or the search icon. You can see one session or more than one in parallel
in order to make an easy comparison.

Besides uploading past session, you can view a currently running session. WebLOAD
Console needs to be configured to send statistics information to the PostgreSQL DB during
runtime. See the deployment session to learn how to configure this.

Share Dashboards
When you build an interesting Dashboard with interesting data, you can share it with your
manager or peers by sending a link.

Playlist (Slideshow)
If you want to have live presentation screened, you can create a list of favorite Dashboards,
via the Mark as favorite in the save menu. Starting the playlist can be reached when
clicking the folder icon.

38
We hope this document will help you to get
started with WebLOAD. If you have any questions
about WebLOAD, we would love to hear from you.
Have you and your team come up with your own
WebLOAD best practices?
Share them with us!

The WebLOAD Team

North American Headquarters

991 Highway 22 West, Suite 200
Bridgewater, NJ 08807
www.radview.com 908-526-7756
Email: [email protected]