Performance Test Report

For
Website http://www.lowcostloadtest.com

Contact Points:
Mark Ferguson @ [email protected] in UK and Europe
Pulakesh Barma @ [email protected] from all other countries

Chakkilam Infotech Ltd

Suite#106,107, MGR Estates
Dwarakapuri Colony, Punjagutta
Hyderabad -500082
www.chakkilaminc.com

Table of Contents

1.

PERFORMANCE TEST CONTEXT ............................................................................................... 3

2.

DESCRIPTION OF THE APPLICATION ...................................................................................... 3

2.1
2.2

3.

TECHNOLOGIES ............................................................................................................................ 3
FUNCTIONALITIES ........................................................................................................................ 3

PERFORMANCE TEST GOALS AND REQUIREMENTS.......................................................... 4

3.1
BUSINESS TRANSACTIONS ............................................................................................................ 4
3.2
TRANSACTION STEPS (T IMING POINTS)........................................................................................ 4
3.2.1
About XampPerf ..................................................................................................................... 4
3.2.2
List All Members..................................................................................................................... 5
3.2.3
Search by Email...................................................................................................................... 5
3.2.4
List Limited Members ............................................................................................................. 5
3.2.5
Registration ............................................................................................................................ 6
3.3
PERFORMANCE REQUIREMENTS ................................................................................................... 6
3.3.1
PerfReq001 - Response Time Requirement............................................................................. 6
3.3.2
PerfReq002 - Processor Time Requirement ........................................................................... 6
3.3.3
PerfReq003 - Failed Transactions Requirement .................................................................... 6

4.

PERFORMANCE TEST PROCESS................................................................................................. 7

5.

PERFORMANCE TEST RESULTS................................................................................................. 8

5.1
SUMMARY .................................................................................................................................... 8
5.1.1. Overall Transactional Summary ................................................................................................. 8
5.1.2. Transactional Steps and Http Requests Transactions Summary................................................. 9
5.1.3. Performance Result Graphs.......................................................................................................11

6.

CONCLUSION ..................................................................................................................................11

Performance Test Report

Page 2 of 11

1. Performance Test Context

A performance Test was conducted for a website with few (~6) dynamic as well as static
pages. The basic functionality of the website is to create logins database.
This is a test website created by Chakkilam team for demonstration purposes only. It is
not intended to use it in any production.

2. Description of the application

It is a simple web application which allows any user to register them on line and later use
functionalities like search an user by email, list all users in the database or list limited
users in the database.

2.1

Technologies

The application is built on XAMP technology.

2.2

Functionalities

Following is the depiction of web application functionalities and its usages in pictorial
representation. For independent transactions and the steps, refer sections 3.1 and 3.2.

Performance Test Report

Page 3 of 11

3. Performance Test Goals and Requirements

The goal of the performance testing is to verify whether the website is meeting the
minimum performance requirements or not. The performance requirements are listed
below:
The performance testing for the website http://www.lowcostloadtest.com is planned to
verify the response times and throughput of the transactions with maximum load of 160
number of concurrent users.
The business transactions and its associated steps with expected response time
requirements are listed below.

3.1

Business Transactions

S. No.

3.2

Transaction Name

Description

About XampPerf

Navigate to Index.html Clicks on About XampPerf

List All Members

Navigate to Index Page Login List all members

Logout

Search by Email

Navigate to Index Page Login Search by Email

Logout

List Limited Members Navigate to Index Page Login List limited Members
Logout

Registration

Navigate to Index Page Register

Transaction Steps (Timing Points)

Maximum Simultaneous Users: 160

3.2.1 About XampPerf

Step Name

Description

Response Time
Requirement

Load Index Page

Navigate to
Index.html

< 2 seconds

Load About Page

Navigate to
Index.html and click
on Click Here

< 2 seconds

Performance Test Report

Page 4 of 11

3.2.2 List All Members

Step Name

Description

Response Time Requirement

Load Index Page

Navigate to Index.html

< 2 seconds

Load Login Page

Navigate to Index.html and click on Login

< 2 seconds

Submit Login
Detail

Provide valid users name and password and

click on 'Submit' button, which will load
'Search' page.

< 4 seconds

List All Members

Click on 'Search by Total Members'

< 5 seconds

Logout

Click on 'Logout'

< 2 seconds

3.2.3 Search by Email

Step Name

Description

Response Time
Requirement

Load Index Page

Navigate to Index.html

< 2 seconds

Load Login Page

Navigate to Index.html and click on Login

< 2 seconds

Submit Login Detail

Provide valid users name and password and click < 4 seconds
on 'Submit' button, which will load 'Search' page.

Enter Email

Provide Valid Email and click on 'Search by

Email'

< 5 seconds

Logout

Click on 'Logout'

< 2 seconds

3.2.4 List Limited Members

Step Name

Description

Response Time
Requirement

Load Index Page

Navigate to Index.html

< 2 seconds

Load Login Page

Navigate to Index.html and click on Login

< 2 seconds

Submit Login Detail

Provide valid users name and password and click

on 'Submit' button, which will load 'Search' page.

< 4 seconds

Provide Numbers

Enter required records number and Submit

< 4 seconds

List Limited Members Click on 'Search by Limited Members'

< 5 seconds

Logout

< 2 seconds

Click on 'Logout'

Performance Test Report

Page 5 of 11

3.2.5 Registration
Step Name

Description

Response Time Requirement

Load Index Page

Navigate to Index.html

< 2 seconds

Load Registration Page Navigate to Index.html and click on

Registration

< 2 seconds

Submit Registration
Detail

< 4 seconds

3.3

Provide valid registration details and

click on 'Submit' button.

Performance Requirements

3.3.1 PerfReq001 - Response Time Requirement

90% of response time of all web actions (transaction steps) must be less than 2 sec / 5 sec
when load is ramped up to 160 concurrent users. Please find response time requirement
of each transaction steps in section 3.2. (Transactions Steps Timing Points)
3.3.2 PerfReq002 - Processor Time Requirement
% Processor Time of web server, application server and database server must not be
more than 75% for > 10 minutes at any point during the performance run.
3.3.3 PerfReq003 - Failed Transactions Requirement
The percentage of failed transactions must not be more than 5% when the load is ramped
up to 160 concurrent users.

Performance Test Report

Page 6 of 11

4. Performance Test Process

Chakkilam has conducted following Performance Tests to verify the performance Test
Goals:
1. Baseline Test
i. Number of concurrent users 1
ii. Duration of the test 30 minutes
2. Benchmark Test
i. Number of concurrent users 24 (15% of max concurrent users)
ii. Duration of the test 1 hour 45 minutes
3. Load Test
i. Number of concurrent users 160
ii. Duration of the test 11 hours
iii. Load ramp up The number of concurrent users were ramped up as depicted
in the figure below.

Performance Test Report

Page 7 of 11

5. Performance Test Results

5.1

Summary

Based on the preliminary analysis of the performance test, Chakkilam team made the
following observations:

The overall performance of the website doesnt conform to the performance

requirements.
-

10% transactions are under performing i.e. response time SLA (Performance
Requirement 01) is not achieved
50% transactions (all http requests e.g. images, css, php etc.)are failing
(Performance Requirement 03)

5.1.1. Overall Transactional Summary

Following is the summary report for business transactions involved in the performance
run.
S.No.

Business Transaction
Name

Total
Transactions

Passed
Transactions

Failed
Transactions

% Failed

1.
2.
3.
4.

About XampPerf
List All Members
Search By Email
List Limited
Members
Registration

474
442
432
449

474
442
432
449

0
0
0
0

0
0
0
0

456

456

5.

Performance Test Report

Page 8 of 11

5.1.2. Transactional Steps and Http Requests Transactions Summary

Following is the summary report of all individual steps of business transactions involved
in the performance run.
Response Time (in secs) - is the time spent actively by step to download objects, business
processing and page loading.
Transactions: is all HTTP requests (page, images etc.) associated with a step.
Transacti
on Name

SL
A
Sta
tus

Response Time (in secs)

P
F

P
F

Transactions

Resp
onse
Tine
SLA
(in
secs)

SLA: < 5% Failed

Transactions

Min
About
Index
Page
About
About
Page
List All
Members
Index
Page
List All
Members
Login
Page
List All
Members
Submit
Login
Detail
List All
Members
List
All
Members
List All
Members
Logout
Search By
Email
Index

Std.
Dev.

1.36

0.43
1.37

1.79

0.8

0.86

0.82
1.36

Avg
1.64

0.52
1.62

2.22

0.98

1.01

0.98
1.63

Performance Test Report

Max
4.56

2.66
4.63

4.34

4.66

1.75
4.57

90%
1.79

0.57
0.37

2.39

1.15

1.09

1.3
1.82

0.37

0.12
0.3

0.32

0.26

0.26

0.12
0.35

Passed

Failed

Http Status:
#

Http
Status: #

7110

472

{200: 7110}

{404: 47}
{-998: 1}

474

{200: 7110}

{404: 2}

6630

438

{200: 6630}

{404:
438}

1326

{200: 1326}

{404: 1}

884

199

{200: 442}
{302: 442}

{404:
199}

442

{200: 442}

884

{200: 884}

6735

442

{200: 6735}

{404:
442}

%
Failed
6.22

<2

0.84

<2

6.2

<2

0.08

<2

18.37

<4

<5

<2

6.16

<2

Page 9 of 11

Page
Search By
Email
Login
page
Search By
Email
Submit
Login
Detail
Search By
Email
Submit
Email
Search By
Email
Search By
Email
Search By
Email
Logout
List
Limited
Members
Index
Page
List
Limited
Members
Login
Page
List
Limited
Members
Submit
Login
Detail
Limit List
Submit
List
Limited
Members
List
Limited
Members
List
Limited
Members
List
Limited
Members
Logout
Registrati
on
Index

P
F

1.78

0.8

0.81

0.43

0.82
1.36

1.79

0.81

0.81

0.96

0.82

1.37

2.21

0.96

0.97

0.55

1.01
1.65

5.23

0.96

0.97

1.62

0.99

1.62

Performance Test Report

4.91

4.05

1.77

3.75

4.26
10.37

2.26

4.05

2.98

2.78

3.97

4.47

2.42

1.82

1.09

1.12

0.64
1.65

0.39

1.82

1.9

1.9

1.1

1.79

0.35

0.26

0.13

0.24

0.32
1.82

2.48

0.2

0.19

0.22

0.21

0.33

1347

{200: 1347}

{404: 2}

898

{200: 449}
{302: 449}

{404: 2}

449

449

{200: 449}

{404:
449}

449

{200: 449}

898

{200: 898}

6480

426

{200: 6480}

{404:
426}

1296

{200: 1296}

{404: 5}

864

228

{200: 432}
{302: 432}

{404:
228}

432

432

{200: 432}

{404:
432}

864

{200: 864}

864

{200: 864}

6840

452

{200: 6840}

{404:

0.15

<2

0.15

<4

50

<2

<5

<2

6.17

<2

0.38

<2

20.88

<4

50

<2

<5

<2

6.2

<2

Page 10 of 11

452}

Page
Registrati
on
Registrati
on Page
Register
Submit
Registrati
on Detail

0.94

0.8

1.1

0.94

1.89

1.85

1.21

1.08

0.11

0.13

912

{200: 912}

{404: 1}

912

115

{200: 456}
{302: 456}

{404: 4}

0.44

<2

11.2

<4

5.1.3. Performance Result Graphs

6. Conclusion
The performance test team has found issues related to performance of the website during
preliminary steps. The performance team will continue to do further analysis and will
submit a detail report within a week period of time.

Performance Test Report

Page 11 of 11