IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Overview on Cloud Computing and Performance Testing

By Harish Negi

Copyright IBM Corporation 2011

Unlock the power of Sharing

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Agenda
What is The Cloud? What is Cloud Computing? Benefits of Cloud Computing Risk/Concerns of Cloud Computing What things are the same about testing cloud solutions?

What is different about testing cloud solutions?

Testing Phases Key Characteristics of the Cloud Performance/Load Testing Performance Testing in the Cloud Performance Testing Scenarios Testing on-premises applications from the cloud Testing Cloud Application and Services Testing Cloud and on-premises Applications

Cloud Performance Testing Challenges

Cloud Performance Testing Solutions
2

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

What is The Cloud?

Internet (The Cloud) accessible solution Off-premise multi-tenant architecture Accessed via a browser (PC or Wireless) Delivered as Software as a Service (SaaS) ,

Platform as a Service (Paas)

Infrastructure as a Service (Iaas) Common cloud companies are: Google, Amazon, Microsoft, IBM, HP and Salesforce

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

What is Cloud Computing?

Forrester defines cloud computing as: A pool of abstracted, highly scalable, and managed compute infrastructure capable of hosting end-customer applications and billed by consumption.

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Benefits of Cloud Computing

Scalability The distributed nature of Cloud solutions allow utilization to be spread

evenly amongst available servers meaning applications can scale on demand.

Location independent access Using thin clients or virtualization. The only limitation being internet access.

Reduced cost of ownership Using service providers with currently existing Cloud
deployments means the need to own hardware to support the Cloud solution can be almost entirely removed. Server efficiency/utilization The spread of server workload improves server efficiency and increases utilization of otherwise lesser used servers producing greater return on investment.

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Continue...
Green IT The reduced requirement for hardware, implementations and location dependence means business can reduce the environmental impacts of its IT infrastructure. Instantly deployable environments Environments can be built and deployed for specific needs such as test or deployment. The use of virtualization using the Cloud means that these environments can be scalable to production size and deployed within far reduced timescales. Reduced maintenance cost The centralization of all IT components means that maintenance can be carried out centrally on a one time only basis. The maintenance is then mirrored in all end user instances of that Cloud solution.

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Risk/Concerns of Cloud Computing

Lack of control When IT infrastructure is outsourced to an external third party how does the business maintain control of their data, impact down time, drive technology change or influence decisions which may impact their solution? Security How can business ensure the potentially sensitive information which traverses the cloud is safe and secure? Privacy concerns What can business do to maintain the privacy of their users and information when using the cloud?

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Continue
Data Integrity When using third party solutions for Cloud Computing what assurances do businesses have their valuable data remains intact? Availability Cloud Computing solutions rely on the availability of their infrastructure to be able to function. Should a business critical Cloud Solution be unavailable for any time, what is the business impact? Business Acceptability How sure can a business be that their third party solution is suitable for its intended use?

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

What things are the same about testing cloud solutions?

Requirements coverage based testing Risk-based structured test approach Test Plan / Test Phases Test Cases / Test Data / Test Automation Defect Management / Functional Test

Use of off-shore resources / Virtualization

Politics {Quality / Schedule / Resources}

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

What is different about testing cloud solutions?

Shared multi-tenant test environments Security (Test User IDs / SSO) Integration of on/off premise systems Performance / volume test Defect isolation Documentation of Out Of the Box reqs Release Management

10

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Performance/Load Testing

Traditionally, to support such a test, you would need the following components in place: A good load-testing software Sufficient load-testing hardware for your load-testing environment Target testing hardware similar to your production hardware for your target-test environment with your software installed Sufficient bandwidth for realistic simulation Skilled professionals to run, monitor and analyze the results of the tests Other equipment to simulate realistic environment
11

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Key Characteristics of the Cloud

Elasticity

Accessibility

Efficiency

Global Delivery
Immediacy

12

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Performance Testing in the Cloud

Test planning

Test development and construction

Test execution

Test result analysis and reporting

13

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Performance Testing Scenarios

Testing on-premises Applications from the Cloud

Testing Cloud Application and Services

Testing Cloud and on-premises Applications

14

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Testing on-premises applications from the cloud

15

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Testing Cloud Application and Services

16

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Testing Cloud and on-premises Applications

17

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Cloud Performance Testing Challenges

Firewall exceptions and remote configuration

Storage and bandwidth costs

Cross cloud alignment bottlenecks

Failover Testing

Elasticity and scalability

Application Tuning

18

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Cloud PerformanceTesting Solutions

HP (Loadrunner)

IBM (Rational Performance Tester)

Micro Focus (SilkPerformer CloudBurst)

SOASTA (CloudTest)

19

Learn. Reuse. Excel

Copyright IBM Corporation 2011

IBM TESTING SERVICES - GLOBAL DELIVERY INDIA

Thank You

20

Learn. Reuse. Excel

Copyright IBM Corporation 2011