Customer Test Plan For Cisco WAAS 5.0 Encrypted MAPI
Customer Test Plan For Cisco WAAS 5.0 Encrypted MAPI
Customer Test Plan For Cisco WAAS 5.0 Encrypted MAPI
Systems Engineer: _ _
Phone: _ _
Product Specialist: _ _
Phone: _ _
EDCS-905049
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Table of Contents
OVERVIEW AND PREREQUISITE INFORMATION......................................................................................................3
SCOPE............................................................................................................................................................ 4
RECOMMENDED TEST PROCEDURE.................................................................................................................. 4
SIMULATING WAN ENVIRONMENTS.................................................................................................................. 5
SIMULATING A DATACENTER SERVER...............................................................................................................5
SIMULATING A BRANCH PC............................................................................................................................. 6
TYPICAL NETWORK TOPOLOGY........................................................................................................................ 6
SETTING UP THE WAE.................................................................................................................................... 7
TEST METHODOLOGY...................................................................................................................................... 7
GENERATING APPLICATION LOADS................................................................................................................... 8
MEASURING PERFORMANCE............................................................................................................................. 9
WAAS Central Manager Reporting....................................................................................................................... 10
TRAFFIC ANALYSIS:....................................................................................................................................... 10
OPTIMIZATION CHARTS:................................................................................................................................. 11
SUMMARY REPORT:...................................................................................................................................... 13
PER-CONNECTION STATISTICS:....................................................................................................................... 13
ACCELERATION STATISTICS (REPORT CENTRAL):............................................................................................15
MEASURING THE BASELINE PERFORMANCE FOR ALL THE TESTS......................................................................16
ENABLING AND DISABLING GLOBAL OPTIMIZATION FEATURES...........................................................................17
SUCCESS CRITERIA AND OBJECTIVES OF THIS TEST.........................................................................................18
TEST SUITE: MICROSOFT EXCHANGE/OUTLOOK (MAPI).....................................................................................19
Preparing for MAPI testing................................................................................................................................... 19
PROCEDURE:................................................................................................................................................ 19
Performance Testing: Email Attachments............................................................................................................21
Expected Results.................................................................................................................................................. 21
Performance Testing: Simulated Workloads with Exchange LoadGen 2010.......................................................24
Expected Results.................................................................................................................................................. 24
APPENDIX A................................................................................................................................................................. 25
Granting WAAS permission to accelerate Encrypted MAPI.................................................................................25
APPENDIX B................................................................................................................................................................. 29
Printable Results Tables for All Manual Tests......................................................................................................29
TEST: MICROSOFT EXCHANGE/OUTLOOK (MAPI)...........................................................................................29
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 2 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
The purpose of this document is to offer a complete test plan for customers evaluating Cisco Wide Area Application
Services (WAAS). The document includes key test areas and a recommended test environment.
Cisco WAAS provides application acceleration and WAN optimization capabilities to enable organizations with
multiple branch offices the ability to centralize their storage, server, and data protection infrastructure while providing
LAN-like performance for remote users that access information over the WAN. Cisco WAAS provides generic
optimizations for TCP based applications, compression, and data suppression capabilities that result in more efficient
bandwidth usage and faster response times for client applications. Additionally, Cisco WAAS provides application-
specific acceleration capabilities that work in conjunction with the other optimizers to improve the application behavior
in WAN environments.
Cisco WAAS provides the following capabilities to improve application performance over the WAN:
1. Transport optimization - Cisco WAAS uses a variety of Transport Flow Optimization (TFO) features to
optimize TCP traffic intercepted by the WAAS devices
2. Compression – Cisco WAAS use Data Redundancy Elimination and persistent Lempel-Ziv (LZ)
compression to minimize the amount of bandwidth consumed by data transmitted over your WAN.
The result of all of the above improves the user experience and enables consolidation of costly distributed
infrastructures. Cisco WAAS is deployed on the Cisco Wide Area Application Engine (WAE/WAVE) family of
appliances. The general deployment configuration is described in Figure 1 below. A WAAS deployment typically
involves the following elements:
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 3 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Scope
The scope of this test plan is to prove Cisco WAAS features and functionality within a controlled environment. This
test plan is not meant to be a detailed engineering validation test, rather a proof-of-concept test showing the reality of
the benefits the Cisco Wide Area Application Services provides. As such, this document provides various testing
scenarios which will prove the functionality of Cisco WAAS.
3. Application traffic generating tools (e.g.- Microsoft Load Simulator, WAFS Benchmark, etc.)
4. Datacenter servers such as FTP, HTTP, HTTPS, Exchange Server, NFS server and file server. For testing
file service, domain controller is also required. Microsoft clients/servers should be registered member of the
Active Directory domain.
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 4 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Following are the available WAN simulator which can be downloaded either from CCO or their respective sites. It is
recommended to use WAN-Bridge as a WAN simulator.
WAN-Bridge is a WAN emulation tool based on netem. Cisco's WAN-Bridge also offers a web based monitoring tool (NTOP) from
which users can view network usage statistics. This tool is configured as bridged links.
WAN-Bridge
WAN-Bridge bootable ISO CD can be download on CCO (CCO Login Required).
NISTnet is used to add latency, bandwidth limitations, packet loss or duplication, and other WAN characteristics on all IP traffic
NISTnet
moving between the Ethernet ports of the system.
Network
Network Nightmare is based on open-source Dummynet technology that is available as part of FreeBSD.
Nightmare
Shunra There is a paid, commercial WAN simulator from Shunra.
Typical provisioning of the servers will be explained in the respective test case section.
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 5 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Simulating a Branch PC
To test various protocols and application you need to have one or two branch PC. These client PC should be
configured in a way similar to production environment. A typical list of application/OS to be installed in these PC
should be:
Typical provisioning of these clients will be explained in the respective test case section
The topology of a simple test network with in-path deployment is shown in figure below:
ClientWorkst
ation
WAN
Branch Datacenter Server
WAAS Emulated WAN WAAS
WAAS Central
Manager
For off-path, Cisco WAAS supports transparent interception and redirection using WCCP, PBR or the Cisco
Application Control Engine (ACE) load balancer appliance or Catalyst 6500 series module. This mode requires
network configurations to be modified on intercepting switch or router. It may require a different software release on
the router/switch if WCCP is used.
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 6 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Cisco WAAS Installation and Configuration Guide for Windows on a Virtual Blade
Test Methodology
To get a clear view and understanding of the results before and after WAAS perform each of below test scenarios
within each test case.
1. Baseline Test: Baseline tests will show the native performance between the client and server over the
WAN. It is recommended that you perform baseline testing first for all the test cases without plugging Cisco
WAAS into the network. This baseline testing can also be performed by putting Cisco WAAS into pass-
through mode. This can be achieved by configuring inline interfaces into bypass mode, or disabling
interception (WCCP, PBR, ACE).
2. Cold Test: Cold tests will show the performance of TFO, persistent LZ, ‘cold’ DRE cache and
corresponding Application Optimizer for that protocol, if available. This will also add signature and chunk
data to the DRE cache. This first transfer will show some performance improvement and a reduction in
bandwidth utilization. Application Optimizer provides latency mitigation and overall response time
improvements in this first transfer.
3. Hot Test: Hot tests will show full WAAS performance of TFO, persistent LZ, hot DRE cache and
corresponding Application Optimizer for that protocol, if available. This is done by performing the same
operation twice (i.e. NFS copy of the same file).This second transfer will show dramatic improvement in
performance as it can make use of a ‘hot’ DRE cache. Application Optimizer continues to provide latency
mitigation and overall response time improvements in this test also.
4. Warm test: Warm tests will show nearly full WAAS performance of TFO, persistent LZ with a nearly hot
DRE cache and corresponding Application Optimizer for that protocol, if available. This is done by
performing same operation again but with a very similar copy of a modified file.
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 7 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Microsoft Outlook: The default email program included in Microsoft Office is a great tool to generate
manual application loads. This program works very well to simulate send/receive improvements for file and
other types of attachments.
Measuring performance
Performance can be monitored by Cisco WAE locally, the Cisco WAAS Central Manager, 3rd party monitoring tool
(like NetQoS, OpNet, NTop, etc). For timing operations, it is recommended that you use an application (e.g.- timethis
(Microsoft Resource Kit), time (Unix)) to measure accurate time to complete that operation. Alternatively, tools like
DU meter (http://www.dumeter.com) can be used to perform timing operations and gather throughput measurements.
1. Programatic Measurement: Programatic measurements are the best way to measure performance
improvement for timing operation. Perform an operation with and without Cisco WAAS and measure the time
required for that operation (download file through HTTP/FTP etc.) using an application that measures the
request time (e.g.- timethis or even a network analyzer like WireShark).
2. Measuring WAN utilization: While programatic measurements will provide you measurements to quantify
improvements in response time, it is also important to measure bandwidth savings or WAN utilization. Some
WAN simulators (e.g WAN-Bridge) do provide capabilities of measuring WAN utilization through a Web UI.
WAN Bridge can use NTop- a NetFlow Collector that shows the network usage, similar to what the popular
“top” Unix command does.
3. PRTG Traffic Grapher or other SNMP tool: If you are doing this test under lab environment, PRTG Traffic
Grapher (http://www.paessler.com/prtg6) can be used to get usage information on WAN/LAN interface of
Branch and DC router. PRTG Traffic Grapher is easy to use Windows software for monitoring and
classifying bandwidth usage. It provides system administrators with live readings and long-term usage
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 8 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
trends for their network devices. You need to enable SNMP monitoring on router WAN and LAN interface
and this monitoring tool provide real time 1 minute (configurable) interval snapshot of bandwidth usage. A
typical snapshot is shown below:
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 9 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Traffic Analysis:
3. Throughput Charts
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 10 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Optimization Charts:
This section describes these charts:
1. Compression Summary
You can choose which applications to include; the default is all traffic.
The traffic units (bytes, KB, MB, or GB) at the left side depend upon the range.
This chart should be compared with the “Original Traffic over Time” chart, to demonstrate the data
reduction effect of WAAS.
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 11 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
The traffic units (bytes, KB, MB, or GB) at the left side
depend upon the range.
Formula
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 12 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Summary Report:
The Summary Report window is a monitoring chart available in the “Monitoring” drawer on the initial login screen for
the Central Manager. This chart is a simplified, central view of several traffic and optimization charts commonly used
in day-to-day operations of a WAAS network
Per-connection statistics:
The “Connection Statistics” report, available in the “Monitor” navigation drawer, can show near-real-time view of
optimized connections and details of each connection.
Click the Details icon next to the connection entry in the summary table to view connection details.
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 13 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
The Connection Details window appears. This window contains connection addresses, port information, policy
information, and traffic statistics. The Connection Details window also displays a graph that plots real-time traffic
statistics.
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 14 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Acceleration statistics charts shows acceleration specific information for each of the application accelerators that are
provided by Cisco WAAS (CIFS, MAPI, NFS, HTTP, Video, and SSL).
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 15 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Baseline (unaccelerated) performance can be obtained by either running all the tests described in this document
before deploying Cisco WAAS. If Cisco WAAS is already configured, these tests can be run by putting Cisco WAAS
into pass-through mode. Following are the methods through which Cisco WAAS can be put in pass-through mode.
1. Inline interception: if inline interception has been used InlineGroup can be put in pass-through mode by
disabling the InlineGroup interface. See the example below to shutdown active inline group interface. Please
repeat the step in all the WAE in Branch and Datacenter to run Native WAN performance test.
2. WCCP Interception: In case of WCCP interception, WCCP can be disabled on the WAE to make all traffic
traverse the WAN natively without redirecting to WAE.
DC-WAE#
Baseline mode can be also measured by powering off WAE in both inline and WCCP mode.
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 16 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
The global optimization features determine if TFO optimization, Data Redundancy Elimination (DRE), and Persistent
Compression are enabled on a device or device group. By default, all of these features are enabled and there is no
need to enable or disable these features.
In addition, the global optimization includes each of the following application accelerators: EPM, CIFS, HTTP MAPI,
NFS, SSL and video. By default, all of the application accelerators are enabled. The application accelerators also
require specific licenses to operate. These licenses must be enabled for corresponding optimization to Turn On. For
information on installing licenses, see the Cisco WAAS Quick Configuration Guide.
These accelerators are enabled on both of the peer WAEs at either end of a WAN link for most application
accelerators to operate. The video accelerator is the exception and needs to be enabled only on the Edge WAE,
though it can be enabled on both the Core and Edge WAEs.
1. From the WAAS Central Manager GUI navigation pane, choose Home > Manage > Devices (or Device
Groups).
2. Click the Edit icon next to the device or device group for which you want to change the global optimization
features.
3. From the navigation pane, choose Configure > Acceleration > Enabled Features. From here, you can
enable or disable each specific WAAS feature as desired.
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 17 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 18 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
2. Create 2 test users with mailboxes in Exchange Server- waas1 and waas2
3. Ensure that the WAAS devices can resolve DNS from Active Directory. The simplest method to ensure this
is to set the ‘ip name-server’ value on WAAS to the Active Directory Domain Controller IP Address.
4. Ensure that the time on the WAAS devices is within 5 minutes of the Active Directory time (taking Time Zone
+/- UTC into account). The simplest method to ensure this is to set the ‘ip ntp server’ value on WAAS to the
Active Directory Domain Controller IP Address.
5. To optimize Encrypted RPC (MAPI) traffic, WAAS must be explicitly granted permission to do this by an
Active Directory Administrator. This permission is granted to either a User or Machine account. For more
information, please see Appendix A – Granting WAAS Permission to accelerate Encrypted MAPI. A
User account is recommended for ease of testing, and the Administrator account on an Active Directory
domain always has the appropriate permission.
6. Make sure EPM Accelerator, MAPI Accelerator, SSL Accelerator, and WAN Secure are enabled on both
Core and edge WAE as explained below. These two are enabled by default after adding Enterprise license
into WAE.
2. Make sure, global optimization for Cisco WAAS (as explained earlier) is enabled.
3. To ensure a fresh cache, Log in to the Branch & Datacenter WAAS device and clear the DRE cache
Before doing any test, please make sure global optimization, MAPI, EPM, SSL and WAN Secure
Accelerators are enabled. If not, enable as follows:
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 19 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
From the Central Manager GUI, und Home -> Manage -> Device Group -> AllWAASGroup, then
Configure -> Enabled Features. Check all required accelerators and Submit
6. On the DataCenter WAAS Device, configure the identity that has been granted permission to accelerate
Encrypted MAPI in Active Directory:
<ID_TAG>: Identifier to reference the
identity. Match with next command
below.
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 20 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
1. Open Outlook Exchange client in one of the branch PC and login as user waas1. Send an email with
attachment to the test user waas2. Please use attachment of bigger size (4-5MB), you can use Excel
spreadsheets, PowerPoint slides, AutoCAD drawings as attachment.
2. When you click “Send”, note down the time it will be in the queued
outgoing message “Outbox [1]” and the message “Sending message
1 of 1” to the message disappeared in
outbox. This is the time it took to
send the message.
3. Login to the outlook client of waas2 user. Check updating Inbox status
message on the outlook status bar and note down the time it take to
download the message and appear in inbox.
Repeat step 1 to 3 with attachment of different size and record the results.
Time to
Download
Bandwidth
Time to
Download
Bandwidth
Time to
Download
Bandwidth
Expected Results
When the user waas1 downloads the message, this is the first transfer and DRE cache is in cold state. There will be
some improvement in response time observed.
When the user waas2 downloads the attachment, Cisco WAAS already cached that message into DRE cache, this
will be HOT test and it delivers LAN-like performance. There will be very less bandwidth utilized while downloading
the message by waas2.
My WAN ->Manage Devices ->Branch WAE->Monitoring -> Acceleration ->MAPI Acceleration Report
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 21 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
If you want detail information about any MAPI connection, please issue CLI
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 22 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 23 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Appendix A
Granting WAAS permission to accelerate Encrypted MAPI
To grant Cisco WAAS permission to accelerate Exchange encrypted email sessions, do the following:
Note: This group is for accounts that WAAS will use to optimize Exchange traffic. Normal users and computers
should not be added to this group.
Step 1. Using an account with “Domain Administrator” privileges, launch the Active Directory Users and
Computers application.
Step 2. A new group is needed. Right-click the Organizational Unit (OU) where you wish to place this group, and
choose New > Group.
Step 3. Name the new group, and ensure the group is a Global, Security Group.
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 24 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Step 4. After the group is created, return to the Active Directory Users and Computers window. Select View >
Advanced Features. This step allows configuration of the permissions required by WAAS.
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 25 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Step 6. Click the Security tab, and then press the Add button under Group or User Names.
Step 7. Enter the name of the group that was entered in Step 3, and press OK.
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 26 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Step 8. The group entered in Step 3 should now show in the Group or User Names list. Click on the group to select
it. Then, scroll down in the Permissions for *Group Name* pane, until the permissions Replicating
Directory Changes and Replicating Directory Changes All are visible. Check Allow to allow both of
these permissions, and press OK.
Step 9. User or Workstation (Computer) accounts now need to be added to this group for WAAS to use to optimize
Exchange encrypted email. To add an account, right click on the account you wish to add, and select the
Member Of tab. Click the add button, and pick the group used above in Step 3. Press OK.
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 27 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Appendix B
Printable Results Tables for All Manual Tests
Time to
Download
Bandwidth
Time to
Download
Bandwidth
Time to
Download
Bandwidth
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 28 of 29
PRE-RELEASE DRAFT DOCUMENT WAN Optimization Test Plan
Version Information
Printed in USA
© 2012 Cisco and/or its affiliates. All rights reserved. This document is Cisco Public Information. Page 29 of 29