GEN4T Reference Guide
GEN4T Reference Guide
Dell believes the information in this publication is accurate as of its publication date. The information is subject to change
without notice.
Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be the property of
their respective owners. Published in the USA.
EMC Corporation
Hopkinton, Massachusetts 01748-9103
1-508-435-1000 In North America 1-866-464-7381
www.EMC.com
Chapter 1 Introduction 5
Important Avamar terms and concepts.........................................................6
Nodes.............................................................................................. 6
Utility node...................................................................................... 7
Storage nodes................................................................................. 7
Single-node servers......................................................................... 7
NDMP accelerator node.................................................................. 7
Node resource database (probe.xml)...............................................7
Avamar Downloader Service............................................................ 7
Local downloader service.................................................................7
Avamar FTP site.............................................................................. 8
Avamar Installation Manager........................................................... 8
Avamar login manager..................................................................... 8
Packages......................................................................................... 8
EMC repository............................................................................... 8
Local repository............................................................................... 8
Manifest file.................................................................................... 9
Segregated networks...................................................................... 9
Bonded network interfaces..............................................................9
High-availability network................................................................. 9
ConnectEMC................................................................................... 9
Email home.....................................................................................10
Data deduplication......................................................................... 10
Replication...................................................................................... 11
Avamar clients................................................................................ 11
Encryption......................................................................................12
Information for customers...........................................................................12
Fundamental Avamar principles...................................................... 13
Avamar 7.x installation features overview................................................... 13
How long will the Avamar software installation take?.....................13
Avamar Installation Manager.......................................................... 13
Process flow.................................................................................. 14
Log files......................................................................................... 15
In-flight encryption........................................................................ 15
Avamar Downloader Service...........................................................15
Chapter 3 Networking 25
Overview.................................................................................................... 26
Default port configuration.......................................................................... 26
Multi-node servers........................................................................ 26
Single-node servers....................................................................... 27
Basic networking configuration.................................................................. 28
Multi-node servers.........................................................................28
Supported network configurations............................................................. 29
Multi-node servers........................................................................ 29
Single-node servers....................................................................... 32
Advanced network configuration dpnnetutil utility.............................34
Features provided by dpnnetutil...............................................35
Replication................................................................................................. 36
Single-node servers....................................................................... 36
Multi-node servers.........................................................................38
The following topics introduce Avamar and the Avamar Data Store (ADS) Gen4T
family of hardware components:
Introduction 5
Introduction
Nodes
The primary building block in any Avamar system is a node. Each node is a self-
contained, rack-mountable, network-addressable server that runs Avamar software on
the Linux operating system. All Avamar nodes are Domain Name System (DNS)
clients.
Note
The term "server" in the previous definition is used in the typical industry context
(that is, a computer that provides services to other computers or devices). However,
for the remainder of this guide, unless otherwise specified, the term "server" is used
to refer to a single node or multi-node Avamar system. The term "node" is used to
refer to the individual computer/storage platforms that make up an Avamar server.
All nodes run the Linux operating system and use RAID data protection. Nodes have 2,
4, 6, 8, or 12 hard drives, depending on node type and storage capacity. The primary
differences between node types are:
l The amount of internal data storage (if any)
l How internal data storage is configured and allocated (that is, RAID level, number
of logical units [LUNs] and so forth)
Utility node
In scalable multi-node Avamar servers, a single utility node provides essential internal
services for the server (for example, administrator server, replication, external
authentication, network time protocol [NTP], and Web access). Because utility nodes
are dedicated to running these essential services, they cannot be used to store
backups.
Storage nodes
The remaining nodes in scalable multi-node Avamar servers are storage nodes, which
store the actual backups. There are three storage node models, the primary difference
being the amount of usable storage available: the M600, M1200, and M2400. They are
also offered as single node Avamar servers.
Single-node servers
Single node Avamar servers combine all the features and functions of utility and
storage nodes on a single node. There are four single-node server models: the M600,
M1200, M2400, and S2400. The S2400 (the Avamar Business Edition) is offered only
as a single-node server and features no requirement for replication.
Utility node 7
Introduction
Packages
Avamar software installation files, hotfix patches, and operating system (OS) patches
available from the EMC repository. Packages comprise three types:
l Client - A release of Avamar file system or application backup software.
l Server - A new release of Avamar server software, a service pack, or a patch for
the operating system, management console, or Avamar software.
l Workflow - A package that runs operations such as replacing a node or changing
the session security configuration.
Package files use the extension .avp.
EMC repository
A repository that contains server installation packages, client installation packages,
and manifest files. The EMC repository currently spans two locations: ftp://
ftp.avamar.com and EMC Subscribenet:
l High urgency packages such as hot fixes and OS patches are available from ftp://
ftp.avamar.com.
l Low urgency packages that have security and entitlement considerations are
available from EMC Subscribenet.
The actual source location of a package is transparent to the user.
The repository is located on the EMC network. Each EMC customer has its own
download center that contains files available to it. These files are maintained by the
EMC Subscribenet team. Outgoing communication from the Avamar Downloader
Service and LDLS to the EMC repository is encrypted with SSL over an HTTP
connection.
Local repository
The /data01/avamar/repo/packages directory on the utility node or single-node
server. The directory contains the most current manifest file from the EMC
Manifest file
An XML file listing all packages currently available for download from the EMC
repository. When the EMC Subscribenet team adds a package to the EMC repository,
it then adds an entry to the manifest file that describes the package. When the EMC
Subscribenet team removes the package from the repository, it then removes the
entry for the package from the manifest file.
The Avamar Downloader Service automatically downloads the manifest file from the
EMC repository once a day and determines if new download packages are available.
The Avamar Downloader Service sends the new manifest file to the local repository for
each Avamar system.
The LDLS manages changes to the manifest file in a similar way to the Avamar
Downloader Service. However, the LDLS downloads the manifest file directly to each
Avamar system without the requirement for an intermediate host.
Segregated networks
In multi-node ADS servers, inter-node traffic is carried over an internal network that
includes dual dedicated switches with specific utility node and storage node ports. All
other data traffic is carried directly to external customer switches for access to
backup, replication, and management sources or targets. Both internal and external
networks provide protection against single points of failure.
Bonded network interfaces on page 9 and Networking on page 25 provide more
information.
High-availability network
HA configuration provides for continued operation in the event of a single point of
failure between network components. The primary objective is to provide multiple
paths to the internal ADS network and the external customer network so that the
system can recover from an individual device or link failure. To do this, HA
configuration employs bonded network interfaces and dual dedicated ADS switches.
Each switch is connected to one of two physical interfaces of an ADS node.
Networking on page 25 provides more information.
ConnectEMC
A Linux-based program that transfers event data from an Avamar server to EMC
Technical Support. Installation of the Avamar software automatically initializes
Manifest file 9
Introduction
You can set other ConnectEMC attributes after the installation by using Avamar
Administrator. Additional information about ConnectEMC is available from the
following resources:
l EMC Avamar Administration Guide
l ConnectEMC for Linux 3.0 Reference Guide
Email home
An Avamar feature that automatically emails configuration, capacity, and general
system information to EMC Technical Support once daily, and critical alerts in near-
real time on an as-needed basis. Email home uses the same email server that you
configure for ConnectEMC.
Data deduplication
Data deduplication is a key feature of the Avamar system. Data deduplication ensures
that each unique sub-file object is stored only once across sites and servers.
During backups, Avamar client software examines the client file system, applies a data
deduplication algorithm that identifies redundant data sequences and breaks the client
file system into sub-file data segments. Each data segment is assigned a unique ID.
The client software then determines whether this unique ID has already been stored
on the Avamar server.
If this object resides on the Avamar server, a link to the stored object is referenced in
the backup. Once an object has been stored on the server, it never has to be re-sent
over the network, no matter how many times it is encountered on any number of
clients. This feature significantly reduces network traffic and provides for greatly
enhanced storage efficiency on the server.
Replication
A feature that enables efficient, encrypted, and asynchronous exchange of data that is
stored in an Avamar server to another Avamar server deployed in a remote location,
without the requirement to ship tapes. Replication is a scheduled process between
two independent Avamar servers that provides a higher level of reliability for stored
backups. Replication can be scheduled to run at off-peak hours to minimize bandwidth
impact.
Avamar clients
Avamar provides client software for various computing platforms. Each client
comprises a client agent and one or more plug-ins.
Figure 2 Avamar Client Operation
Agents
Avamar agents are platform-specific software processes that run on the client and
communicate with the Management Console Server (MCS) and any plug-ins installed
on that client.
Plug-ins
Avamar provides two types of plug-ins:
l File system used to browse, back up, and restore files or directories on a specific
client file system (such as Linux, Mac OS, Microsoft Windows, and Sun Solaris).
Replication 11
Introduction
Encryption
Avamar can encrypt all data sent between clients and the server in flight. To provide
enhanced security during client/server data transfers, Avamar supports two levels of
in-flight encryption: medium and high. You can set the encryption level on a client-
by-client basis in client properties, or for an entire group of clients in group properties.
You also can disable in-flight encryption entirely.
Each Avamar server can also be configured to encrypt data that is stored on the
server (at rest). The decision to encrypt all data that is stored in an Avamar server is
typically a one-time decision that is made when the server is initially deployed at a
customer site.
Starting in Avamar 7.3.x, additional security features use encryption during
authentication of both the server and client. The EMC Avamar Product Security Guide
provides more information.
Note
Note
Uploading the installation package can take a significant amount of time, depending on
the method used. Installing and configuring the Avamar Downloader Service and LDLS
are considered post-installation tasks because they are not required to perform
Avamar software installation.
l Monitoring the local repository for any software packages manually added to the
server
l Dependency and version checks of the downloaded packages
l Management of the temporary directory that is used to extract the packages
l Deletion of software packages after a successful installation or upgrade
Process flow
The following diagram shows how the Avamar Downloader Service, LDLS, and Avamar
Installation Manager work together with other components to automatically provide
installation, upgrade, and hot fix packages.
Figure 3 Process Flow for Packages
Note
l The Avamar Downloader Service then downloads the package and pushes it to
the Avamar Installation Manager, or
l The Avamar Installation Manager downloads the package directly using the
LDLS.
4. The user installs the package by clicking the Install button in the Avamar
Installation Manager.
Log files
The Avamar Installation Manager provides log file information through the web
interface. The log information can be exported to a file (.xls or .pdf).
The Avamar Installation Manager also provides the Download all system logs icon
, which enables you to download all system log files for troubleshooting issues, for
example.
You must log in to the EMC Customer Support account to use the Download all
system logs icon.
In-flight encryption
A new installation of Avamar sets in-flight encryption to High as the default setting.
An upgrade does not change the current in-flight encryption setting. The EMC Avamar
Administration Guide provides more information about in-flight encryption.
Component Description
Avamar Downloader Monitors the EMC repository. When a package is available for the
Service Windows Avamar system, the Avamar Downloader Service service
service automatically downloads the package and pushes it to the local
repository on the Avamar utility node or single-node server.
Avamar Downloader A process that provides status message about the Avamar
Service monitor Downloader Service.
Log files 15
Introduction
Component Description
Moving the mouse over the tray icon displays status messages
from the Avamar Downloader Service monitor.
Check for New Packages Queries the EMC repository for a new
manifest file.
Hardware Specifications 17
Hardware Specifications
The minimum ADS multi-node configuration is one utility node and three storage
nodes. The maximum is 1 utility node, 16 active storage nodes, and an optional spare
storage node.
Hardware specifications
Each node runs the SuSE Linux Enterprise Server v11 SP3 operating system and
features a service port. See Service port connectivity on page 20 for more
information.
The M600, M1200, and M2400 can be used as single-node servers or as storage
nodes within a multi-node server.
The S2400 (Avamar Business Edition) is available only as a single-node server and
does not require replication.
The NDMP Accelerator node is an optional node associated with, but not part of, the
Avamar server.
Utility node
l Two 3.5" hard drives
l Dual 1100W power supplies
l Two SLICs, each containing four 10GbE network ports:
n Bay 0: 10GBase-T or 10GbE Twinax/Optical
n Bay 1: 10GBase-T
l RMC shared and dedicated management ports
Hardware specifications 19
Hardware Specifications
Note
Traffic for the remote management console (RMC) may be configured during
installation to share the primary backup network port or use the dedicated RMC port.
The default ports for both configurations are listed in the following table, where
applicable.
After Avamar multi-node Internal network l Use the internal network IP address
installation switch port 24 assigned to each node during installation.
l The default internal network IP addresses
typically start at 192.168.255.1 for the utility
node.
After Avamar single- or RMC dedicated The dedicated or shared RMC port.
multi-node installation
eth0 (RMC l Use the RMC port IP address assigned to
shared) the node during installation.
l Because configuration of the RMC ports is
optional, the RMC may not always be
accessible.
l When configured, the RMC ports are always
available, including before the system has
booted and when the node is off.
Node components
Before handling ADS Gen4T equipment, first familiarize yourself with the Gen4T node
types and component locations for your specific hardware. See the figures and tables
that follow for details.
Figure 5 Front View
Node components 21
Hardware Specifications
Feature Description
Hard drives Hot swappable 3.5 hard drives:
l Utility node - Two in the 0 and 1 drive locations. All others are
blank.
l M600 node - Four in the 0 through 3 drive locations. All others
are blank.
l M1200 node - Six in the 0 through 5 drive locations. All others
are blank.
l M2400 node - 12 in the 0 through 11 drive locations.
l Avamar Business Edition (S2400) node - Eight in the 0
through 7 drive locations. All others are blank.
l Accelerator node - Two in the 0 and 1 drive locations. All
others are blank.
Feature Description
Service tag A pull-out label with the serial number and other system
information.
SLIC bays Hosts for network interfaces. Each 10GBase-T or 10GbE Twinax/
Optical SLIC hosts four network ports. All unoccupied bays contain
fillers.
SSD bays Host for SSD storage devices. Only the S2400 and M2400 contain
an SSD. All other models contain two fillers.
Feature Description
RMC shared port The remote management port that is used to share remote
management traffic and backup traffic.
RMC dedicated port The remote management port that is used when remote
management traffic is not shared.
Serial port Connects a device via RS-232 to provide direct access to the
console.
Do Not Unplug LED Indicates that the node should not be powered off or unplugged.
Service LED Indicates that the node requires some type of service.
Reset Reset the node by using the end of a paper clip to press the Reset
button. Use this button only if directed to do so by qualified
support personnel.
Node components 23
Hardware Specifications
l Overview............................................................................................................26
l Default port configuration.................................................................................. 26
l Basic networking configuration.......................................................................... 28
l Supported network configurations.....................................................................29
l Advanced network configuration dpnnetutil utility.......................................... 34
l Replication......................................................................................................... 36
Networking 25
Networking
Overview
The information in this chapter is for reference only. If advanced network or
replication configuration is required, EMC personnel must perform those activities
before installing the Avamar software.
Included in this chapter are:
l General overview of ADS Gen4T networking principles
l Descriptions of different network configurations ADS servers can interconnect
with
l An overview of the optional dpnnetutil advanced configuration utility
l Descriptions of replication schemes supported by ADS Gen4T
Multi-node servers
A multi-node ADS Gen4T server divides network traffic between internal Avamar
traffic and external customer communications. Multi-node systems have two internal
switches (to support high-availability) on an isolated network for internal Avamar
traffic between nodes. Customers provide external switching and connections to
match their infrastructure for backups, replication, and node management.
All nodes are connected to dual dedicated switches through the eth7 (SLIC1NIC2) and
eth8 (SLIC1NIC3) ports. These ports are normally bonded together as bond1.
Single-node servers
A single-node ADS Gen4T server divides different types of network traffic onto
different network interfaces. Customers provide external switching and connections
to match their infrastructure for backups, replication, and management.
For the ADS external network, the default configuration depends on whether the
remote management console (RMC) port is dedicated or shared.
When high availability is desired, the primary and secondary external network ports
are normally bonded together as bond0 for backing up customer data.
For systems configured with dedicated RMC ports:
The server is connected directly to a customer network switch through the eth1
(SLIC0NIC0) port. If high availability is desired, the server can also be connected to a
different customer network switch through the eth2 (SLIC0NIC1) port.
eth1 (SLIC0NIC0) is the primary, eth2 (SLIC0NIC1) is the secondary.
The remote management connection is made through the RMC dedicated port on the
rear I/O panel.
For systems configured with shared RMC ports:
The server is connected directly to a customer network switch through the eth0
(RMC shared) port. If high availability is desired, the server can also be connected to a
different customer network switch through the eth1 (SLIC0NIC0) port.
eth0 (RMC shared) is the primary, eth1 (SLIC0NIC0) is the secondary.
Single-node servers 27
Networking
The remote management connection is made through the eth0 (RMC shared) port on
the rear I/O panel.
The default settings can be changed through the dpnnetutil utility described in
Advanced network configuration dpnnetutil utility on page 34.
Note
As noted in this list of basic network configurations, Avamar systems support the use
of VLANs and separately support the use of NAT. However, Avamar does not support
the use of NAT on VLANs.
If all backup, replication, and management interfaces are used, ensure that they are
configured for different subnets.
See Node components on page 21 for descriptions and images related to node
components. The following images provide further clarification of possible ADS Gen4T
networking configurations.
Multi-node servers
For multi-node servers, primary and secondary port bonding on storage nodes can be
broken to facilitate incoming replication, which is delivered directly to storage nodes,
or for node management. If this bond is broken, high availability backup capability is
not possible.
The utility node can also be plugged in to a customer network switch for optional
outgoing replication and node management through its additional four network
interfaces. These interfaces are also bonded in pairs for high availability configuration:
Multi-node servers
Single uplink to external customer network
The following figures illustrate dual dedicated ADS switches (ADS Switch A and B)
and a single uplink from all nodes to the customer network switch.
Figure 8 Single Uplink (Dedicated RMC Port)
Multi-node servers 31
Networking
Single-node servers
Single uplink to external customer network
The following figures illustrate a single uplink from the server to the customer network
switch.
Figure 14 Single Uplink (Dedicated RMC Port)
Single-node servers 33
Networking
Note
Only EMC personnel can run the dpnnetutil utility. If the customer site requires
advanced network configuration, alert the EMC Account Team that the
implementation specialist must run dpnnetutil before installing the Avamar
software. While dpnnetutil is running, the customer may be asked to check certain
hardware-related connectivity errors that the utility might report.
Note
Replication
The following sections describe the types of replication architectures supported by
ADS systems. For complete instructions on setting up and performing replication,
including terms and concepts, capabilities and limitations, and best practices, see the
EMC Avamar Administration Guide.
Single-node servers
The networking architecture of ADS Gen4T and the Avamar software provide two
types of replication: Basic and Dedicated. They are described in the following sections.
Basic replication
The source and target systems each have a single network for traffic of all purposes.
Replication is in and out on this single network between the source and target pair.
The target system can be either a multi-node or single-node Avamar server. The
following image shows a multi-node server as the target.
Figure 20 Basic Replication Network
To configure basic replication, the Avamar software must be installed. The EMC
Avamar Administration Guide provides more information about configuring basic
replication.
Dedicated replication
A system that is configured for dedicated replication has dedicated networks on both
source and target systems. On the source system, dedicated backup, replication, and
management ports can be configured. The following image shows a multi-node server
as the target.
Figure 21 Dedicated Replication Network
Single-node servers 37
Networking
Multi-node servers
The networking architecture of ADS Gen4T and the Avamar software provide three
types of replication: Basic, Dedicated, and Disaster Recovery (DR). They are
described in the following sections.
Basic replication
The source and target systems each have a single network for traffic of all purposes.
Replication is in and out on the single network between the source and target pair.
Cross-replication between source and target systems is also supported by performing
the same procedure on the target.
Figure 22 Basic Replication Network
To configure basic replication, the Avamar software must be installed. The EMC
Avamar Administration Guide provides more information about configuring basic
replication.
Dedicated replication
A system that is configured for dedicated replication has dedicated networks on both
source and target systems. On the source system, dedicated backup, replication, and
management ports can be configured on the utility node. On the target system, the
bonds between primary and secondary backup ports on the storage nodes are broken,
and the secondary backup ports are dedicated to replication traffic.
Cross-replication between source and target systems is also supported by performing
the same procedure on the target.
Multi-node servers 39
Networking
The following topics describe setup procedures for an ADS system and followup
activities:
Siting
Siting is the process of determining where ADS equipment will be located. Numerous
thermal, acoustic, electrical, regulatory, and environmental requirements must be
taken into account before going forward with installation and implementation.
See the EMC Avamar Data Store Gen4, Gen4S, and Gen4T Site Prep Technical
Specifications document on the EMC Online Support site (http://support.emc.com)
for comprehensive information about siting ADS hardware.
Installation
Installation consists of racking, stacking, and cabling the ADS equipment and then
performing a minimal amount of network configuration to place the system on the
customers network for remote implementation.
ADS multi-node server installation must be performed by EMC personnel. Instructions
for doing so are contained in the SolVe Desktop utility and are accessible only to EMC
personnel.
ADS single-node server installation can be performed by customers. Instructions for
doing so are contained in the EMC Avamar Data Store Single Node Customer Installation
Guide, which can be found on the EMC Online Support site. If EMC is contracted to do
the installation, those instructions are located in the SolVe Desktop utility.
Implementation
Implementation consists of copying and configuring the Avamar software on each
node in the ADS system and preparing the Avamar subsystem to function as a backup
and restore tool. Implementation also involves procedures for setting up the initial
Avamar configuration as it relates to the unique backup, restore, and replication
requirements of the customer environment.
EMC believes the information in this publication is accurate as of its publication date. The information is
subject to change without notice.
The information in this publication is provided as is. EMC Corporation makes no representations or
warranties of any kind with respect to the information in this publication, and specifically disclaims
implied warranties of merchantability or fitness for a particular purpose. Use, copying, and distribution
of any EMC software described in this publication requires an applicable software license.
EMC, EMC, and the EMC logo are registered trademarks or trademarks of EMC Corporation in the
United States and other countries.
All other trademarks used herein are the property of their respective owners.
For the most up-to-date regulatory document for your product line, go to EMC Online Support
(https://support.emc.com).