Dell EMC Avamar® Data Store Gen4T Comprehensive Reference Guide
Dell EMC Avamar® Data Store Gen4T Comprehensive Reference Guide
Dell EMC Avamar® Data Store Gen4T Comprehensive Reference Guide
Dell believes the information in this publication is accurate as of its publication date. The information is subject to change without notice.
THE INFORMATION IN THIS PUBLICATION IS PROVIDED “AS-IS.“ DELL MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND
WITH RESPECT TO THE INFORMATION IN THIS PUBLICATION, AND SPECIFICALLY DISCLAIMS IMPLIED WARRANTIES OF
MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. USE, COPYING, AND DISTRIBUTION OF ANY DELL SOFTWARE DESCRIBED
IN THIS PUBLICATION REQUIRES AN APPLICABLE SOFTWARE LICENSE.
Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be the property of their respective owners.
Published in the USA.
Dell EMC
Hopkinton, Massachusetts 01748-9103
1-508-435-1000 In North America 1-866-464-7381
www.DellEMC.com
Chapter 1 Introduction 5
Important Avamar terms and concepts.........................................................6
Nodes.............................................................................................. 6
Node resource database (probe.xml)...............................................7
Avamar Downloader Service............................................................ 7
Local downloader service.................................................................7
Avamar FTP site.............................................................................. 8
Avamar Installation Manager........................................................... 8
Avamar login manager..................................................................... 8
Packages......................................................................................... 8
Segregated networks...................................................................... 9
ConnectEMC................................................................................... 9
Email home.....................................................................................10
Data deduplication......................................................................... 10
Replication...................................................................................... 11
Avamar clients................................................................................ 11
Encryption...................................................................................... 11
Information for customers...........................................................................12
Fundamental Avamar principles...................................................... 12
Avamar installation features overview......................................................... 12
How long will the Avamar software installation take?.....................13
Avamar Installation Manager.......................................................... 13
Process flow.................................................................................. 13
Log files......................................................................................... 15
In-flight encryption........................................................................ 15
Avamar Downloader Service...........................................................15
Chapter 3 Networking 25
Overview.................................................................................................... 26
Default port configuration.......................................................................... 26
Multi-node servers........................................................................ 26
Single-node servers....................................................................... 27
Basic networking configuration.................................................................. 28
Multi-node servers.........................................................................28
Supported network configurations............................................................. 29
Multi-node servers........................................................................ 29
Single-node servers........................................................................31
Advanced network configuration – dpnnetutil utility.............................34
Features provided by dpnnetutil...............................................35
Replication................................................................................................. 36
Single-node servers....................................................................... 36
Multi-node servers.........................................................................38
The following topics introduce Avamar and the Avamar Data Store (ADS) Gen4T
family of hardware components:
Introduction 5
Introduction
Nodes
A node is the primary building block in any Avamar configuration. Each node is a self-
contained, rack-mountable, network-addressable server that runs Avamar software on
the Linux operating system. All Avamar nodes are Domain Name System (DNS)
clients.
Note
The term "server" in the previous definition is used in the typical industry context
(that is, a computer that provides services to other computers or devices). However,
for the remainder of this guide, unless otherwise specified, the term "server" refers to
a single-node or multi-node Avamar system. The term "node" refers to the individual
computer/storage platforms that make up an Avamar server.
All nodes run the Linux operating system and use RAID data protection. Nodes have 2,
4, 6, 8, or 12 hard drives, depending on node type and storage capacity. The primary
differences between node types are:
l The amount of internal data storage (if any)
l The configuration and allocation of internal data storage (that is, RAID level,
number of logical units [LUNs] and so forth)
Utility node
In scalable multi-node servers, a single utility node provides essential internal services
for the server (for example, administrator server, replication, external authentication,
network time protocol [NTP], and web access). Utility nodes are dedicated to running
these essential services and do not store backups.
Storage nodes
Storage nodes, which store the actual backups, form the remainder of scalable multi-
node servers. There are three storage node models, the primary difference being the
amount of usable storage available: the M600, M1200, and M2400. Each model is also
offered as a single-node server.
Single-node servers
Single-node servers combine all the features and functions of utility and storage nodes
on a single node. There are four single-node server models: the M600, M1200, M2400,
and S2400. The S2400 (the Avamar Business Edition) is offered only as a single-node
server and features no requirement for replication.
Packages
Packages are Avamar software installation files, hotfix patches, and operating system
(OS) patches that are available from the Dell EMC repository. Packages comprise
three types:
l Client - A release of Avamar file system or application backup software
l Server - A new release of Avamar server software, a service pack, or a patch for
the operating system, management console, or Avamar software
l Workflow - A package that runs operations such as replacing a node or changing
the session security configuration
Packages use the extension .avp.
Local repository
The /data01/avamar/repo/packages directory on the utility node or single-node
server contains the most current manifest file from the Dell EMC repository,
installation packages, and workflow packages. The Avamar Downloader Service and
LDLS push packages from the Dell EMC repository to the local repository. If a
customer site does not allow Internet access, you can manually copy packages into
the local repository.
Manifest file
An XML file that lists all of the packages that are currently available for download from
the Dell EMC repository. When the Dell EMC Subscribenet team adds a package to
the repository, a corresponding manifest file entry describes the package. When the
Dell EMC Subscribenet team removes a package from the repository, the team then
removes the entry for the package from the manifest file.
The Avamar Downloader Service automatically downloads the manifest file from the
Dell EMC repository once a day and determines whether there are new packages
available for download. The Avamar Downloader Service sends the new manifest file
to the local repository for each Avamar server. The LDLS manages changes to the
manifest file in a similar way. However, the LDLS downloads the manifest file directly
to each Avamar server without the requirement for an intermediate host.
Segregated networks
In multi-node servers, an internal network carries inter-node traffic over dual
dedicated switches with specific utility node and storage node ports. All other data
traffic is carried directly to external customer switches for access to backup,
replication, and management sources or targets. Both internal and external networks
provide protection against single points of failure.
Bonded network interfaces on page 9 and Networking on page 25 provide more
information.
High-availability network
An HA configuration provides for continued operation in the event of a single point of
failure between network components. The primary objective is to provide multiple
paths so that the server can recover from an individual device or link failure. To do
this, HA configuration employs bonded network interfaces and dual dedicated internal
switches that connect to one of two physical interfaces of a node.
Networking on page 25 provides more information.
ConnectEMC
A Linux-based program that transfers event data from an Avamar server to Customer
Support. Installation of the Avamar software automatically initializes ConnectEMC by
passing values from the workflow to the ConnectEMC configuration files.
The server software installation requires you to set the following ConnectEMC
attributes:
Segregated networks 9
Introduction
Avamar Administrator allows you to set other ConnectEMC attributes after the
installation. The following resources provide additional information about
ConnectEMC:
l Avamar Administration Guide
l ConnectEMC for Linux 3.0 Reference Guide
Email home
An Avamar feature that automatically emails configuration, capacity, and general
system information to Customer Support once daily, and critical alerts in near-real
time on an as-needed basis. Email home uses the same email server that you configure
for ConnectEMC.
Data deduplication
Data deduplication is a key feature of the Avamar software. Data deduplication
ensures that each unique sub-file object is stored only once across sites and servers.
During backups, the Avamar client software examines the client file system, applies a
data deduplication algorithm that identifies redundant data sequences and breaks the
client file system into sub-file data segments. Each data segment is assigned a unique
ID. The client software then determines whether the Avamar server already stores this
unique ID.
If this object resides on the Avamar server, the backup references a link to the stored
object. Once an object has been stored on the server, it never has to be re-sent over
the network, no matter how many times it is encountered on any number of clients.
This feature significantly reduces network traffic and provides for greatly enhanced
storage efficiency on the server.
Figure 1 Avamar global data deduplication
Replication
A feature that enables efficient, encrypted, and asynchronous exchange of data from
one Avamar server to another Avamar server that is deployed in a remote location,
without the requirement to ship tapes. Replication is a scheduled process between
two independent Avamar servers that provides a higher level of reliability for stored
backups. You can schedule replication to run at off-peak hours to minimize bandwidth
impact.
Avamar clients
Avamar provides client software for various computing platforms. Each client
comprises a client agent and one or more plug-ins.
Figure 2 Avamar client operation
Agents
Avamar agents are platform-specific software processes that run on the client and
communicate with the Management Console Server (MCS) and any plug-ins installed
on that client.
Plug-ins
Avamar provides two types of plug-ins:
l File system – used to browse, back up, and restore files or directories on a specific
client file system (such as Linux, Mac OS, Microsoft Windows, and Sun Solaris).
l Application – support backup and restore of databases or other special
applications (such as Microsoft Exchange or SQL Server, Oracle, and NDMP for
NAS devices).
Encryption
To provide enhanced security during client/server data transfers, Avamar can encrypt
all data that is sent between clients and the server “in flight.” You can set the
encryption level on a client-by-client basis in client properties, or for an entire group of
clients in group properties. You also can disable “in-flight” encryption entirely.
You can also configure each Avamar server to encrypt the stored data on the server
(“at rest”). The decision to encrypt all data that is stored in an Avamar server is
typically a one-time decision that is made when the server is initially deployed at a
customer site.
Replication 11
Introduction
Additional security features use encryption during authentication of both the server
and client. The Avamar Product Security Guide provides more information.
Note
Note
Uploading the installation package can take a significant amount of time, depending on
the method used. Installing and configuring the Avamar Downloader Service and LDLS
are considered post-installation tasks because they are not required to perform
Avamar software installation.
Process flow
The following diagram shows how the Avamar Downloader Service, LDLS, and Avamar
Installation Manager work together with other components to automatically provide
installation, upgrade, and hot fix packages.
Note
2. The Avamar Installation Manager processes the manifest file and notifies the user
of new packages.
3. The user requests the package by clicking the Download button in the Avamar
Installation Manager.
l The Avamar Downloader Service then downloads the package and pushes it to
the Avamar Installation Manager, or
l The Avamar Installation Manager downloads the package directly using the
LDLS.
4. The user installs the package by clicking the Install button in the Avamar
Installation Manager.
Log files
The Avamar Installation Manager provides log file information through the web
interface. The log information can be exported to a file (.xls or .pdf).
The Avamar Installation Manager also provides the Download all system logs icon
, which enables you to download all system log files for troubleshooting issues, for
example.
You must log in to the Customer Support account to use the Download all system
logs icon.
In-flight encryption
A new installation of Avamar sets in-flight encryption to High as the default setting.
An upgrade does not change the current in-flight encryption setting. The Avamar
Administration Guide provides more information about in-flight encryption.
Component Description
Avamar Downloader Monitors the Dell EMC repository. When a package is available for
Service Windows the Avamar system, the Avamar Downloader Service service
service automatically downloads the package and pushes it to the local
repository on the Avamar utility node or single-node server.
Avamar Downloader A process that provides status message about the Avamar
Service monitor Downloader Service.
Moving the mouse over the tray icon displays status messages
from the Avamar Downloader Service monitor.
Right-clicking the icon displays these options:
Log files 15
Introduction
Component Description
Open Repository Opens the local file cache directory on
the Windows server (C:\Program
Files\EMC\Avamar Downloader
Service\repository).
Check for New Packages Queries the Dell EMC repository for a
new manifest file.
Hardware specifications 17
Hardware specifications
18 Storage node 8
17
16 Storage node 7
15
14 Storage node 6
13
12 Storage node 5
11
10 Storage node 4
9
8 Storage node 3
7
6 Storage node 2
5
4 Storage node 1
3
2 U lity node
1
The minimum ADS multi-node configuration is one utility node and three storage
nodes. The maximum is 1 utility node, 16 active storage nodes, and an optional spare
storage node.
Hardware specifications
Each node runs the SuSE Linux Enterprise Server 11 SP3 or SP4 operating system,
and features a service port. See Service port connectivity on page 20 for more
information.
Note
Some versions of the Avamar software may upgrade the operating system to SLES 11
SP4.
The M600, M1200, and M2400 can be used as single-node servers or as storage
nodes within a multi-node server. The S2400 (Avamar Business Edition) is available
only as a single-node server and does not require replication.
The NDMP accelerator node is an optional node that is associated with, but not part
of, the Avamar server.
Utility node
l Two 3.5" hard drives
l Dual 1100W power supplies
l Two SLICs, each containing four 10GbE network ports:
n Bay 0: 10GBase-T or 10GbE Twinax/Optical
n Bay 1: 10GBase-T
l RMC shared and dedicated management ports
Hardware specifications 19
Hardware specifications
Note
Traffic for the RMC can be configured during installation to share the primary backup
network port, or to use the dedicated RMC port. The following table lists the default
ports for both configurations, where applicable.
After multi-node Internal network l Use the internal network IP address that
installation switch port 24 was assigned to each node during
installation.
l The default internal network IP addresses
typically start at 192.168.255.1 for the utility
node.
After single- or multi- RMC dedicated The dedicated or shared RMC port.
node installation
eth0 (RMC l Use the RMC port IP address that was
shared) assigned to the node during installation.
l Because configuration of the RMC ports is
optional, the RMC may not always be
accessible.
l When configured, the RMC ports are always
available, including before the system has
booted and when the node is off.
Node components
Before handling Gen4T equipment, first familiarize yourself with the node types and
component locations for your specific hardware. See the figures and tables that follow
for details.
Figure 5 Front view
Node components 21
Hardware specifications
Feature Description
Hard drives Hot swappable 3.5” hard drives:
l Utility node - Two in the 0 and 1 drive locations. All others are
blank.
l M600 node - Four in the 0 through 3 drive locations. All others
are blank.
l M1200 node - Six in the 0 through 5 drive locations. All others
are blank.
l M2400 node - 12 in the 0 through 11 drive locations.
l Avamar Business Edition (S2400) node - Eight in the 0
through 7 drive locations. All others are blank.
l NDMP accelerator node - Two in the 0 and 1 drive locations.
All others are blank.
Feature Description
Service tag A pull-out label with the serial number and other system
information.
SLIC bays Hosts for network interfaces. Each 10GBase-T or 10GbE Twinax/
Optical SLIC hosts four network ports. All unoccupied bays contain
fillers.
SSD bays Host for SSD storage devices. Only the S2400 and M2400 contain
an SSD. All other models contain two fillers.
Feature Description
RMC shared port The remote management port that is used to share remote
management traffic and backup traffic.
RMC dedicated port The remote management port that is used when remote
management traffic is not shared.
Serial port Connects a device via RS-232 to provide direct access to the
console.
Do Not Unplug LED Indicates that the node should not be powered off or unplugged.
Service LED Indicates that the node requires some type of service.
Reset Reset the node by using the end of a paper clip to press the Reset
button. Use this button only if directed to do so by qualified
support personnel.
Node components 23
Hardware specifications
l Overview............................................................................................................26
l Default port configuration.................................................................................. 26
l Basic networking configuration.......................................................................... 28
l Supported network configurations.....................................................................29
l Advanced network configuration – dpnnetutil utility.......................................... 34
l Replication......................................................................................................... 36
Networking 25
Networking
Overview
The information in this chapter is for reference only. If advanced network or
replication configuration is required, Dell EMC personnel must perform those activities
before installing the Avamar software.
Included in this chapter are:
l General overview of Gen4T networking principles
l Descriptions of different network configurations with which Gen4T servers can
interconnect
l An overview of the optional dpnnetutil advanced configuration utility
l Descriptions of replication schemes that Gen4T supports
Multi-node servers
A multi-node server divides network traffic between internal Avamar traffic and
external customer communications. Two internal switches (to support high-
availability) on an isolated network route internal Avamar traffic between nodes.
Customers provide external switching and connections to match their infrastructure
for backups, replication, and node management.
All nodes connect to dual dedicated network switches through the eth7 (SLIC1NIC2)
and eth8 (SLIC1NIC3) ports. These ports are normally bonded together as bond1.
Single-node servers
A single-node server divides different types of network traffic onto different network
interfaces. Customers provide external switching and connections to match their
infrastructure for backups, replication, and management.
For the external network, the default configuration depends on whether you use the
shared or dedicated RMC port.
When high availability is desired, the primary and secondary external network ports
are normally bonded together as bond0 for backing up customer data.
For servers configured with dedicated RMC ports:
The server connects directly to a customer network switch through the eth1
(SLIC0NIC0) port. For high availability, the server can also connect to a different
customer network switch through the eth2 (SLIC0NIC1) port.
eth1 (SLIC0NIC0) is the primary, eth2 (SLIC0NIC1) is the secondary.
The remote management connection is made through the RMC dedicated port on the
rear I/O panel.
For servers configured with shared RMC ports:
The server connects directly to a customer network switch through the eth0 (RMC
shared) port. For high availability, the server can also connect to a different customer
network switch through the eth1 (SLIC0NIC0) port.
eth0 (RMC shared) is the primary, eth1 (SLIC0NIC0) is the secondary.
Single-node servers 27
Networking
The remote management connection is made through the eth0 (RMC shared) port on
the rear I/O panel.
The default settings can be changed through the dpnnetutil utility that is described
in Advanced network configuration – dpnnetutil utility on page 34.
Note
As noted in this list of basic network configurations, Avamar systems support the use
of VLANs and separately support the use of NAT. However, Avamar does not support
the use of NAT on VLANs.
If you use all of the backup, replication, and management interfaces, ensure that you
configure the interfaces for different subnets.
See Node components on page 21 for descriptions and images of node components.
The following topics provide further clarification of the possible Gen4T networking
configurations.
Multi-node servers
The primary and secondary port bonding on storage nodes can be broken to facilitate
incoming replication, which is delivered directly to storage nodes, or for node
management. Breaking this bond prevents use of the high-availability backup
capability.
You can also connect the utility node to a customer network switch through its
additional four network interfaces for optional outgoing replication and node
management. These interfaces are also bonded in pairs for high availability
configuration:
Multi-node servers
Single uplink to external customer network
The following figures illustrate a single uplink from all nodes to the customer network
and connections for the dual dedicated internal switches (switch A and B).
Figure 8 Single uplink, dedicated RMC port
Single-node servers
Single uplink to external customer network
The following figures illustrate a single uplink from the server to the customer network
switch.
Single-node servers 31
Networking
Single-node servers 33
Networking
Note
Only Dell EMC personnel can run the dpnnetutil utility. If the customer site
requires advanced network configuration, alert the Dell EMC Account Team that the
implementation specialist must run dpnnetutil before installing the Avamar
software. While dpnnetutil is running, the customer may be asked to check certain
hardware-related connectivity errors that the utility might report.
Note
If you configure all backup, replication, and management interfaces on the single-
node server, you must configure the interfaces for different subnets.
l Configuration of backup VLAN interfaces, including:
n Requesting a list of VLAN IDs available on the customer network switch
n Requesting corresponding parameters for each VLAN ID (IP, netmask)
The customer network administrator must provide a list of correct VLAN IDs
(typically in the range 1 to 4094). The site networking topology must be such that
all clients are able to resolve the Avamar server by the same hostname from
different VLANs. Otherwise, backup failures may occur.
The dpnnetutil utility populates probe.xml with information obtained during the
configuration procedure.
Replication
The following sections describe the types of supported replication architectures. For
complete instructions on setting up and performing replication, including terms and
concepts, capabilities and limitations, and best practices, the Avamar Administration
Guide provides more information.
Single-node servers
The Gen4T networking architecture and the Avamar software provide two types of
replication: basic and dedicated. The following sections describe each type of
replication.
Basic replication
The source and target servers each have a single network for all traffic. Incoming and
outgoing replication occurs on this single network between the source and target pair.
Target servers can be either multi-node or single-node. The following figure shows a
multi-node server as the target.
Figure 20 Basic replication network
Configure basic replication after installation of the Avamar software. The Avamar
Administration Guide provides more information.
Dedicated replication
Servers that are configured for dedicated replication have dedicated networks on both
the source and target. On the source server, you can configure dedicated backup,
replication, and management ports. The following figure shows a multi-node server as
the target.
Figure 21 Dedicated replication network
Single-node servers 37
Networking
Multi-node servers
The Gen4T networking architecture and the Avamar software provide three types of
replication: basic, dedicated, and disaster recovery (DR). The following sections
describe each type of replication.
Basic replication
The source and target systems each have a single network for all traffic. Incoming and
outgoing replication occurs on this single network between the source and target pair.
Avamar supports cross-replication between source and target systems by performing
the same procedure on the target.
Figure 22 Basic replication network
Configure basic replication after installation of the Avamar software. The Avamar
Administration Guide provides more information.
Dedicated replication
Servers that are configured for dedicated replication have dedicated networks on both
the source and target. On the source server, you can configure dedicated backup,
replication, and management ports on the utility node. On the target server, the bonds
between primary and secondary backup ports on the storage nodes are broken, and
the secondary backup ports become dedicated to replication traffic.
Avamar supports cross-replication between source and target systems by performing
the same procedure on the target.
Multi-node servers 39
Networking
Siting
Siting is the process of determining where to locate ADS hardware. The siting process
must account for numerous thermal, acoustic, electrical, regulatory, and
environmental requirements before you continue with installation and implementation.
See the Avamar Data Store Gen4, Gen4S, and Gen4T Site Prep Technical Specifications
document on the Online Support site (http://support.emc.com) for comprehensive
information about siting ADS hardware.
Installation
Installation consists of racking, stacking, and cabling the ADS equipment and then
performing a minimal amount of network configuration to place the system on the
customer’s network for remote implementation.
Customer can perform ADS single-node server installation. The Avamar Data Store
Single Node Customer Installation Guide provides additional information. ADS multi-
node server installation must be performed by Dell EMC personnel, who use
instructions from the SolVe Desktop utility that is only accessible to
Dell EMC personnel.
Implementation
Implementation consists of copying and configuring the Avamar software on each
node in the ADS system and preparing the Avamar subsystem to function as a backup
and restore tool. Implementation also involves procedures for setting up the initial
Avamar configuration as it relates to the unique backup, restore, and replication
requirements of the customer environment.