EMC NetWorker and VMware
EMC NetWorker and VMware
EMC NetWorker and VMware
Integration Guide
302-001-580
REV 08
Copyright © 1990-2015 EMC Corporation. All rights reserved. Published in USA.
EMC believes the information in this publication is accurate as of its publication date. The information is subject to change
without notice.
The information in this publication is provided as is. EMC Corporation makes no representations or warranties of any kind with
respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a
particular purpose. Use, copying, and distribution of any EMC software described in this publication requires an applicable
software license.
EMC², EMC, and the EMC logo are registered trademarks or trademarks of EMC Corporation in the United States and other
countries. All other trademarks used herein are the property of their respective owners.
For the most up-to-date regulatory document for your product line, go to EMC Online Support (https://support.emc.com).
EMC Corporation
Hopkinton, Massachusetts 01748-9103
1-508-435-1000 In North America 1-866-464-7381
www.EMC.com
Figures 7
Tables 9
Preface 11
Chapter 1 Introduction 15
Introduction to VMware support.................................................................... 16
Backup and recovery types............................................................................16
Guest-based backup and recovery.................................................................18
Recommendations for NetWorker installed in a virtual machine....... 18
Advantages of guest-based backups................................................ 18
Disadvantages of guest-based backups........................................... 19
Installation for guest-based backup and recovery.............................19
Configuration of guest-based backup and recovery.......................... 19
Recommendations and considerations for guest-based backup....... 19
NetWorker VMware Protection....................................................................... 20
Advantages of NetWorker VMware Protection................................... 20
Disadvantages of NetWorker VMware Protection.............................. 20
VADP backup and recovery (legacy)...............................................................20
Advantages of VADP.........................................................................20
Disadvantages of VADP.................................................................... 21
Launching the vSphere Web Client from the NetWorker Console (Windows only)
................................................................................................................... 153
Recovering VADP Backups...........................................................................153
File based recovery of a VM............................................................ 153
Image level (single step) recovery of a full VM................................ 155
Recovery of pre-NetWorker 7.6 SP2 VM backups............................ 163
VADP Planning and Best Practices............................................................... 163
Recommendations and considerations for VADP backup and recovery
...................................................................................................... 163
Application-level consistent backups............................................. 164
Selection of physical vs. virtual proxy.............................................165
VADP snapshot recommendations................................................. 167
Recommendations for Data Domain systems..................................169
Network and Firewall port requirements......................................... 170
Memory requirements for the VADP proxy.......................................170
VADP mount point recommendations and space considerations.... 171
Support for tape drives in a VM...................................................... 172
Recommendations and considerations for transport modes........... 173
Performance optimization recommendations................................. 177
VADP proxy access to LUNs............................................................ 177
Upgrading from VCB to VADP (pre-NetWorker 8.1)....................................... 179
Upgrading an existing NetWorker server and VCB proxy..................179
Change vCenter role privileges after upgrading...............................181
Upgrading only the proxy client to NetWorker 7.6 SP2 or later........ 182
Upgrade to use vCenter if ESX/ESXi server was previously used for VM
backups.........................................................................................182
Space requirement changes on proxy for VADP vs VCB................... 183
Post-upgrading steps for Virtual Center on a 64-bit Windows host..183
Glossary 189
50 Recovery from a secondary site in the EMC Backup and Recovery user interface.......... 106
51 Monitoring stream counts output.................................................................................115
52 Specify Client name and type.......................................................................................137
53 Apps and Modules tab in NMC.....................................................................................142
54 Recover Options dialog................................................................................................154
55 VMware vCenter restore............................................................................................... 157
1 Revision history............................................................................................................. 11
2 Comparing Guest based, VADP, and NetWorker VMware Protection................................16
3 NetWorker VMware Data Protection tasks...................................................................... 24
4 NetWorker VMware Protection requirements.................................................................. 25
5 Incoming port requirements...........................................................................................26
6 Outgoing port requirements — with external proxies...................................................... 27
7 Recommended memory and swap space based on storage space utilization................. 31
8 OVA versions for NetWorker 8.2 SP1 VMware Backup Appliances.................................. 31
9 Minimum required vCenter user account privileges ....................................................... 43
10 Description of services running on the VMware Backup appliance................................. 51
11 Backup tab column descriptions ...................................................................................77
12 Email configuration fields ............................................................................................. 79
13 EMC Backup and Recovery alarms .................................................................................95
14 Scalability Factors....................................................................................................... 108
15 Maximum concurrent sessions per VMware Backup Appliance.................................... 109
16 Concurrency/parallelism recommendations ................................................................109
17 Application information values ................................................................................... 139
18 Recovery options that are available based on the virtual client configuration...............143
19 VADP backup privileges .............................................................................................. 148
20 VADP recovery privileges .............................................................................................149
21 Maximum virtual disk file size and corresponding block size for ESX/ESXi 4.0............. 168
22 Maximum virtual disk size and corresponding block size for ESX/ESXi 4.1...................168
23 APPINFO variable replacements................................................................................... 180
As part of an effort to improve its product lines, EMC periodically releases revisions of its
software and hardware. Therefore, some functions described in this document might not
be supported by all versions of the software or hardware currently in use. The product
release notes provide the most up-to-date information on product features.
Contact your EMC technical support professional if a product does not function properly
or does not function as described in this document.
Note
This document was accurate at publication time. Go to EMC Online Support (https://
support.emc.com) to ensure that you are using the latest version of this document.
Purpose
This document describes the integration of VMware with NetWorker.
Audience
This guide is part of the NetWorker documentation set, and is intended for use by system
administrators who are responsible for setting up and maintaining backups on a network.
Operators who monitor daily backups will also find this guide useful.
Revision history
The following table presents the revision history of this document.
Table 1 Revision history
06 May 25, 2015 Added information about the new OVA version 1.1.1.50 of
the VMware Backup Appliances
Added knowledgebase article information to Limitations
and unsupported features on page 112
Created a new topic for VMware Backup Appliances best
practices on page 28
Updates to System Requirements on page 25 for new
OVA file versions, vSphere 6.0 support, and DD Boost
Compatibility Guide references
Updates to NTP configuration on page 30 to address the
leap second issue
08 June 12, 2015 Updated OVA references throughout to indicate that OVA
version 1.1.1.50 is the latest version for NetWorker 8.2
SP1
Related documentation
The NetWorker documentation set includes the following publications:
l EMC NetWorker Online Software Compatibility Guide
Provides a list of client, server, and storage node operating systems supported by the
EMC information protection software versions. You can access the Online Software
Compatibility Guide on the EMC Online Support site at https://support.emc.com.
From the Support by Product pages, search for NetWorker using "Find a Product", and
then select the Install, License, and Configure link.
l EMC NetWorker Administration Guide
Describes how to configure and maintain the NetWorker software.
l EMC NetWorker Cluster Installation Guide
Contains information related to configuring NetWorker software on cluster servers
and clients.
l EMC NetWorker Installation Guide
Provides information on how to install, uninstall and update the NetWorker software
for clients, storage nodes, and servers on all supported operating systems.
l EMC NetWorker Updating from a Previous Release Guide
Describes how to update the NetWorker software from a previously installed release.
l EMC NetWorker Release Notes
NOTICE
Note
Typographical conventions
EMC uses the following type style conventions in this document:
Italic Use for full titles of publications referenced in text
Monospace Use for:
l System code
l System output, such as an error message or script
l Pathnames, file names, prompts, and syntax
l Commands and options
Introduction 15
Introduction
Table 2 Comparing Guest based, VADP, and NetWorker VMware Protection (continued)
Virtual full backup Not supported Not supported Backup is always virtual
full
File level restore Yes Yes for Windows guest OS Yes for Windows and Linux
only
Configuration NetWorker client Proxy and virtual machine EMC Backup and Recovery
configured through as NetWorker client appliance registration
Client Configuration configured through Client through web interface
wizard Configuration wizard
Table 2 Comparing Guest based, VADP, and NetWorker VMware Protection (continued)
Advantages of VADP
VADP provides the following advantages:
l Offloads backup processes from the ESX server to a VADP proxy server.
l Eliminates the need for a backup window by using VMware virtual machine snapshot
technology.
l Supports backups of all files residing in VMs running a Microsoft Windows guest
operating system using save set ALLVMFS.
l Supports backups of specific files or folders for VMs running a Microsoft Windows
guest operating system.
l Supports incremental and non level-0 backups for VMs running on a Microsoft
Windows guest operating system.
Note
The incremental and non level-0 backups allow recovery of files. Recovery of the full
VM is only supported for level-0 *FULL* save set backups.
l Supports image level backups for VMs running any guest operating system supported
by VMware.
l Supports the ability to recover individual files from an image level backup (Windows
NTFS only).
l Supports deduplication across VMs and servers.
l Minimizes the backup impact on the target VM and other VMs hosted on the same
ESX server.
l There is no need to install NetWorker software on each virtual machine.
l Provides LAN-Free backup because the VADP proxy server can be connected to the
SAN through a fibre channel adapter.
l Supports advanced VMware features and configurations such as Distributed
Resource Scheduling (DRS) and VMotion, which do not impact the performance of
NetWorker.
Disadvantages of VADP
Disadvantages of VADP include:
l No support for File-level restore from Image-level backup of non-NTFS system.
l No support for Image-level recovery of an entire VM from an incremental CBT backup.
Disadvantages of VADP 21
Introduction
Program/Role Task
NMC l Create and edit Data Protection policies to perform actions such as
backup, clone, and checkpoint backup for disaster recovery
l Assign a policy to the VMware Backup Appliance
l Assign VMs/VMDKs to the policy
l Start or schedule a policy to run any backup and clone actions
associated with the policy
When you start a policy from NMC, you can perform both backups and
clones, based on the actions defined in the policy.
System requirements
The following table lists the required components for NetWorker VMware Protection.
When you install or upgrade NetWorker and deploy the VMware Backup Appliance,
ensure that the NetWorker server, storage node, and VMware Backup Appliance are at the
same version. For example, for NetWorker 8.2 SP1, install or upgrade to the latest OVA
version 1.1.1.50. The section OVA files for the NetWorker 8.2 SP1 VMware Backup
Appliances on page 31 provides more information about the current OVA versions.
Note
The VMware Backup appliance is available in 2 capacities — a 0.5 TB and 4 TB OVA. You
only need to download one of these appliances, based on your system requirements. The
section Downloading the OVAs for EMC Backup and Recovery on page 30 provides more
information.
Component Requirements
NetWorker l 8.2 or later Server software with NMC
NetWorker VMware Protection only supports the following NetWorker
server architectures:
-Windows 64-bit
-Linux x86_64
-Solaris SPARC 64-bit (VMware View in NMC is not supported on Solaris)
System requirements 25
NetWorker VMware Protection
Component Requirements
Note
In order to access the EMC Backup and Recovery user interface in the
vSphere Web Client, you must enable web browsers with Adobe Flash
Player version 11.5 or later on Windows platforms. Since Linux
platforms only support up to Adobe Flash Player version 11.2, only
Windows platforms can access the EMC Backup and Recovery user
interface.
Data Domain l Data Domain Boost system OS at DDOS 5.4.2.1 and later.
Note
Port requirements
The NetWorker VMware Protection solution requires the ports outlined in the following
tables.
VMware Backup Data Domain 7, 22, 80, 111, 131, Data Domain management
Appliance and external 163, 2049, 2052
proxy
VMware Backup ESX servers 443, 111, 902 Backup and recovery
Appliance and External operations
Proxy
External proxy VMware Backup 28001, 27000, 29000 External proxy to MCS and
Appliance GSAN
To communicate with the VMware Backup Appliance, the NetWorker server VM web
services (nsrvmwsd) listen on port 8080 by default. Ensure that no other services, such
as HBA, use port 8080. To check port usage for 8080 outside of NetWorker:
l On Windows, run netstat -anbo | findstr 8080
l On Linux, run netstat -anp | grep 8080
l On Solaris, run lsof -i :8080
If any software other than NetWorker listens on this port, you can change the NetWorker
web services port in NMC by right-clicking the server in the Configuration window and
selecting Properties. The VMWS port field is located under the Miscellaneous tab.
Port requirements 27
NetWorker VMware Protection
Pre-installation requirements
Before you deploy the VMware Backup appliance, review the following pre-installation
requirements.
l DNS Configuration on page 29
l NTP Configuration on page 30
l NetWorker VMware Protection best practices on page 110
DNS Configuration
The DNS server plays a very important role during the VMware Backup Appliance
configuration and during backup/restore operations. You must add an entry to the DNS
Server for the VMware Backup appliance IP address and Fully Qualified Domain Names
(FQDNs).
The DNS server must support both forward and reverse lookup for the following:
l VMware Backup Appliance
l External Proxy
l NetWorker server
l Data Domain device
l vCenter and ESXi hosts
Note
Failure to set up DNS properly can cause many runtime or configuration issues. Do not
manually change entries in the /etc/hosts file on the VMware Backup appliance.
You can set details for the DNS server and network IP during deployment of the VMware
Backup Appliance in the Deploy OVF Template window, as described in the section
Deploy the VMware Backup Appliance on page 32.
To confirm your DNS configuration, open a command prompt and run the following
commands from the vCenter Server.
Procedure
1. To verify DNS configuration, type the following:
The nslookup command returns the FQDN of the VMware Backup appliance.
Pre-installation requirements 29
NetWorker VMware Protection
2. To verify that the FQDN of the VMware Backup appliance resolves to the correct IP
address, type the following:
3. To verify that the FQDN of the vCenter Server resolves to the correct IP address, type
the following:
If the nslookup commands return the proper information, then close the command
prompt; if not, correct the DNS configuration. If you configure short names for the DNS
entries, then perform additional look-ups for the short names.
Note
After deployment, check for DNS resolution (forward and reverse) from the VMware
Backup appliances and proxies for vCenter and the NetWorker hosts.
NTP Configuration
The VMware Backup Appliance leverages VMware Tools to synchronize time through NTP
by using the Sync guest OS time with host option by default.
On ESXi hosts, the vCenter server, and the NetWorker server, you must configure NTP
properly. Since the VMware Backup Appliance obtains the correct time through VMware
Tools, the appliance does not require configuration with NTP. However, you must ensure
that the time on the vCenter server and the VM that hosts the VMware Backup Appliance
are as close as possible, for example, within one minute of each other. This will occur
when the vCenter server is on same host as the VM that hosts the VMware Backup
Appliance, but when this is not the case, you should configure NTP on the VMware
Backup Appliance in order to keep host times in sync.
Note
If you configure NTP directly in the EMC Backup and Recovery user interface in the
vSphere Web Client, then time synchronization errors occur.
ESXi and vCenter Server documentation provides more information about configuring
NTP.
Note
EMC does not recommend configuring a NetWorker 8.2 VMware Backup Appliance and an
OVA earlier than NetWorker 8.2 in the same vCenter.
Three VMware bundles and one ISO update are available. Each fulfills a specific
requirement:
l 0.5 TB OVA — download the 0.5TB appliance when performing backups to a Data
Domain system, or when protecting fewer than 10 VMs using internal storage.
l 4 TB OVA — download the 4TB appliance when performing backups to internal
storage and protecting more than 10 VMs. The following table provides
recommendations on provisioning memory and swap space based on the storage
space in use.
Table 7 Recommended memory and swap space based on storage space utilization
l EBR-Proxy OVA — download the external proxy appliance when performing more than
eight concurrent backups, or to improve performance in certain situations. For
example, you may need to deploy an external proxy to an ESX server in order to
perform hotadd backups of VMs on that server. The section EMC Backup and
Recovery Configure window setup on page 47 provides the steps required to deploy
an external proxy.
l EBRUpgrade — download this ISO if you need to update the deployed VMware
Backup appliance to the latest version.
Other system requirements for the appliances are provided in NetWorker VMware
Protection requirements on page 25. Download the desired OVA and place in shared
storage.
OVA files for the NetWorker 8.2 SP1 VMware Backup Appliances
Networker 8.2 SP1 provides the following OVA files for the 0.5 TB, 4 TB, and external
proxy VMware Backup Appliances, in addition to the appliance for upgrading your OVA
version.
The following table provides version information for the new OVAs.
Table 8 OVA versions for NetWorker 8.2 SP1 VMware Backup Appliances
EBR-Proxy-1.1.1.50.ova NetWorker 8.2.1 OVA for the External proxy that supports
EXT4 backup and recovery
If you previously deployed OVA versions 1.1.1.46, you must apply a patch before
upgrading to OVA version 1.1.1.50. When you download the OVA from https://
support.emc.com/downloads/1095_NetWorker a document displays which contains the
patch links with instructions for installation. After applying the patches, you may then
proceed to upgrade from OVA version 1.1.1.46 to OVA version 1.1.1.50. If you are not
running OVA version 1.1.1.46, you do not need to apply the patches and can upgrade
directly to OVA version 1.1.1.50.
EMC strongly recommends also upgrading your NetWorker Server and Storage Nodes to
Networker cumulative build 8.2.1.3.
OVA 1.1.1.50 fixes the following issues:
l Knowledge Base 201864 - FLR Fails for VMs with larger disks and shows 'Failed to get
disks: Unable to browse as proxies are unavailable'
l Knowledge Base 201865 - Clients VMs are removed from VMware Protection Policies
OVA 1.1.1.46 fixes the following issues:
l 226264 - glibc versions vulnerability
l 226834 - Resurrect restore from Data Domain hangs in Import operation with errors
l 226240 - Circular deadlock problem in rwmutex
l hfscheck failures fix detailed in Knowledgebase article 197864, available at https://
support.emc.com
4. In the filetype drop-down, select OVA Packages then navigate to the directory that
contains the ova files. Select the file and then click Open.
5. On the Deploy OVF Template window, click Next.
6. On the Review Details window, click Next.
7. Accept the EULA and click Next.
8. Specify a name for the VMware Backup appliance, and then select the folder or
datacenter to which you want to deploy the appliance. Click Next.
9. Select the resource where you want to deploy the VMware Backup appliance, then
click Next.
10.Select Storage, then select the virtual disk format and click Next. EMC recommends
thin provisioning disk format.
11.On Setup Networks, select the destination network from the drop-down, then click
Next.
12.Provide the networking properties, including the correct IP (static IP), DNS, and so on.
Verify this information is correct, otherwise the appliance will not work. Click Next.
13.In the Ready to Complete window, ensure that the Power-on after deployment option
is selected, then click Finish.
Results
After a few minutes a screen similar to the following figure appears in the console of the
VMware Backup appliance in vCenter.
e. Click Next.
The OVF Template Details screen appears.
b. Select a datacenter and folder location for this proxy in the Inventory tree.
c. Click Next.
The Host / Cluster screen appears.
NOTICE
Proxy network settings are difficult to change after you register and activate the
Proxy. Therefore, ensure that you type the correct settings in this screen.
Once the VMware Backup appliance is deployed, navigate to the console of the VM in
the vSphere client.
Figure 3 Registering proxy with the VMware Backup appliance
19.Follow the prompts to register the proxy, as shown in the figure above.
a. Press 1 to register the proxy.
b. At the Enter the EMC Backup and Recovery Appliance address prompt, type the
FQDN of the VMware Backup appliance server name.
c. At the Enter the server domain [clients]: prompt, press enter and do not modify.
d. Provide the VMware Backup appliance password if using a non-default password.
e. Wait for the Attempting to connect to the appliance...Connection successful
message.
20.Validate the registration in NMC by ensuring that the external proxy host appears
under the External Proxy Hosts column of the VMware Backup appliance that it is
registered to.
NOTICE
If you upgrade or reboot the VMware Backup appliance after deploying an external
proxy, restart all external proxy VMs.
For sites experiencing such registrations, please contact EMC support to unregister the
proxies in error, and then check all of your external proxy appliances using the above
Note
The proactive_check.pl script includes a check discover proxies that have not been
checked in the last 24 hours.
n If you deployed and configured a VMware Backup appliance with this non-root
(test) user in vCenter 5.1, you must perform the following steps in order to
connect to the VMware Backup appliance after upgrading to vCenter 5.5:
1. From a web browser, type https://
<IP_address_VMware_Backup_appliance>:8453/ebr-configure. The EMC
Backup and Recovery Configure window appears.
2. Click the Configuration tab and unlock the vCenter registration.
3. Change the username to DOMAIN\test, and then save and reboot the
appliance.
Figure 6 Unlock the vCenter Registration in the EMC Backup and Recovery Configure
window
8. Open the EMC Backup and Recovery Configure window. The section Post-Installation
configuration in the EMC Backup and Recovery Configure window on page 50
provides information about the EMC Backup and Recovery Configure window.
9. Navigate to the Upgrade tab and click Check Upgrades. The available upgrade
package appears.
10.Navigate to the Status tab to ensure all services are running.
11.Return to the Upgrade tab and click Upgrade EBR.
When the upgrade completes, the VMware Backup appliance shuts down
automatically.
12.Power on the VMware Backup appliance.
When you launch the EMC Backup and Recovery user interface in the vSphere Web
Client, and then connect to the upgraded appliance and navigate to the Configuration
tab, the new version appears.
Note
When you complete a successful upgrade and verify that all backup and restore
functionality is working as expected, return to the vSphere Client to delete the
snapshot taken in step 4.
Enable VMware View in NMC after upgrading by creating a NSR Hypervisor resource
When you upgrade the NetWorker server to NetWorker 8.2 or later and upgrade to the
latest VMware Backup appliance(s), VMware View may not appear in NMC until you
create a NSR Hypervisor resource.
Perform one of the following to create the NSR Hypervisor resource.
l Download and deploy a NetWorker 8.2 or later VMware Backup appliance from
vCenter, following the registration steps outlined in the section EMC Backup and
Recovery Configure window setup on page 47.
l Manually create a NSR Hypervisor resource by using the nsradmin program. The
section Configuring a VADP proxy host and Hypervisor resource manually by using
nsradmin on page 138 provides steps to create the NSR Hypervisor resource.
Note
If you created a NSR Hypervisor resource for VADP prior to the upgrade, then VMware
view will work.
3. In the VMware vCenter Server Appliance Console, click the Summary tab, and then
click the Stop button next to the Server service in the vCenter pane.
4. Click the SSO tab, and then select Embedded from the SSO deployment type drop-
down and assign a password. Click Save settings.
5. Click the Summary tab, and then click the Start button next to the Server service in
the vCenter pane. Log out of the session.
6. From a web browser, connect to the vSphere Web Client:
https://<IP_address_vCenter_Server>:9443/vSphere-client/
l Update extension
vApp l Export
l Import
l vApp application configuration
Virtual Machine
Note
In high-security environments, you can restrict the vCenter user account permissions
required to configure and administer the VMware Backup appliance. Table 9 on page 43
provides the account permission categories.
The following steps allow you to configure the EMC Backup and Recovery user or SSO
admin user by using the vSphere Web Client.
Procedure
1. From a web browser, access the vSphere Web Client.
https://<IP_address_vCenter_Server>:9443/vsphere-client/
4. On the left side of the page, click on vCenter Servers. It is important that you select
this from the root level of the tree structure (represented under Hosts and Clusters). If
you select the vCenter VM, the configuration fails.
5. Click the Manage tab and then select Permissions.
6. Click the Add permission (+) icon.
7. In the Users and Groups pane, click Add...
The Select Users/Groups dialog box appears.
10.Click OK.
11.From the Assigned Role drop-down list, select the role you created.
12.Confirm that the Propagate to children objects box is checked.
13.Click OK.
When connected, the EMC Backup and Recovery Configure window appears, as
shown in the following figure.
NOTICE
The EMC Backup and Recovery Configure window requires Adobe Flash player version
11.5 or later. If you do not have the appropriate version of Adobe Flash Player installed, a
message appears with a link to download. If you are still unable to connect after
installing Adobe Flash Player, then check the network configuration (IP address, DNS, and
so on) by logging into the VMware Backup appliance registration screen. If any of the
network information was incorrectly entered, you must re-deploy.
Note
When you use the FQDN or IP to register the vCenter server in this window and with
the NetWorker server, ensure that you specify only the FQDN or only the IP in both
instances, not a combination of the two.
Note
If the vCenter server host is different from the vSphere web server host, use
admin@system/domain as the user name along with the appropriate password.
10.In NetWorker Registration, type the details required to connect to the NetWorker
Server:
l NetWorker user name = VMUser (default).
l NetWorker password = changeme (default)
l NetWorker FQDN or IP
l NetWorker web service port = 8080 (default)
Note
2. Log in to the EMC Backup and Recovery Configure window by using the new EMC
Backup and Recovery password that you defined during configuration.
Results
When you open the EMC Backup and Recovery Configure window after registration, the
window in the following figure displays, allowing you to verify information about your
configuration and to ensure the required services are running.
Figure 12 EMC Backup and Recovery Configure window after registration
Status tab
The Status tab lists all of the services required by EMC Backup and Recovery and the
current status of each service. The following table describes these services.
Service Description
Core services Comprise the backup engine of the appliance. If these services are disabled
no backup jobs (either scheduled or “on demand”) will run, and no restore
activities can be initiated.
Management Stop these services only under the direction of technical support.
services
Note
When any service stops running, the action triggers an alarm on the vCenter server. When
the service restarts, vCenter clears the alarm. A delay of up to 10 minutes can occur
before vCenter clears or triggers an alarm.
Status tab 51
NetWorker VMware Protection
Results
To stop a service, click Stop next to the service on the Status tab of EMC Backup and
Recovery Configure window. In general, you should only stop running services under the
direction of Technical Support.
If you stop a service, you can attempt to restart it by clicking Start. In some cases,
additional troubleshooting steps may be required for the service to work properly.
admin@ebr169:/usr/local/avamar/bin/>: status.dpn
The end of the output indicates the current settings for backup window and
maintenance window start times.
Next backup window start time: Sat Sep 28 20:00:00 2013 IST
Next maintenance window start time: Sat Sep 28 08:00:00 2013 IST
2. Change the backup start time (in format HHMM) and duration (in format HHMM) by
running:
admin@ebr169:/usr/local/avamar/bin/>: status.dpn
The end of the output indicates the new backup window and maintenance window
start times:
Next backup window start time: Sat Sep 28 18:00:00 2013 IST
Next maintenance window start time: Sat Sep 28 14:00:00 2013 IST
Note
In order to use FLR, eth0 on the VMware Backup appliance and external proxy appliance
should be on the production network and eth1 on the backup network.
Note
In order to use Instant Access restore, which will mount a NFS Data-store on the ESX, the
backup network on the ESX may require a VMkernel port configured.
You can use a non-routable private address space for the subnet used for the backup
traffic/data, providing that all devices/vNICs using a private IP address exist on the same
physical switch and there is a DNS server on the non-routed private network so that the
proxies can perform a reverse lookup for its host name.
a. Right click the VMware Backup appliance and select Edit Settings. The Virtual
Machine Properties window appears
b. In the Hardware tab, click Add.
c. Select Ethernet Adapter and click Next.
d. In the Adapter Type field, change the value to VMXNET 3, and assign this vNIC to
the appropriate VM Port Group. Select the Connect at power on checkbox if it is not
selected.
e. Select the appropriate VM Port Group for the production network/VLAN, and then
click Next.
f. Verify the information and then click Finish.
5. Right click the VMware Backup appliance and select Power > Power On.
Verify that you associated the NIC to the correct network by running a ping to the IP. If
the IP is not reachable, you may need to swap the network for NICs. Right-click the
VMware Backup appliance and select Edit Settings, and in the Hardware tab, select
Network adaptor and Network connection on the right of the screen, as shown in the
following.
Figure 15 Swap network for NICs in the Virtual Machine Properties window
d. Select Network Settings and press Enter. The Network Settings dialog appears.
e. In the Overview tab, select the Second Ethernet Adapter labeled eth1.
f. Use the tab key to select Edit and press Enter.
g. From the Network Card Setup, use the tab key to access Statically assigned IP
Address and select using the spacebar. Use the tab key to select IP Address and
enter the IP Address, the Subnet Mask, and the host name of the VMware Backup
appliance for the backup network.
h. Use the tab key to select Next and press Enter.
i. From Network Settings, use the tab key to select Overview. Use the right-arrow key
to select Hostname/DNS. Use the Tab key to select and then specify the following
fields:
l Host name
l Domain name for the production network
l Policy for DNS configuration (use the default policy)
l Name Server 1 for production network
l Name Server 2 for backup network
l Domain Search for both production and backup network
j. From Network Settings, use the tab key to select Hostname/DNS. Use the right-
arrow key to select Routing, and set the Default Gateway to the gateway/address
for the production network if not already set.
k. Use the Tab key to select OK and press Enter.
l. Use the Tab key to select Quit and press Enter.
7. From a web browser, type https://<IP_address_VMware_Backup_appliance>:8543/
ebr-configure and follow the instructions in the section EMC Backup and Recovery
Configure window setup on page 47to configure the VMware Backup appliance.
Results
Once configured, the VMware Backup appliance shows up with production network
details in NMC.
After completing the VMware Backup appliance configuration, you can perform the dual
vNIC setup for the external proxy appliance.
3. When the blue splash-screen appears, right-click the proxy appliance and select
Power -> Shutdown Guest.
4. Add the second NIC to the proxy appliance:
a. Right click the proxy appliance and select Edit Settings.
b. In the Hardware tab, click Add.
c. Select Ethernet Adapter and click Next.
d. In the Adapter Type field, change the value to VMXNET 3, and assign this vNIC to
the appropriate VM Port Group. Select the Connect at power on checkbox if it is not
selected.
e. Select the appropriate VM Port Group for the production network/VLAN, and then
click Next.
f. Verify the information and then click Finish.
5. Right click the proxy appliance and select Power > Power On.
6. Configure the second NIC on the proxy appliance:
a. After you power on the proxy appliance, skip the registration and login as root to
the proxy appliance Console by using the vSphere Client.
b. Type yast2 to invoke Yast.
c. Select Network Devices and press Enter. The Network Devices dialog appears.
d. Select Network Settings and press Enter. The Network Settings dialog appears.
e. In the Overview tab, select the second ethernet adapter, labeled eth1.
f. Use the tab key to select Edit and press Enter.
g. From the Network Card Setup, tab to access Statically assigned IP Address and
select using the spacebar. Use the tab key to select IP Address and enter the IP
Address, the Subnet Mask, and the host name of the proxy appliance for the
backup network.
h. Use the tab key to select Next and press Enter.
i. From Network Settings, use the tab key to select Overview. Use the right-arrow key
to select Hostname/DNS. Use the Tab key to select and then specify the following
fields:
l Host name
l Domain name for the production network
l Policy for DNS configuration (use the default policy)
l Name Server 1 for production network
l Name Server 2 for backup network
l Domain Search for both production and backup network
j. From Network Settings, use the tab key to select Hostname/DNS. Use the right-
arrow key to select Routing, and set the Default Gateway to the gateway/address
for the production network if not already set.
k. Use the tab key to select OK and press Enter.
l. Use the tab key to select Quit and press Enter.
7. Reboot the proxy appliance. When prompted to register the appliance, register using
the IP address on the production network assigned to eth0 on your VMware Backup
appliance.
You can verify that backup traffic is outgoing by way of the second NIC on the proxy,
and incoming by way of the second NIC on the VMware Backup appliance, by
accessing the Performance Monitoring tab in the vSphere Client, if you set monitoring
to network traffic in real time.
Setting user privileges for the root user in the NetWorker server
Before you access the VMware Protection solution in NMC to create and assign policies,
you must assign the appropriate user privileges to the root user in the user group of the
NetWorker server.
Procedure
1. Run nsradmin from a Windows command line or UNIX terminal.
2. Type the following command:
3. When prompted with the question "Create?", type Y, and then exit from nsradmin.
4. From NMC, navigate to NetWorker Administration > Configuration > User Groups.
5. Select the created user group for the root user and type the following in the Users
field:
username@VBA node
Results
NetWorker automatically creates a default device for the VMware Backup Appliance,
based on the media type AFTD, for the VMware Backup Appliance’s internal storage. This
resource appears in the Devices window when you click the Devices tab.
You can access most of the options for the VMware Protection solution by selecting the
Configuration tab, as shown in the following figure.
Figure 16 Configuration tab in the NMC Administration window
Three selections related to VMware Protection appear in the lower part of the left pane,
described in the following sections:
l VMware Backup Appliance in NMC on page 60
l VMware Protection Policies in NMC on page 62
l VMware View in NMC on page 67
Additionally, the Monitoring tab provides the following options:
l Starting a policy manually from the NMC Monitoring window on page 72
l Stopping a policy from the NMC Monitoring window on page 72
l Viewing policy progress from the NMC Monitoring window on page 72
l Decommissioning the VMware Backup Appliance in NMC on page 72
NMC automatically retrieves information about the VMware Backup Appliance, including
the following details and health information:
l vCenter host
l Policies pushed to the VMware Backup Appliance
l List of External proxy hosts
l Total internal storage capacity
l Used internal storage capacity
Note
When you restrict the transport mode to Hotadd only, backups will fail for any VM that
does not meet the Hotadd criteria as outlined in the VMware knowledgebase article
2048138. When such a failure occurs, the EMC Backup and Recovery policy only
reports that the backup was “Interrupted.” The correct status displays when you run
the following command:
NetWorker automatically applies the default VMware Protection policy to all VMware
Backup Appliances after you register the first appliance, and enables the policy to run
once every 24 hours starting at 21:00. NetWorker saves the backups created by this
policy on the internal storage of the appliance. The backup level used is determined by
the levels defined in the Default schedule, and a one month data retention policy is used.
2. On the Definition tab of the Create VMware Policy window, type a descriptive name
for the policy, and specify a Start Time and Interval. NetWorker provides default values
in these fields. In the following figure, a policy named BackuptoDDRandClone is being
created to backup and clone VMs to a Data Domain system.
Figure 21 Create VMware policy window
Note
3. To create the VMware action (for example, action type=VMware backup), click the
New button in the VMware Actions pane. The following page displays.
Figure 22 Create VMware Action window
Note
Currently, the VBA checkpoint discover action cannot be specified before the
VMware backup action. The EMC NetWorker 8.2 Release Notes provide more
information about this issue (NW154275).
l VBA checkpoint backup — performs a checkpoint backup of the VMware Backup
appliance at a scheduled time (typically once daily) to be used in case of a
disaster recovery. This action must occur after the checkpoint discover action.
Note
You can only perform a VBA checkpoint backup to a Data Domain pool.
l VMware backup — performs a backup of the VMware Backup appliance to internal
storage or a Data Domain system. You can only perform one VMware backup
action per VMware Protection policy. The backup action must occur before clone
actions.
Note
targets). You can specify multiple clone actions. Clone actions must occur after the
VMware backup action. You can also clone a VBA checkpoint backup, but only to a
Data Domain destination pool.
Note
Cloning to tape will clone a full backup each time, even if the VMware backup is an
incremental backup. When cloning to tape, ensure that tapes contain sufficient
space for the full backup.
e. Select a retention policy for Index Management, or use the default value.
f. On the Schedule tab, NetWorker uses the default VMware Incremental Forever
schedule. You can use the default schedule, select an alternate schedule from the
drop-down, or click the green + to create a new schedule or edit a schedule.
Note
When you select a schedule for clone actions, EMC recommends a weekly or
monthly schedule, depending on your requirements, due to the time required to
complete this action. Since save sets are synthesized on the source Data Domain
device after performing an incremental backup, a scheduled clone will clone the
entire save set chain, including data from previous backups.
When you click OK to create the VMware backup action, the Create/Edit VMware
Protection Policy window displays again, with the new action in the VMware
Actions pane, along with all of the policy details. You must now assign a VMware
Backup Appliance to the policy.
Note
If you do not select a VMware Backup Appliance for the policy, NMC displays a
warning message indicating there is no appliance attached to this policy, and asks if
you want to proceed. If this warning displays, click No, and then return to this window
to assign a VMware Backup Appliance.
Figure 23 Select a VMware Backup Appliance in the Create/Edit VMware Protection Policy
window
When you complete these steps, the following page displays, showing the completed
VMware Protection Policy and associated actions. A map also appears at the bottom
of the window displaying a visual representation of the policy and actions.
Figure 24 VMware Protection policy with associated actions
To avoid waiting until all backups complete before the clone action begins, you can
choose to make the operations concurrent, similar to NetWorker’s immediate cloning
option which allows a group to start cloning upon each save set completion.
To enable and mark actions to run concurrently with their preceding actions, open the
Create VMware Policy or Edit VMware Protection Policy window, and then select the
appropriate checkboxes under the Definition tab, as shown in the following figure.
Figure 25 Enable and mark actions concurrent in Create VMware Policy window
Once you create the policy and complete the Actions, select the VMware backup
appliance that the policy applies by selecting the VMware Backup Appliance Selection
tab, available from the Create VMware Policy or Edit VMware Protection Policy windows.
Note
After upgrading to NetWorker 8.2, VMware View may not be visible. The section Enable
VMware View in NMC after upgrading by creating a NSR Hypervisor resource on page 42
provides more information.
You can refine items displayed in the right details pane by selecting containers in the
Virtualization node hierarchy in the left pane. For example, if an individual Cluster is
selected in the Virtualization node, only child elements associated with that Cluster
display.
You can also filter the visible items to show only protected VMs, unprotected VMs, or
overprotected VMs, by clicking the links located above the right pane, as shown in the
following figure.
Figure 28 Filtering results in VMware View
Content button. These operations are also available by right-clicking in the details
pane.
l Moving the display: You can move the graphical display by left-clicking in the details
pane and dragging the mouse cursor.
l Expanding and collapsing containers: You can expand or collapse any container in
the map view to display or hide the child elements associated with the container by
double-clicking the container.
l Overview: You can display an overview of the map view by selecting the Overview tab
within the Overview pane. The overview of the map view is particularly useful for large
maps and allows you to quickly drill down to specific areas in the map.
l Filter: You can limit items displayed and search for specific items in the map view by
using the Filter VM by and Show functions, available from the Filter tab within the
Overview pane.
The filtering function works the same in table view as in map view. Links provided above
the details pane allow you to display only overprotected VMs, unprotected VMs, or all
VMs in the environment. The NetWorker Administration Guide provides general
information on using tables in the NetWorker Console.
Note
In table view, the Host field contains an undefined value for VMs or containers that are
part of a cluster. The map view provides a link to the cluster.
When you select a policy, VMware View refreshes and displays the new association.
3. To assign a policy at the VMDK level, expand a VM and highlight the VMDK(s) you
want to associate to the policy, and then right-click and select Add Policy-VBA. Ensure
that you select a policy that has been specifically configured to back up VMDKs using
the backup type option specified in the section Setup and configure policies in
NMC on page 62.
Note
Disconnecting an ESX server from its vCenter server only temporarily disconnects the
server and does not remove it. To permanently remove the ESX server from the vCenter
inventory, use the Remove command from vCenter.
Use caution when you completely remove references of a VMware Backup appliance
from the NetWorker Server as this erases all the backups, clones, and configuration
information. Before you decommission the VMware Backup Appliance in NMC, review
the section Decommissioning the VMware Backup Appliance on page 101.
NMC includes the option to decommission a VMware Backup Appliance when problems
occur. To decommission the appliance, right-click the appliance and select
Decommission from the drop-down. The dialog shown in the following figure displays.
Figure 31 Decommissioning the VMware Backup Appliance in NMC
Web Client that connects to the VMware Backup appliance, allowing you to perform
several operations including:
l Assign VMs/VMDKs to policies created in NMC
Note
Since this same functionality, described in the section Assigning policies within
VMware View on page 71, is available within NMC, EMC recommends that you only
use NMC to assign VMs/VMDKs to policies.
l Ad-hoc VM backups (also known as Backup Now functionality)
l Image-level (FULLVM) recoveries
l View reports and log files for policies run
l Configuration options such as email notifications
The following sections provide more information about using the EMC Backup and
Recovery user interface in the vSphere Web Client:
l Benefits of EMC Backup and Recovery user interface in the vSphere Web Client on
page 73
l Deduplication store benefits on page 74
l Image-level Backup and Restore on page 74
l Connecting to the EMC Backup and Recovery user interface in the vSphere Web
Client on page 75
l Available tasks in the EMC Backup and Recovery user interface on page 76
l Assigning VMs/VMDKs to a policy on page 81
l Manually starting the backup policy using Backup Now on page 83
l Stopping a policy in the EMC Backup and Recovery user interface on page 83
l Viewing policy progress in the vSphere Web Client on page 83
Note
You cannot use the VMware Backup appliance without a vCenter Server. In linked mode,
the appliance works only with the vCenter to which it is associated.
Benefits of EMC Backup and Recovery user interface in the vSphere Web Client
The EMC Backup and Recovery user interface provides the following benefits:
l Provides fast and efficient data protection for all of your VMs/VMDKs, even those
migrated between ESX hosts.
l Significantly reduces disk space consumed by backup data by using patented
variable-length deduplication with every backup operation. The section
Deduplication store benefits on page 74 provides more information.
l Reduces the cost of backing up VMs and minimizes the backup window by using
Changed Block Tracking (CBT) and VM snapshots.
l Allows for easy backups without the need for third-party agents installed in each VM.
l Uses a simple, straight-forward installation as an integrated component within EMC
Backup and Recovery, which is managed by a web portal.
l Provides direct access to EMC Backup and Recovery configuration integrated into the
vSphere Web Client.
Benefits of EMC Backup and Recovery user interface in the vSphere Web Client 73
NetWorker VMware Protection
reduces data transfer within the EMC Backup and Recovery environment during a
recovery operation and reduces the recovery time.
Additionally, EMC Backup and Recovery automatically evaluates the workload between
both restore methods (full image restore or a recovery leveraging CBT) and performs the
method that results in the fastest restore time. This is useful in scenarios where the
change rate since the last backup in a VM being restored is very high and the overhead of
a CBT analysis operation would be more costly than a direct full-image recovery.
The advantages of image-level backups are:
l Provides full image backups of VMs, regardless of the guest operating system
l Utilizes the efficient transport method SCSI hotadd when available and properly
licensed, which avoids copying the entire VMDK image over the network
l Provides file-level recovery from image-level backups
l Deduplicates within and across all .vmdk files protected by the EMC Backup and
Recovery appliance
l Uses CBT for faster backups and recoveries
l Eliminates the need to manage backup agents in each VM
l Supports simultaneous backup and recovery for superior throughput
Connecting to the EMC Backup and Recovery user interface in the vSphere Web
Client
Procedure
1. From a web browser, open the vSphere Web Client:
https://IP_address_vCenter_Server:9443/vsphere-client/
Note
If you receive an SSL certificate error in your web browser, refer to the VMware
knowledgebase article 1021514 at the following link:
http://kb.vmware.com/selfservice/microsites/search.do?
language=en_US&cmd=displayKC&externalId=1021514
2. In the Credentials window, type the vCenter user name and password for the
dedicated EMC Backup and Recovery user you created and then click Login.
3. In the vSphere Web Client, select EMC Backup and Recovery.
4. In the Welcome to EMC Backup and Recovery window, select a Backup Appliance from
the drop-down. The drop-down lists all the VMware Backup appliances registered in
the vCenter.
Each vCenter Server supports up to 10 appliances. The EBR Appliance field, as shown
in the following figure, displays the appliance names alphabetically in a drop-down
list. In the EMC Backup and Recovery user interface, the name of the active appliance
displays on the left pane, and the appliance name in the drop-down list is the first in
the list of available appliances.
Connecting to the EMC Backup and Recovery user interface in the vSphere Web Client 75
NetWorker VMware Protection
5. Click Connect.
Note
The maximum retry attempts for the VMware Backup appliance to connect to the
vCenter is two. Further attempts to connect to the vCenter requires restarting the EMC
Backup and Recovery server by typing the following command:
ebrserver.pl --restart.
The EMC Backup and Recovery user interface consists of five tabs:
l Getting Started — provides an overview of functionality within the EMC Backup and
Recovery user interface along with quick links to assign VMs to a policy and perform
restores.
l Backup — provides a list of scheduled backup policies as well as details about each
policy created in NMC. This window enables users to add the VMs/VMDKs you want
to protect to the policies, and to run policies on demand. About the Backup Tab on
page 77 provides additional information on adding VMs to the backup policies and
starting backup policies on demand.
l Restore — provides a list of successful backups that you can restore. About the
Restore Tab on page 78 provides additional information.
l Reports — provides backup status reports for the VMs on the vCenter Server that you
added to the policy. About the Reports Tab on page 78 provides additional
information.
l Configuration — displays EMC Backup and Recovery configuration information and
allows you to edit some of these settings. Also allows you to run integrity checks (for
example, checkpoint creation and validation). About the Configuration Tab on page
78 provides additional information.
The following sections describe the contents of the tabs.
Column Description
Name The name of the backup policy.
State Whether the backup policy is enabled or disabled. Disabled backup policies will
not run. Also, a “No Schedule” state displays when you disable Autostart in NMC
for a policy.
Next Run The policy will run again at this scheduled time.
Time
Success The number of VMs that were backed up successfully the last time the backup
Count policy ran.
This number updates after each backup. Changes to a policy between backups
will not be reflected in this number until after the policy runs again. For example,
if a backup reports that 10 VMs successfully backed up, and then you edit the
policy so that only one VM remains, this number remains at 10 until the policy
runs again and, if successful, the number changes to one.
Failure Count The number of VMs that did not back up successfully the last time the backup
policy ran.
This number updates after each backup. Changes to a policy between backups
will not be reflected in this number until after the policy runs again. For example,
if a backup reports that 10 VMs failed to back up, and then you edit the policy so
that only one VM remains, this number remains at 10 until the policy runs again
and, if the backup fails, the number changes to one.
Figure 34 Backup policies in the EMC Backup and Recovery user interface
l Display name
l Product name
l IP Address
l Major Version
l Minor Version
l Status
l Host
l vCenter Server
l NetWorker Server
l EBR backup user
l EBR appliance time
l Time zone
You can configure these options during the VMware Backup appliance installation. You
can also edit these options by using the EMC Backup and Recovery Configure window.
Post-Installation configuration in the EMC Backup and Recovery Configure window on
page 50 provides additional details.
Configuring Email
You can send SMTP email reports to specified recipients when you enable email
notification. The email includes the following information:
l VMware Backup appliance status
l Backup jobs summary
l Virtual machines summary
Email configuration requires the information defined in the following table.
Outgoing mail Enter the name of the SMTP server you want to use to send email. You can
server enter this name as either an IP address, a host name, or a FQDN. The
VMware Backup appliance needs to be able to resolve the name entered.
The default port for non-authenticated email servers is 25. The default port
of authenticated mail servers is 587. You can specify a different port by
appending a port number to the server name. For example, to specify the
use of port 8025 on server “emailserver” enter:
emailserver:8025
My server requires Check this box if your SMTP server requires authentication.
me to log in
Password Enter the password associated with the username. EMC Backup and
Recovery does not validate the password.
Send time From the drop-down list, choose the time you want EMC Backup and
Recovery to email the reports.
Send days Check the days that you want EMC Backup and Recovery to send the reports.
Report Locale From the drop-down list, choose the locale for the email reports. en-us is the
default.
Note
EMC Backup and Recovery email notification does not support carbon copies (CCs), blind
carbon copies (BCCs), and SSL certificates.
Before you configure email notifications, ensure that the email account that sends the
email reports exists.
Procedure
1. From the EMC Backup and Recovery user interface, select the Configuration tab.
2. Select Email.
3. In the bottom right corner of the window, click the Edit button.
4. Specify the following:
a. Enable email reports
b. Outgoing mail server
c. (optional) My server requires me to log in
d. User name
e. Password
f. From address
g. To address(es)
h. Send day(s)
i. Send time
j. Report Locale
5. Click the Save button.
Results
To test your email configuration, click Send test email.
You can assign collections of VMs (such as all VMs in a datacenter), individual VMs, and
VMDKs to be included in a policy backup using the EMC Backup and Recovery user
interface in the vSphere Web Client. If you select an entire resource pool, host,
datacenter, or folder, any new VMs in that container are included in subsequent backups.
If you select a VM, then any disk added to the VM is included in the backup. If you move
the VM from the selected container to another unselected container, then the VM is no
longer part of the backup.
You can also manually select a VM to be backed up, which ensures that NetWorker backs
up the VM, even when you move the VM.
Note
EMC Backup and Recovery will not back up the following specialized VMs:
-VMware Backup appliances
-VMware Data Protection (VDP) Appliances
-Templates
-Secondary fault tolerant nodes
-Proxies
-Avamar Virtual Edition (AVE) Servers
The Wizard allows you to select these VMs; however, when you click Finish the Wizard
displays a warning that the job does not contain these special VMs.
Procedure
1. Select EMC Backup and Recovery in the vSphere Web Client.
2. On the Getting Started tab, select Assign Backup Policies. The Backup tab displays,
which shows the available policies in upper half of the window, and the Backup Policy
Details in the lower half.
The policy description matches the description in NMC (for example, Default). Backup
to internal disk means that any VMs you assign to this default policy will go to the
storage of the deployed VMware Backup appliance. When you perform backups to the
internal storage of a VMware Backup appliance, these details appear in NMC and as
part of the policy description in EMC Backup and Recovery in vCenter.
Note
You can only assign VMs/VMDKs to the policies that you create in NMC.
1. Figure 37 Selecting at VMDK level in EMC Backup and Recovery user interface
5. Click Finish. A dialog box displays to indicate that the backup policy was saved
successfully.
Results
To return at any time to the Backup Policy Details window and verify which VMs that you
selected, click Edit. This information also appears in the lower half of the window, in the
Show Items link next to the Sources field.
Note
If you disabled Backup Now functionality in the NSR VBA Server Properties window in
NMC, as described in the section VMware Backup Appliance in NMC on page 60, a
message displays when you click this button indicating that Backup Now is locked and
not available.
Otherwise, you can wait for NetWorker to start the backup policy based on the scheduled
start time.
After the backup completes, you can recover the backed up VMs in the vSphere Web
Client or perform a file-level restore by using the EMC Data Protection Restore Client.
Note
Note
Once you perform a restore from a secondary VMware Backup appliance for a
particular VM's restore point, you can no longer use this restore point for Instant
access or VMDK level restores. You can use file-level restore or image-level restore as
an alternative to restore the data. The knowledgebase article 196887, available at
http://support.emc.com, provides more details.
3. Expand the VM that you want to restore. You can filter by using the Filter drop-down to
show a specific VM and related items. You can also browse to the VMDK level and
select a single VMDK for restore if you only want to restore that disk.
4. Select a restore point and click Restore. The Restore backup wizard launches.
5. On the Select Backup page, select the correct restore point (the wizard displays all
restore points for the backup by date and time). Typically, you only select one restore
point at a time. Click Next.
6. On the Set Restore Options page, specify where you want to restore the backup:
l Restore to Original Location — when you select Restore to Original Location, then
the backup restores to its original location. If the VMDK file still exists at the
original location, then the restore process overwrites the file.
l Restore to New Location — when you unselect Restore to Original Location, you
can then specify a new location (new Name, destination, and datastore) where the
VM/VMDK will be restored.
Optionally, set the VM to Power On and Reconnect NIC after the restore process
completes. Click Next.
Note
Reconnect NIC is enabled by default and greyed out. Only when you select Power
On are you given the option to unselect Reconnect NIC.
7. On the Ready to complete page, verify the selections. The wizard displays a summary
of the number of machines that will be replaced (restore to the original location) and
the number of machines that will be created (restore to a new location).
Results
To change any of the settings for your restore request, either use the Back button to
return to the appropriate screen, or click on the appropriate numbered step title to the
left of the wizard. If the settings are correct, then click Finish. If the settings are not
correct, then click Back to go back to create the correct configuration.
The Restore wizard displays a message that the restore process initiated successfully.
Click OK. You can monitor the Restore progress by using the Recent Tasks pane.
Note
If you selected Reconnect NIC during the restore process, then confirm that the network
configuration for the newly-created VM. Once the restore completes, the new VM NIC
might use the same IP address as the original VM, which will cause conflicts.
When the recovery starts, a recovery session also displays in NMC. Any activities that
occur on the vCenter side are visible on the NMC side.
When you click Finish, the Data Domain system gets added as a datastore to the ESX
server, and the VM gets created within the datastore.
Note
Before using this option, ensure that you establish a connection to the VMware Backup
appliance by selecting the EMC Backup and Recovery user interface in the vSphere Web
Client.
l A vSphere host that is currently managed by the vCenter Server must be temporarily
disassociated from the vCenter Server to perform the emergency restore. To
disassociate the vCenter Server, use the vSphere Client (not the vSphere Web Client)
connected directly to the vSphere host.
l You must have adequate free space in the target datastore to accommodate the
entire VM. The target VMFS datastore to which the VM is being restored must support
the VMDK file size
l Network connectivity must be available for the restored VMs from the ESX host
running the VMware Backup Appliance
l You must have at least one local account with administrator privileges on the ESX
host running the VMware Backup Appliance
Figure 41 Emergency Restore in the EMC Backup and Recovery Configure window
Procedure
1. Log in to the vSphere Client of the ESX host.
2. In the vSphere Client, right-click on the ESX host that the VMware Backup Appliance
resides on:
a. Select Disconnect.
b. Click Yes when prompted to disassociate the ESX host from its vCenter.
3. Log in to the EMC Backup and Recovery Configure window at https://
<IP_address_VMware_Backup_Appliance>:8543/ebr-configure/.
4. In the EMC Backup and Recovery Configure window, select the Emergency Restore tab
The Emergency Restore dialog box lists VMs protected by the VMware Backup
Appliance. Click Refresh to view the most recent available VM backups. Highlight a
VM and click the down arrow to view the date and time of previous backups.
5. Select the VM that will serve as the restore point and click Restore.
The Host Credentials dialog box displays.
6. In the Host Credentials dialog box, enter the valid ESX host credentials for the
following fields:
a. ESXi hostname or IP address – enter the host name or IP address of the ESXi
hosting the VMware Backup Appliance
b. Port – pre-populated with the default port, 443
c. Username – enter the username for ESX host. The recommended host username is
root. For any other host username, you must assign the Create VM privilege to the
user account
d. Password – enter the password for the ESX host.
7. Click OK to continue.
The Restore a Backup dialog box displays.
8. Enter a new name in the New Name field. The name must be unique and can be up to
255 characters long.
Note
CAUTION
The datastore capacity size is listed. Make sure you select a datastore with enough
disk space to accommodate the restore. Insufficient space causes the restore to fail.
10.Click Restore.
11.In the vSphere Client, right-click on the ESX host that the VMware Backup Appliance
resides on:
a. Select Connect.
b. Click Yes when prompted to associate the ESX host back with its vCenter.
12.Verify that the restore was initiated successfully by checking the progress in the
Recent Tasks window in the vSphere Web Client.
Note
The restored VM is listed at the vSphere host level in the inventory. Restoring to a
more specific inventory path is not supported.
File-level restore
Use the EMC Data Protection Restore Client interface to perform file-level restore (FLR).
The following sections provide information about FLR:
l Restoring specific folders or files to the original VM on page 90
l Restoring specific folders or files from a different VM on page 93
l FLR limitations on page 93
Note
Before you start a file-level restore, review the limitations specified in the section FLR
limitations on page 93 to ensure that you can perform FLR in your configuration.
http://VMware_Backup_appliance_host:8580/flr
Note
The browser must point to a VMware Backup appliance from the VM that is being
restored using FLR, and you must be part of the Administrators group to perform FLR
restore.
2. When you log in, the Manage Mounted Backups dialog displays, as shown in the
following figure. Click Mount to mount a restore point.
Figure 43 Manage Mounted Backups in EMC Data Protection Restore Client
Note
When you click Mount, if a folder hierarchy does not appear, the file system in use on
the VM may not be supported. The section FLR limitations on page 93 provides more
information.
3. Browse the files and select files to recover, then click Restore selected files.
File-level restore 91
NetWorker VMware Protection
4. In the Select Destination window, select the folder to which you want to restore the
VM, as shown in the following figure.
Figure 45 Select Destination window
Note
When using the Advanced login, ensure that you launch the EMC Data Protection Restore
Client from a VM that has been backed up using the same VMware Backup appliance,
and that the user you specify for the vCenter login has the necessary permissions to
perform FLR restore. These permissions are typically the same as the user role specified
in the section Creating a dedicated vCenter user account and EMC Backup and Recovery
role on page 42.
FLR limitations
The following limitations apply to file-level restores:
l EMC Backup and Recovery does not support restoring specific folders or files to a
different VM.
l You must install VMware Tools to use FLR. For best results, ensure that all VMs run
the latest available version of VMware Tools. Older versions are known to cause
failures when browsing during the file-level restore operation.
l All VMs must belong to the vCenter dedicated to EMC Backup and Recovery. Multiple
vCenters are not supported.
l FLR does not support the following virtual disk configurations:
n Unformatted disks
n Dynamic disks
n FAT16 file systems
n FAT32 file systems
n Extended partitions (Types: 05h, 0Fh, 85h, C5h, D5h)
n Two or more virtual disks mapped to single partition
n Encrypted partitions
n Compressed partitions
l FLR of ext4 or GPT file systems is supported only with external proxies. To perform FLR
of ext4 or GPT file systems, you must disable the internal proxies from the NSR VBA
Server Properties window in NMC, as described in the section VMware Backup
Appliance in NMC on page 60.
l FLR does not support direct restore from a cloned backup. To recover individual files
from a clone, you must first perform an image-level recovery of the clone. This creates
a primary copy on the EMC Backup and Recovery appliance, from which you can then
perform FLR.
l FLR does not restore ACLs.
l FLR does not restore or browse symbolic links.
l FLR cannot restore more than 5,000 folders or files in the same file-level restore
operation.
l FLR cannot browse more than 14,498 folders or files in the same file-level restore
operation.
File-level restore 93
NetWorker VMware Protection
l When you create partitions, fill the lower ordered indices first. That is, you cannot
create a single partition and place it in the partition index 2, 3, or 4. You must place
the single partition in partition index 1.
l FLR of Windows 8 and Windows Server 2012 VMs does not support the following file
systems:
n Deduplicated NTFS
n Resilient File System (ReFS)
n EFI bootloader
Viewing Alarms
EMC Backup and Recovery can trigger the following alarms:
EBR: [002] The VMware Backup The VMware Backup appliance is nearly out of space for
appliance is nearly full. additional backups. You can free space on the appliance by
manually deleting unnecessary or older backups and by
changing retention policies on backup jobs to shorten the time
that backups are retained.
EBR: [003] The VMware Backup The VMware Backup appliance has no more space for
appliance is full. additional backups. The appliance will run in read-only (or
restore-only) mode until additional space is made available.
You can free space on the appliance by manually deleting
unnecessary or older backups and by changing retention
policies on backup jobs to shorten the time that backups are
retained.
EBR: [004] The VMware Backup The datastore where the VMware Backup appliance
appliance datastore is provisioned its disks is approaching maximum capacity. When
approaching maximum the maximum capacity of the datastore is reached, the VMware
capacity. Backup appliance will be suspended. The appliance cannot be
resumed until additional space is made available on the
datastore.
EBR: [005] Core services are not Start Core services using the EMC Backup and Recovery
running. Configure window.
EBR: [006] Management Start Management services using the EMC Backup and
services are not running. Recovery Configure window.
EBR: [007] File system services Start File system services using the EMC Backup and Recovery
are not running. Configure window.
EBR: [008] File level restore Start File level restore services using the EMC Backup and
services are not running. Recovery Configure window.
EBR: [009] Maintenance Start Maintenance services using the EMC Backup and
services are not running. Recovery Configure window.
EBR: [010] Backup scheduler is Start Backup scheduler using the EMC Backup and Recovery
not running. Configure window.
Viewing Alarms 95
NetWorker VMware Protection
l Error— “EMC Backup and Recovery: Appliance has changed from Full Access to Read
Only.”
EMC Backup and Recovery generates events on all state changes in the appliance. As a
general rule, state changes that degrade the capabilities of the appliance are labeled
errors, and state changes that improve the capabilities are labeled informational. For
example, when starting an integrity check, EMC Backup and Recovery generates an event
that is labeled an error because the appliance is set to read-only before performing the
integrity check. After the integrity check, EMC Backup and Recovery generates an
informational event because the appliance changes from read-only to full access.
Selecting an event entry displays details of that event, which includes a link to Show
related events.
Thick provisioning allocates all of the required storage when the disk is created. The best
practice for the EMC Backup and Recovery datastore is to create a thin provisioned disk
when the EMC Backup and Recovery appliance is deployed (this allows for rapid
deployment), and then convert the disk from thin provisioning to thick provisioning after
deployment.
Note
See the VMware documentation for details on inflating thin provisioned disks to thick
provisioned disks. This procedure requires that you shut down the VMware Backup
appliance. This may take several hours to complete.
nsrmm -d -S ssid/cloneid
When you delete a backup from NetWorker, the corresponding backup will also be
deleted from the EMC Backup and Recovery appliance.
Deleting a volume
You can delete a default VMware Backup appliance volume or user-defined Data Domain
device volume that contains VMware Backup appliance backups after you unmount the
devices. If the backups cannot be deleted from the VMware Backup appliance, then the
volume deletion operation fails.
Volume relabeling
You can relabel a default VMware Backup appliance volume or user-defined Data Domain
volume that the VMware Backup appliance uses in the same method as any other
volume. The relabel operation deletes all the VMware Backup Appliance backups that
belong to the volume associated with the device from both NetWorker and the VMware
Backup Appliance server. If the backups cannot be deleted from the VMware Backup
Appliance, then the device relabel operation fails.
Creating a checkpoint using the EMC Backup and Recovery user interface
You can create a validated checkpoint by using the command line or the EMC Backup and
Recovery user interface in the vSphere Web Client. The section Preparing the VMware
Backup appliance for disaster recovery on page 102 provides information on creating
and validating checkpoints from the command line.
Procedure
1. Navigate to the Configuration tab.
2. Select the Run integrity Check option, as shown in the following figure.
Figure 47 Run Integrity Check button in EMC Backup and Recovery user interface
Note
NetWorker does not support disaster recovery from a checkpoint backup that was
taken using an OVA earlier than the currently installed version. For example, if you
upgrade to a NetWorker 8.2 server and OVA 1.1.09.147 from NetWorker 8.1 SP1 and
OVA 1.0.1.9, you cannot perform a disaster recovery from a checkpoint backup
created with OVA 1.0.1.9. Backup and restore operations will hang in "Waiting:
Queued" state.
Cross Sync
A Cross sync operation synchronizes the VMware Backup appliance and NetWorker
databases for backups, triggered automatically upon VMware Backup appliance rollback.
You can also perform cross sync manually from the command line to check the
consistency of the NetWorker metadata. Before you perform a cross sync, ensure that the
VMware Backup appliance is online.
Note
After running the scanner command to recover the media database, you must manually
perform a cross sync in order to cross sync with the VMware Backup appliances and set
primary clone IDs correctly.
Use the following command to manually perform cross sync from the command line of the
NetWorker server:
where:
l -S initiates the VMware Backup appliance cross sync
l -h specifies the VMware Backup appliance server name
l -t is an optional parameter that specifies the last checkpoint time. EMC Backup and
Recovery performs cross sync for the backups that occur only after the specified time.
Specify the time in a format that NetWorker accepts. The nsr_getdate man page
provides information on acceptable formats.
l -f synchronizes the entire database and deletes out of sync backups. If the backups
exist only on the VMware Backup appliance, then you can only delete the backups by
using this option.
To cross sync the entire database, specify -f without specifying the time.
If you do not specify a time when you perform a manual cross sync, NetWorker retrieves
the most recent validated checkpoint from the VMware Backup appliance and performs a
cross-sync starting from that time.
If you perform cross sync on an entire database where the database is very large, it may
take longer than normal to synchronize.
Cross sync generates the following events in NMC:
l “Cross sync with appliance name VMware Backup Appliance is started.”
l “Cross sync with appliance name VMware Backups Appliance is successful for
configuration and backups.”
Use caution when you completely remove references of a VMware Backup appliance from
the NetWorker Server as this erases all the backups, clones, and configuration
information.
The decommissioning process deletes all backup metadata on the appliance node, if the
operation is successful. If an error occurs, you will be provided with one of the following
options:
l Abort the decommission.
l Continue without further contact with the VMware Backup appliance, and
decommission the appliance only from NetWorker.
If you confirm to continue decommission, this will:
l Remove all the save sets/clones from their respective volumes and the media
database.
l Delete the NSR Client resource associated with the VMware Backup Appliance.
l Delete the NSR VMware Backup Appliance Server RAP resource.
l Remove the VMware Backup Appliance entry from all policies referencing it.
Disaster Recovery
NetWorker VMware Protection is robust in its ability to store and manage backups. In the
event of failure, as a first course of action, rollback to a known validated checkpoint. To
recover from a VMware Backup appliance failure, refer to the following disaster recovery
guidelines.
Note
NetWorker VMware Protection does not support a disaster recovery of data backed up to
Avamar storage when the internal AFTD metadata is lost.
Note
When you use ssh to connect or login to the EMC Backup and Recovery console, ensure
that you login as admin instead of root. The section Log in to the EMC Backup and
Recovery Console as admin instead of root on page 120 provides more information.
Procedure
1. If you do not have a recent checkpoint or want to create a new checkpoint backup,
create the checkpoint by running the following command:
Validation takes some time to complete. Keep checking the status by running mccli
checkpoint show.
4. Add two actions for the VMware Protection Policy within NMC, in the following order:
a. VMware checkpoint discover action.
b. VMware checkpoint backup action.
Note
You can only perform a checkpoint backup to a Data Domain pool. The section
Setup and configure policies in NMC on page 62 provides more information about
configuring a policy with VMware Actions in NMC.
Optionally, you can add a clone action after the checkpoint backup action to clone
the checkpoint backup to a Data Domain system, AFTD, or tape.
Note
Although the 0.5TB appliance contains 3 * 256 GB disks and the 4TB appliance
contains 6 * 1TB disks, only one checkpoint save set gets created on NetWorker for all
the disks. Ensure that you know which VMware Backup appliance (0.5 or 4TB) you
deployed before performing disaster recovery. This information is not required when
performing the checkpoint backup, but it will be required during re-deployment of the
appliance as part of the disaster recovery.
To help identify the deployed appliance and verify the checkpoint backup, you can
view log messages within NMC’s daemon log file, and within the policy logs (located
in /nsr/logs/policy).
For any disaster recovery, you must repeat any changes previously made to the
configuration files (for example, the changes performed in the section Restrict mapping
of datastores on page 47).
Procedure
1. Redeploy the VMware Backup appliance with the same network configuration, and
use the Override button within the EMC Backup and Recovery Configure window.
Note
Ensure that the password for the system you plan to recover to matches the password
for the system that the checkpoint was taken from.
2. Re-register the proxies with the redeployed VMware Backup appliance by running the
following command from each external proxy, or reboot the external proxy:
#/usr/local/avamarclient/etc/initproxyappliance.sh start
3. Navigate to the Configuration tab in NMC and highlight VMware Backup Appliance in
the lower left pane.
4. In the right pane, right-click the VMware Backup Appliance and select Start VBA
Recover for Checkpoints, as shown in the following figure. A list of checkpoint
backups display.
Figure 49 Start VBA Recover for Checkpoints in NMC
5. Select the checkpoint backup you want to rollback to, then click OK. After clicking OK,
the following events occur:
a. The status of the VMware Backup Appliance changes to recover pending, and the
recovery takes 10-15 minutes to complete.
b. Upon successful recovery, the status of the VMware Backup Appliance changes to
query pending.
Complete disaster recovery of the VMware Backup appliance and the Data Domain
or tape device
The following section describes the steps required for a complete disaster recovery,
where you need to restore both the connection to the VMware Backup appliance, and the
device (Data Domain or tape device) that has completely failed:
l Prerequisites for performing a complete disaster recovery on page 105
l Performing a complete disaster recovery on page 105
Note
Ensure that the password for the system you plan to recover to matches the password
for the system that the checkpoint was taken from.
2. Re-register the proxies with the redeployed VMware Backup appliance by running the
following command from each external proxy, or reboot the external proxy:
#/usr/local/avamarclient/etc/initproxyappliance.sh start
3. Navigate to the Configuration tab in NMC and highlight VMware Backup Appliance in
the lower left pane.
4. In the right pane, right-click the VMware Backup Appliance and select Start VBA
Recover for Checkpoints, as shown in Figure 49 on page 104. A list of checkpoint
backups display.
Complete disaster recovery of the VMware Backup appliance and the Data Domain or tape device 105
NetWorker VMware Protection
5. Select the checkpoint backup you want to rollback to, then click OK.
6. Unmount the volumes pointing to the primary Data Domain device that has failed.
Results
After performing these steps, you can now replace the primary Data Domain device and
either configure NetWorker Data Domain Boost devices the same way you set up the
devices prior to the failure, or create new Data Domain Boost devices and adapt your
VMware policy and pools accordingly.
4. Browse restores from the VMware Backup appliance and select the VMs/VMDKs you
want to restore to the new location, as specified in the section Performing a FULLVM
restore on page 85. Restore to the original location, Instant Access Restore and
restore from GSAN will be disabled.
vCenters and number of proxies, and whether you perform a large number of concurrent
VM backups. The following table provides these scalability factors.
VMs per VMware 800-1000 VMs Given an average size of 20-30 GB per VM, the 0.5
Backup appliance TB OVA can accommodate a maximum of
(Data Domain backup, 800-1000 VMs when backing up to a Data Domain
no external proxy) device. One VMware Backup appliance can run 8
sessions in parallel. Considering the VM size and
data change rate, a VMware Backup appliance can
complete a backup of 800-1000 VMs within 24
hours.
Note
VMs per policy 200 or lower A single policy can scale up to 200 VMs. If more
than 48 VMs per policy, the remaining VMs will be
queued during backup.
VMs per restore 16 More than 16 VMs may result in NBD based
restore due to VMware API limitations.
Files/directories per Maximum of 5000 FLR restore may be significantly impacted when
FLR there are more than 5000 files to be restored.
A VMware Backup appliance can backup up to 8 VMs in parallel. If you want to run up to
48 VM backups in parallel, then add up to 5 external proxies. Each external proxy can
backup up to 8 VMs.
To achieve the best concurrent backup performance in a setup that requires additional
vCenters, VMware Backup appliances or proxies, EMC recommends using 1 VMware
Backup appliance + 5 External proxies per vCenter. The following tables provide
information on expected performance for different setups.
Backups from the VMware Backup Appliance and external proxy create sessions with
NetWorker devices. The count of sessions is driven by the number of appliances, external
proxies, clone jobs and other backups running through this server. Every VMware Backup
Appliance and external proxy can run up to 8 sessions. If using external proxies, EMC
recommends disabling the internal proxy on the VMware Backup Appliance. The values
calculated in the table above reflect a disabled internal storage.
VMs per policy 48 vCenter can process 48 VMs at a time. If a single policy
contains more than 48 VMs, the remaining VMs will be
queued during backup.
VMware Backup 48 concurrent VMs The maximum concurrent sessions per VMware Backup
appliance appliance is 48, irrespective of the target device.
External proxy 24 concurrent External proxy has only 2 SCSI controllers which limits
hotadd of VMDKs the concurrent hotadd sessions to 24. If you back up
more than 24 VMDKs, the backup uses NBD mode.
Note
Hotadd mode requires VMware hardware version 7 or later. Ensure all VMs being
backed up are using VM hardware version 7 at a minimum.
For sites that contain a large number of VMs that do not support Hotadd
requirements, NBD backups will be used. This can cause congestion on the ESXi host
management network. Plan your backup network carefully for large scale NBD
installs. You may consider:
n Set up Management network redundancy
n Set up backup network to ESXi for NBD
n Go to http://www.vmware.com/files/pdf/techpaper/vmw-vsphere-high-
availability.pdf to learn how to set up storage heartbeats.
l Avoid deploying VMs with IDE virtual disks; using IDE virtual disks degrades backup
performance. Use SCSI virtual disks instead whenever possible.
Note
You cannot use hotadd mode with IDE Virtual disks and therefore backup of these
disks will be performed using NBD mode.
l During policy configuration, assign clients to a policy based on logical grouping to
allow for better scheduling of backups that will help you avoid resource contention
and create more organized logs for review.
<vmacore><soap><maxSessionCount> N </maxSessionCount></
soap></vmacore>
This applies specifically to SDK sessions as opposed to VI client sessions:
l Each VM backup to a Data Domain system consumes more than one session on the
Data Domain device. The default device configuration is target sessions=6 and
max session=60, however EMC recommends that you configure additional devices
for more than 10 parallel backups.
l VMs with extremely high IO may face hangs during consolidation due to the ESXi
forced operation called synchronous consolidate. Plan your backups of such VMs
according to the amount of workload on the VM.
l When working with the vCenter database either directly or by using scripts, do not
change the name attribute for the vmfolder object. The knowledgebase article at
https://support.emc.com/kb/190755 provides more information.
l Setting up multiple devices locally on the NetWorker server can lead to resource
contention. Large VMware environments are observed to have more stability when
most backup devices are set up on a remote storage node.
When you mount a backup or clone pool volumes on a remote storage node, then
modify the properties for the VMware Backup Appliance to add these storage node
names under the Globals (2 of 2) tab of the NetWorker Client Properties window in
NMC.
l Resource contention can occur at various points during the backup cycle. Running
larger savegroups and policies often cause issues due to contention of resources that
impact all running operations. Adjust your resources and times for other larger
savegroups/policies to avoid overlaps, thereby avoiding resource contention.
For example, if you set up a policy where every day at 10pm two policies called
'Bronze1' and 'Bronze2' with 400 clients each start writing to a pool named 'Bronze'
which is configured for just one device on NetWorker, the long wait for device
availability may cause unexpected delays or timeouts. To fix this, set the policy start
times 4 hours apart and add more devices to allow for stable backups.
Note
Actions cannot be added to workflows that have the same name in different policies
For traditional workflows, VMware allows the same workflow name to be used in different
policies. However, if you add such a workflow to a policy, you will not be able to add
actions to the workflow.
Datastore names cannot contain spaces or other special characters
Using spaces and other special characters in datastore names can cause problems with
the Virtual Backup appliance, such as failed backups and restores. Special characters
include the following: % & * $ # @ ! \ / : * ? " < > | ;, etc.
Ensure that the external proxy appliance is at the same version as the VMware Backup
Appliance and if not, upgrade the external proxy. If a recovery is immediately required in
the environment, temporarily shut down all of the external proxies while starting the
restore for the VM. This will ensure that the recovery gets assigned to the VMware Backup
Appliance internal proxy. Knowledgebase article 202211 available at http://
support.emc.com provides more information.
Avamar image backups to Data Domain fail if proxies not added to DD Boost Access list
Avamar VMware image backups to Data Domain fail with errors when you do not add the
proxies to the DD Boost access list.
To add the proxies to the DD Boost access list, run the following command: ddboost
access add clients client-list. Knowledgebase article 168524 available at http://
support.emc.com provides more information.
FLR browse in EMC Data Protection Restore Client may not display second of three disks
When you browse disks for FLR by using the EMC Data Protection Restore Client, the
second of three disks may not display due to partition detection failing for this specific
disk. The disk will display properly from the command line.
Knowledgebase article 201908 at http://support.emc.com provides possible
workarounds and more information on this issue.
Data Domain SMT not supported
NetWorker VMware Protection does not support Data Domain SMT. You can create a
different user to segregate access to specific DD Boost devices, but not to a specific
secure multi-tenancy (SMT) unit. If you want to protect both Guest and VM images, you
must create two specific DD Boost users; one for the guest backup with SMT, and one for
the VM image backup without SMT.
Do not use combination of FQDN and IP when registering vCenter server
When you register the vCenter server with the VMware Backup appliance and the
NetWorker server, ensure that you specify only the FQDN or only the IP in all instances. Do
not use a combination of the two.
VMware Backup appliance must be deployed to an ESX host managed by the same
vCenter you register the appliance to when using multiple vCenters
When you have multiple vCenters, you must deploy the VMware Backup appliance to an
ESX host that is managed by the same vCenter you register the appliance to. Otherwise, a
connection error appears indicating “Unable to find this EBR in the vCenter inventory.”
Backups to VMware Backup appliance and Data Domain system not supported
You can only backup to the VMware Backup appliance internal storage or a Data Domain
system.
Cloning between Data Domain system and VMware Backup Appliance internal storage
not supported
You cannot clone backups from a Data Domain system to VMware Backup appliance
internal storage, nor can you clone backups from VMware Backup appliance internal
storage to any other devices, including Data Domain systems. However, backups to a
Data Domain system can be cloned to any device that NetWorker supports for cloning.
Only hotadd and NBD transport modes supported
The NetWorker VMware Protection solution supports only the hotadd and NBD transport
modes. The hotadd mode is the default transport mode.
Higher default target session and max session values for VMware Backup Appliance
NetWorker creates the default VMware Backup appliance with the values target
session=50 and max session=200. These values are higher than normal default values
for a device created in NetWorker because each appliance or external proxy comes with 8
proxy agents.
Backup of individual folders within a VM not supported
The NetWorker VMware Protection solution only supports image-level backup and disk-
level backup; you cannot perform backups of individual folders within the VM.
NMC's VMware View map view does not display when configuration for VMs within the
vCenter is incomplete
When using NMC’s VMware View, the map view does not appear when the configuration
for one or more VMs in the vCenter is incomplete. To avoid this issue, remove incomplete
VM configurations from vCenter.
I/O contention when all VMs on a single data store
I/O contention may occur during snapshot creation and backup read operations when all
VMs reside on a single data store.
No automatic migration tool to move from previous solution to NetWorker VMware
Protection
An automatic migration tool to move from the previous VM backup solution to the
NetWorker VMware Protection solution does not exist.
Only English keyboards supported in vSphere Web Client's EMC Backup and Recovery
user interface
The EMC Backup and Recovery user interface in the vSphere Web Client only supports
English language keyboards.
Configuration checklist
The following configuration checklist provides best practices and troubleshooting tips
that may help resolve some common issues.
Basic configuration
l Synchronize system time between vCenter, ESX/ESXi/vSphere, and EMC Backup and
Recovery appliance
l Assign IPs carefully — do not reuse any IP address
l Use FQDNs (Fully Qualified Domain Names) everywhere
l For any network related issue, confirm that forward and reverse DNS lookups work for
each host in the datazone.
l To obtain the number of sessions, multiply the total number of VMware Backup
Appliance sessions (all VMware Backup Appliances + all external proxies) by 8, and
then multiply that total by 2.
Note
This does not include VMware Backup Appliance nodes with the internal proxy
disabled
l You may need to make adjustments depending on whether you configured any other
types of backups simultaneously to this Data Domain system.
l Note the maximum number of streams allowed by your particular Data Domain
model/configuration. If the combination of the VMware Backup Appliance and other
sessions exceeds the maximum streams allowed, then performance degradation or
backup and cloning failures may occur. In such cases, you may benefit from
staggering backups.
Additionally, note the following requirements:
l All Data Domain systems must use DDOS version 5.4 and later
l Ensure that the Data Domain system does not reach the MTree limit and max-streams
limit
l Ensure that the DDBoost user has administrator privileges
l Ensure that only devices from the same Data Domain system host per Data Domain
system pool when used in any Action
Monitoring Stream Counts (Advanced)
You can monitor changes to the stream by using an SSH connection to the Data Domain
system.
1. Launch PuTTY and connect to Data Domain over SSH as sysadmin.
2. Run the system show performance command, as shown in the following
example.
When you run the following command, the output displays stream counts over a period of
5 minutes, with a maximum of 15 streams.
In this example, you notice a performance issue during backups to a Data Domain 670
system, which you set up with one VMware Backup Appliance node (with internal proxy
disabled) and 12 external proxies. Additionally, you will run Exchange and UNIX backups
for a total of 150 clients each day, with a maximum parallelism of 40.
Considerations:
Now, since the totals from the first two bullets (192+40=232) exceed ‘Max stream
allowed’ (140), you should stagger the backups to run a lower session count. Some
suggestions to achieve this include:
l Set up group start times to simultaneously work only through 6 clusters (VMware
Backup Appliance external proxies ( 6 * 8 * 2)) = 96 streams.
l Reduce the parallelism for other backups to lower than 25.
The combined parallel stream count (VMware Backup Appliance + others) should now be
lower than 140 at all times.
If the number of clients required for backup continues to grow, you may want to set up a
Data Domain system that allows for a higher stream count, such as a DD 7200, for these
operations.
NetWorker configuration
l Ensure that NetWorker services are up before you configure the EMC Backup and
Recovery appliance
l Leave “Source Storage Node” empty when you configure the “VM Backup” action
l Ensure that the relevant devices are mounted
l Wait until you successfully configure a policy before you run the policy.
2. If you notice errors, check the host names involved and remove peer information for
the problem hosts.
3. Log in to the problem host and check the hostname. Ensure that the NetWorker
nsrladb shows the correct host names on both affected machines.
You discover the following error message on your NetWorker server nwserver1:
nsradmin -p nsrexec
nsradmin> d type: nsr peer information; name: nwproxy1.example.com
Delete? Yes
nsradmin> quit
Then, you log in to nwproxy1 and check to ensure the host name is valid.
Note
curl esxi.my.local:902
220 VMware Authentication Daemon Version 1.10: SSL Required,
ServerDaemonProtocol:SOAP, MKSDisplayProtocol:VNC , VMXARGS supported
If you receive a response such as "curl: (7) couldn't connect to host", this may indicate
that there is a host-based connectivity issue or network firewall software blocking
connectivity.
Connectivity between the VMware Backup Appliance and the NetWorker server
Use the following test to validate connectivity between the VMware Backup Appliance
node (or external proxy) and the NetWorker server.
Before you begin
Before running the test, log in to NMC and create a client for the external proxy.
Procedure
1. Connect to the VMware Backup Appliance or external proxy using PuTTY.
For NetWorker 8.2 or later VMware Backup Appliances, login as admin.
2. Run the following command.
save -J <storage-node> -s <nw-server> -b <pool> /etc/hosts
If the output shows the backup was successful, you can skip the remaining steps.
3. If the backup fails, check the /etc/hosts file for the following entry:
If not present, add these entries to the hosts file. If you see these entries, skip to the
next step.
Note
4. Check for any peer information issues on the VMware Backup Appliance or external
proxy host and the NetWorker server and clear up these issues.
5. Run a debug backup to check for other issues such as DNS errors:
save –D2 -J <storage-node> -s <nw-server> -b <pool> /etc/
hosts
6. Ensure that the Network Portgroup for the VM (VMware Backup Appliance or external
proxy) is set on the correct port group.
/usr/local/avamarclient/bin/avnwcomm --version
This setting applies only to the following NetWorker and OVA versions for the VMware
Backup appliance node or external proxy.
NetWorker version OVA version Command output Notes
8.1 SP1 1.0.1.9 7.0.161-7 Patch only
Note
--nw_init_timeout=420
4. Ensure you have the correct permissions by running:
Log in to the EMC Backup and Recovery Console as admin instead of root
When you use ssh to connect or login to the EMC Backup and Recovery Console, ensure
that you login as the admin user instead of root. Direct login as the root user is not
permitted.
After you ssh to the Console as admin, you can then switch to the root user, as shown in
the following example:
If you connect to the EMC Backup and Recovery Console via the vSphere Client, you can
log in as the root user.
Note
The password for the admin user is the same as the password that was specified in the
EMC Backup and Recovery Configure window during the initial installation of the VMware
Backup appliance.
Note
Modifying the ssh configuration file in /etc/ssh so that a user can ssh into the appliance
directly as root is not recommended as it may result in future upgrade failures.
NetWorker operations
The following troubleshooting items provide some direction on how to identify and
resolve common issues with NetWorker and VMware Protection Policies.
VMware Protection Policy fails for manually created client resource with DataDomain backup
attribute enabled
When you manually create a client resource and enable the DataDomain backup attribute
(using nsradmin or the NMC Client Properties window), the default VMware Protection
Policy fails with the following error:
“No proxies running on VBA {appliance name} for backing up VM {VM name}”
When the avagent is not running, or no proxies are running, this error appears in the
VMware Protection Policy details window in NMC.
If you see this error, log in as root from the EMC Backup and Recovery Console in the
vSphere Client and invoke service avagent restart:
/etc/init.d/avagent restart
NSR_VBA_REQUEST_TIMEOUT=2400
If your timeout values are lower than these numbers, EMC recommends updating to these
values.
Note
Changes to these values may depend on the operating system of the NetWorker server.
The sections "Setting environment variables on UNIX" and "Setting environment variables
on Windows systems" in the EMC NetWorker Administration Guide available at http://
support.emc.com provide more information.
vi /var/lib/vmware/vsphere-client/webclient.properties
2. Ensure that the output contains a line similar to allowHttp=true.
Note
When you use ssh to connect or login to the EMC Backup and Recovery Console in the
vSphere Client, ensure that you login as admin instead of root. The section Log in to the
EMC Backup and Recovery Console as admin instead of root on page 120 provides more
information.
1. Log into the Console, and then type:
emwebapp.sh --stop
emwebapp.sh --start
emwebapp.sh --stop
su – admin
ebrdbmaint.pl --startdb
exit
emwebapp.sh --start
emwebapp.sh --stop
cd /usr/local/avamar/lib/ebr
mv ebr-server.war ebr-server.war.orig
emwebapp.sh --start*
3. Verify that the time on your EMC Backup and Recovery appliance and your vCenter
server are the same by running the date command on each.
Note
Allow a couple of minutes after making the changes for times to merge.
4. Log in to the vSphere Web Client. If the time synchronization message does not
appear when you launch the EMC Backup and Recovery user interface, the times have
been synchronized successfully.
cd /usr/lib/vmware-vsphere-client
2. Run ./vsphere-client stop.
3. Run ./vsphere-client start.
Start user interface does not display as available in vSphere Web Client
If the user interface does not display as available in the vSphere Web Client, log into
vCenter and restart the vSphere Client Services by running the following from a command
prompt:
cd /usr/lib/vmware-vsphere-client
./vsphere-client stop
./vsphere-client start
When you deploy a VM, do not change the default network (VM Network) provided by the
wizard. After the deployment completes and prior to powering on the VM, reconfigure the
VM to use the appropriate network if VM Network is not correct. If you change the network
in the wizard, EMC Backup and Recovery looks for eth1 instead of eth0, and network
connectivity fails.
If you see this message, do not shutdown the VM, and allow time for the reboot to
complete.
The EMC Backup and Recovery appliance is not responding. Please try your request again
If you were previously able to connect to EMC Backup and Recovery and this message
appears, check the following:
l Confirm that the user name or password used to validate EMC Backup and Recovery
to the vCenter Server has not changed. Only one user account and password are used
for EMC Backup and Recovery validation. This is configured through the EMC Backup
and Recovery Configure window.
l Confirm that the name and IP address of the appliance have not changed since the
initial EMC Backup and Recovery installation. DNS Configuration on page 29 provides
additional information.
Integrity Check
After you start an integrity check, a delay of several seconds may occur before the “EBR:
Integrity Check” task shows up in the Recent Tasks pane of the EMC Backup and Recovery
user interface in the vSphere Web Client. Similarly, when you cancel an integrity check, a
delay of several seconds may occur before the task is cancelled.
In some cases (for example, when the integrity check progress is above 90%), the
integrity check may actually complete before the cancel operation completes. Even when
the integrity check completes successfully, the Task Console may still show an error
indicating that the integrity check was cancelled.
If you knew that the Integrity Check Status of the appliance (shown on the Reports tab)
was “Out of Date” before you started the integrity check, then you can look at the status
immediately after you cancel the job to see if the cancel operation succeeded. If the
Integrity Check Status is “Normal,” then the check was successful. If the status is “Out of
Date,” then the check was cancelled.
Backup operations
The following troubleshooting items provide some direction on how to identify and
resolve common issues with NetWorker VMware Protection backups.
Backups fail when EMC Backup and Recovery plug-in registers with an incorrect version string in
vCenter
Backups may fail when the EMC Backup and Recovery plug-in registers with an incorrect
version string in vCenter. Additionally, EMC Backup and Recovery cannot co-exist with
VMware VDP or any third-party backup plug-in in the same vCenter. If a conflict occurs,
then unregister the EMC Backup and Recovery plug-in extension from the managed object
browser (MOB):
1. Navigate to http://vcenter-ip/mob.
2. In the Properties table, select the content link.
3. Select Extension Manager and verify that the Properties table lists
“com.emc.networker.ebr”.
4. From the Methods table, select UnregisterExtension.
5. Type com.emc.networker.ebr and select Invoke Method.
Note
This name will be different if removing VDP or a third party backup plug-in.
6. Verify in Extension Manager that the plug-in is no longer listed in the Properties
table, and then restart vCenter services or the vCenter server.
7. Restart emwebapp on the EMC Backup and Recovery appliance by using the
command emwebapp.sh --restart.
select a very large number of jobs. This message disappears when the action is
completed, which can take up to five minutes.
“Unable to add client {client name} to the EMC Backup and Recovery appliance while creating
backup job {backupjob name}.”
This error can appear when there is a duplicate client name on the vApp container or the
ESX/ESXi host. In this case only one backup job is added. Resolve any duplicate client
names.
“The following items could not be located and were not selected {client name}.”
This error can occur when the backed up VM(s) cannot be located during Edit of a backup
job. This is a known issue.
Windows 2008 R2 VMs may fail to backup with “disk.EnableUUID” configured to “true.”
Windows 2008 R2 backups may fail if the VM is configured with the disk.EnableUUID
parameter set to true. To correct this problem, manually update the vmx configuration
parameter disk.EnableUUID to false by using the vSphere Web Client:
1. Shut down the VM by right clicking the VM and selecting Shut Down Guest OS.
2. Right click the VM and select Edit Settings.
3. Click VM Options.
4. Expand the Advanced section and click Edit Configuration.
5. Locate the name disk.EnableUUId and set the value to false.
6. Click OK on the next two pages.
7. Right click the VM and select Power On.
After you update the configuration parameter, the backups of the Windows 2008 R2 VM
should succeed.
Backup fails if EMC Backup and Recovery does not have sufficient datastore capacity
Scheduled backups fail at 92% complete if there is insufficient datastore capacity. If you
configured the EMC Backup and Recovery datastore with thin provisioning and maximum
capacity has not been reached, then add additional storage resources. If you configured
the EMC Backup and Recovery datastore with thick provisioning and it is at full capacity,
see EMC Backup and Recovery Capacity Management on page 97.
When VMs are moved in or out of different cluster groups, associated backup sources may be lost
When you move hosts into clusters with the option to retain the resource pools and
vApps, the containers get recreated, not copied. As a result, the container is no longer the
same container even though the name is the same. To resolve this issue, validate or
recreate any backup jobs that protect containers after moving hosts in or out of a cluster.
After an unexpected shutdown, recent backup jobs and backups are lost
When an unexpected shutdown occurs, the VMware Backup appliance performs a
rollback to the last validated checkpoint. This is expected behavior.
Backups fail if certain characters are used in the VM name, datastore, folder, or datacenter names
When you use special characters in the VM name, datastore, folder, or datacenter names,
the .vmx file is not included in the backup. The VMware Backup appliance does not
backup objects that include the following special characters, in the format of character/
escape sequence:
l & %26
l + %2B
l / %2F
l = %3D
l ? %3F
l % %25
l \ %5C
l ~ %7E
l ] %5D
Restore operations
The following troubleshooting items describe how to identify and resolve some common
issues with restores.
Restore tab shows backups taken after checkpoint backup as "not available"
When you complete a successful disaster recovery of the VMware Backup appliance, and
then attempt to restore a backup performed after the last checkpoint backup, the Restore
tab in the EMC Backup and Recovery user interface in the vSphere Web Client displays
these backups as "not available." This occurs because no account for these backups
exists, since the client or VM was added to the policy after the checkpoint backup.
When you add the client or VM back into a policy, backups display correctly with a valid
path in the Restore tab.
Message appears during FLR indicating “error finding vm by ipAddr” when you do not install
VMware Tools
You must install VMware Tools to perform FLR. When you do not install VMware Tools, a
message appears indicating the restore client is unable to find a backup of a VM by IP.
To fix this issue, add the following user to the server administrators:
root@vba-name
root@proxy-name
Where VBA-name is the FQDN of the VMware Backup Appliance node, and proxy-name is
the FQDN of the external proxy.
Alternatively, you can open access to all hosts/users by adding *@*. The knowledgebase
article 174188, available at https://support.emc.com/kb/174188, provides more
information.
To increase the timeout value for checkpoint discovery to 5 minutes, upgrade to the latest
NetWorker cumulative release. If you require a timeout value greater than 5 minutes, you
can then modify the timeout by setting the environment variable
NSR_VBA_CPTAG_REQUEST_TIMEOUT=<value>, where value is in seconds. The maximum
value permitted is 3600 seconds (one hour).
Note
EMC recommends that you only register required proxies. The section "Proxy
Registrations" provides more information.
Note
NetWorker supports VMware vCenter appliance versions 5.0, 5.1 and 5.5.
l You must perform the following prerequisites on the NetWorker server/proxy machine
in order to run vSphere 5.5:
1. Since the registry key for SSL verification is not set by default, add the following
keypath in the registry:
'HKEY_LOCAL_MACHINE/SOFTWARE/Wow6432Node/VMware, Inc./VMware
Virtual Disk Development Kit'
Note
The comreg.exe program, part of the VMware tools installer, contains a Windows
2008 R2 bug that prevents registration of the VMware Snapshot Provider with VSS.
VADP backups of a Windows Server 2008 R2 or Windows 7 VM may fail for certain
versions of ESX 4.0.0 due to this issue.
The following knowledgebase article provides Instructions for fixing this issue:
http://kb.vmware.com/selfservice/microsites/search.do?
language=en_US&cmd=displayKC&externalId=1022720
To resolve this issue, upgrade to ESX 4.0 update 2 or ESX 4.1, or to upgrade your ESX
4.0.0 server with a VMware patch, navigate to the following link: http://
kb.vmware.com/selfservice/microsites/search.do?
cmd=displayKC&externalId=1013127.
n ESX datastore names containing the VM configuration files and virtual disks.
l You can only restore VMs to the same language OS vCenter that you perform the
backup from. For example, you cannot recover a VM backed up from a Japanese OS
vCenter onto an English OS vCenter.
l You can only perform VADP recovery using the NetWorker User program. A command
line recovery of the entire image will not work for backups from a non-English
vCenter.
Note
Attempting to launch the VADP recovery dialog without following this procedure results in
the overwriting of the local system files, which can lead to machine corruption.
Transport modes
The VADP proxy host supports advanced transport modes for image level recovery. You
can set the configured network transport mode to the following values during backup or
recovery:
l SAN (Storage Area Network): selecting this mode completely offloads the backup
related CPU, memory or I/O load on the virtual infrastructure. The backup I/O is fully
offloaded to the storage layer where the data is read directly from the SAN or iSCSI
LUN.
SAN mode requires a physical proxy with SAN access, and the VMs need to be hosted
on either FibreChannel or iSCSI-based storage. The corresponding VMFS volumes
must be visible in the Microsoft Windows Disk Management snap-in of the VADP
proxy host.
l Hotadd: in this mode, the backup related I/O happens internally through the ESX I/O
stack using SCSI hot-add technology. This provides better backup I/O rates than
NBD/NBDSSL. However, selecting this mode places backup related CPU, memory and
I/O load on the ESX hosting the VADP proxy.
Hotadd mode requires a virtual proxy, and the ESX hosting the virtual proxy should
have access to all the datastores where the VMs are hosted So, if the datastores are
SAN/iSCSI/NFS and if the ESX server where the VADP proxy resides is separate from
the ESX server where the VMs are hosted, then:
n In the case of SAN LUNs the ESX hosting the proxy and the ESX hosting the VMs
should be part of the same fabric zones.
n In the case of iSCSI LUNs the ESX hosting the proxy and the ESX hosting the VMs
should be configured for the same iSCSI-based storage targets.
n In the case of NFS datastores, the ESX hosting the proxy and the ESX hosting the
VMs should be configured for the same NFS mount points.
l NBD (Network Block Device): in this mode, the CPU, memory and I/O load gets
directly placed on the ESX hosting the production VMs, because the backup data has
to move through the same ESX and reach the proxy over the network. NBD mode can
be used either for physical or virtual proxy, and also supports all storage types.
l NBDSSL (Network Block Device with SSL): NBDSSL transport mode is the same as
NBD except that the data transferred over the network is encrypted. Data transfer in
NBDSSL mode can therefore be slower and use more CPU due to the additional load
on the VADP host from SLL encryption/decryption.
For recovery of VMs using NBDSSL mode, refer to the section Recovering a VM using
NBDSSL, SAN, or Hotadd transport mode on page 162.
You can set multiple transport modes to be used by the VADP proxy host using the pipe
symbol “|” (for example, san|nbd|nbdssl).
By default, the transport mode field in the NetWorker User program is blank. Specify one
transport mode to use for recovery.
More information on configuring transport modes is provided inConfiguring the VADP
proxy host and Hypervisor resource on page 136. The transport modes are outlined in
the table Table 17 on page 139.
Configuration options
There are two options for configuring NetWorker clients for VADP backup. The
configuration can be performed automatically by using the Client Backup Configuration
wizard, or manually by using the Client Properties window:
l If using the Client Backup Configuration wizard, refer to Configuring a VADP proxy
host and Hypervisor resource automatically by using the Client Backup Configuration
Wizard on page 136.
l If using the Client Properties window, refer to Configuring a VADP proxy host and
Hypervisor resource manually by using nsradmin on page 138.
Note
The VADP proxy host can be the NetWorker server. Also, if multiple client instances of the
same VADP proxy host exist in the NetWorker server, ensure that all the instances have
the same application information attributes related to VADP. Manually copy the
application information attributes into all the VADP proxy client instances. Note, however,
that when a virtual proxy is used, it cannot be created by copying the template of other
VMs that are being protected.
Configuring a VADP proxy host and Hypervisor resource automatically by using the
Client Backup Configuration Wizard
Procedure
1. From the Administration window, click Configuration.
2. In the expanded left pane, right-click Clients and select Client Backup Configuration >
New.
The Specify Client Name and Type page displays, as shown in the following figure.
3. Type the name of the host machine in the Client Name field and select VMware proxy
host and click Next.
4. Select the vCenter server associated with the Proxy host if present, otherwise:
a. In the vCenter section, click New to create a new Hypervisor resource.
b. In the vCenter field, specify the hostname of the vCenter server.
Note
c. In the Username and Password field, type the username and password for an
account with permission to perform backups, snapshots and registering/creating a
new VM.
If the user has non-administrative privileges on the vCenter server, follow the steps
in the section Creating a VADP User role in vCenter on page 147.
d. Click OK.
Note
This will set the VADP_HOST variable in the Application Information properties of
the Proxy host client in NetWorker.
5. In the Filesystem Mount Point Options section, specify the directory where all the VM
backup jobs are supposed to reside in. The default value is c:\\mnt. This option will
set the VADP_BACKUPROOT variable in the Application Information properties of the
Proxy host client in NetWorker.
Consider the following when defining this option:
Configuring a VADP proxy host and Hypervisor resource automatically by using the Client Backup Configuration Wizard 137
VADP Backup and Recovery (legacy)
l Ensure that the directory already exists, otherwise the VADP backup jobs will fail
with “directory does not exist” error.
l The directory must be on a local disk and not on a CIFS share.
l This directory cannot be encrypted.
l For each backup job, a directory with a unique name derived from the * backup
type and the VM name will be created here.
6. In the Retry Option selection, set the desired number of time to retry failures and the
wait time in between retries. These options will set the VADP_MAX_RETRIES and
VADP_MAX_BACKOFF_TIME variables respectively in the Application Information
properties of the Proxy host client in NetWorker.
Consider the following:
l VADP_MAX_RETRIES - Use this option if you see a large number of backup jobs fail
with “resource busy” errors. Usually, backup software will retry failed jobs, but it
might be hours until the backup software retries.
l VADP_MAX_BACKOFF_TIME - If you change this default, also change the default for
MAX_RETRIES, because this setting only applies if MAX_RETRIES is larger than 0).
7. In the Transport Mode Options section, select all desired modes in the Available
Modes section and click the button to add. Change the mode order if desired, the
order in which modes are specified dictate the priority in which they are attempted.
This option will set the VADP_TRANSPORT_MODE variable in the Application
Information properties of the Proxy host client in NetWorker.
Note
8. Click Next.
9. Click Next in the Specify the Proxy Host Backup option as it is not necessary to backup
the Proxy host.
10.Click Next and review the Backup Configuration Summary.
11.Click Create.
12.Click Finish.
Configuring a VADP proxy host and Hypervisor resource manually by using nsradmin
If vCenter is configured in the environment, there must be a Hypervisor resource for the
vCenter server hosting the VMs that use VADP. You may also need to create a Hypervisor
resource if you cannot use VMware View in the NetWorker VMware Protection solution, as
indicated in the section Enable VMware View in NMC after upgrading by creating a NSR
Hypervisor resource on page 42.
Before creating a Hypervisor resource for vCenter, ensure that the NetWorker client
software is installed on the vCenter server.
If vCenter is not configured in the environment, there must be a Hypervisor resource
created for each server in the environment.
VADP backups will work even if you do not install the NetWorker client on vCenter or
VirtualCenter, however, you must create the corresponding Hypervisor resource in the
NetWorker server prior to starting the VADP backups.
Note
If using the NetWorker VMware Protection solution, ensure that the vCenter FQDN or IP
for the NSR Hypervisor resource matches what you specified in the vCenter
Registration page of the EMC Backup and Recovery Configure window. You must use
only FQDN or only IP in both instances, not a combination of the two.
Creating a NetWorker client for the VADP Proxy host by using the Client properties windows
Table 17 Application information values
Configuring a VADP proxy host and Hypervisor resource manually by using nsradmin 139
VADP Backup and Recovery (legacy)
VADP_HOST=any.vc
VADP_HOST=another.vc
VADP_BACKUPROOT=G:\mnt
VADP_TRANSPORT_MODE=Hotadd
VADP_MAX_RETRIES=2
VADP_MAX_BACKOFF_TIME=15
Configuring a VADP proxy host and Hypervisor resource manually by using nsradmin 141
VADP Backup and Recovery (legacy)
Procedure
1. From the Administration window, click Configuration.
2. In the expanded left pane, select Clients.
3. From the File menu, select New.
4. In the Name attribute, type the hostname of the Proxy client.
5. The browse and retention policy fields can remain empty, as they are set for the virtual
clients.
6. If the Proxy client must be backed up, ensure that Scheduled Backups is selected.
Note
7. In the Save Set attribute, type the name of the files or directories to be backed up:
a. To specify a file or directory for backup such as C drive, type c:\.
b. To back up a specific directory such as Documents and Settings, type c:
\Documents and Settings.
c. To backup all file systems and VSS/System save sets, type ALL.
Note
If the Proxy client will not be backed up use the default selection.
8. Click Apps and Modules. The Create Client dialog displays, as shown in the following
figure.
Figure 53 Apps and Modules tab in NMC
9. In the Application Information field, add one line for each VC server hostname that is
configured as part of the NSR Hypervisor resource:
VADP_HOST=any.vc
where any.vc is the hostname of the vCenter server configured as the NSR Hypervisor
resource.
10.The variables, described in the following table, can also be specified in the
Application Information section.
Note
Since index entries are required for VADP image level restores, ensure that the browse
policy is set appropriately. Index entries can still be created using the scanner command
after the browse policy has expired.
The following table lists the recovery options that are available based on the virtual
client’s configuration. Recovery steps are described in Recovering VADP Backups on page
153.
Table 18 Recovery options that are available based on the virtual client configuration
Virtual client with NTFS** OS and the *FULL* save set is Yes Yes
selected.
Virtual client with NTFS** OS and the *FULL* save set is No Yes
specified and the backup level is full (no incremental backups)
and the VADP_DISABLE_FLR APPINFO variable is set to Yes.*
Table 18 Recovery options that are available based on the virtual client configuration (continued)
Note
3. In the Specify the VMware Physical Host and Backup Type page, the Physical Host
field will be populated with the Physical Host for the VM.
4. Select VMware Proxy backup and from the Proxy host list, select the name of the
Proxy Host VC Server. The VC names are taken from the multiple VADP_HOST values
set on the Application Information section of the proxy Client resource. Click Next.
5. In the Specify the Backup Options page, complete the following optional sections if
required:
l Deduplication — Select Data Domain if this client is being used with the DD Boost
option that is available in NetWorker 7.6 SP1 and later. Select Avamar
deduplication backup and the corresponding Avamar server from the list if this
client is using Avamar deduplication. Select None if no deduplication is being
used.
l Target Pool — Select a pool, from the list, to which data from this client’s backup
will be directed. If a pool is selected, this value will override any other pool
selection criteria that is associated with the client’s backup group or the client’s
save sets. This field is most often used when backing up to a NetWorker 7.6 SP1 or
higher Data Domain device.
6. Click Next to display the Specify the Proxy Backup Options page.
7. (Optional) In the Virtual Machine Name field, type the display name of the VM used in
the vCenter. If a value is not entered, backups for this VM will be done by IP address.
If a name is entered in this field, the name must match the display name as seen in
vCenter Administrator, otherwise the backup will fail.
Note
This name is case-sensitive. Also, if the name of the VM contains spaces, then the
name should be enclosed in double quotes "".
Note
Due to limits with VADP, only one entry is allowed for the Save Set attribute.
9. Click Next.
10.In the Select NetWorker Client Properties section, select the Browse and Retention
policies from the drop down menus.
11.If desired, select the Backup Schedule for this client.
Note
If a backup schedule is also defined for the backup group that this client will be
added to, the group schedule will override the client schedule.
Where system is the system account of the Windows VADP proxy and VADP proxy host
is the name of the Proxy host.
14.Click Next.
Configuring a virtual client by using the Client Backup Configuration wizard 145
VADP Backup and Recovery (legacy)
15.In Specify the NetWorker Backup Group, choose the desired group or select Create a
new group and provide a group name and desired number of client retries.
16.If a new group is created, in the Schedule Options section, specify the desired time for
the group to start in the Schedule backup start time field and enable Automatically
start the backup at the scheduled time.
17.Click Next.
18.In the Backup Storage Nodes section, select the storage nodes that contain the
devices to which the backups will be directed.
19.In the Recovery Storage Nodes section, select the storage nodes whose available
devices will be used for recovery operations.
20.Click Next.
21.Review the backup configuration summary and click Create.
You can now enable a directive on the VM.
22.Click Clients, right-click the newly created VM client, and select Properties.
23.From the Directive list, select Encryption directive or NT with compression directive.
24.Click the Apps and Modules tab and ensure that nsrvadp_save is in the Backup
command field.
25.Click OK.
Results
More information on directives is provided in the NetWorker Administration Guide.
Note
If the browse policy is set at the client level, it will override the browse policy specified
for any groups to which this client is a member.
6. In the Retention Policy field, select a retention policy from the list.
Note
If the retention policy is set at the client level, it will override the retention policy
specified for any groups to which this client is a member.
Note
Due to limitations with VADP, only one entry is allowed for the Save Set attribute.
Note
Where system is the system account of the Windows VADP proxy andVADP proxy
host is the name of the Proxy host.
15.Click OK.
Procedure
1. Log in to the vCenter Server with Administrator privileges using vSphere Client.
2. From the vCenter Server, select View > Administration > Roles.
3. Click Add Role.
4. Name the role VADP User.
5. Assign the required permissions to the VADP User role and click OK.
Assigning the VADP User role to the user specified in the NetWorker Hypervisor
resource
Note
Setting Privileges
Virtual machine > Configuration l Add existing disk
l Add or Remove device
l Change Resource
l Disk Change Tracking
l Disk Lease
l Raw device
l Remove disk
l Settings
Setting Privileges
Setting Privileges
Global l Cancel task
l Licenses
l Log Event
l Settings
Minimum vCenter permissions needed to back up and recover using VADP 149
VADP Backup and Recovery (legacy)
Setting Privileges
Note
When Changed Block tracking (CBT) is enabled, incremental and differential backups are
supported only for Windows VMs, and all attached disks must be NTFS file systems.
Note also that CBT-based incremental backups are always file based. Image level
recovery from a CBT-based incremental backup is not supported.
Note
Where:
l directory is the location of the executable (for example, c:\bin\nw762\nsr\bin)
l vCenter server is the vCenter server hostname
l protocol is the protocol to use with the web service. Can be one of the following:
n http
n https
l user is the vCenter user name
l password is the vCenter user password
l lookup method is the lookup method to use. Can be one of the following:
n vm-name
n ip-addr
n dns-name
l lookup key is the lookup key to use
l command is where you specify one of the following CBT options:
n cbt-disable
n cbt-enable
n info
In the following example, the command line interface is used to enable CBT on a VM
vm31-w2k3x64:
Note
Procedure
1. Connect to the NetWorker server via NMC.
2. Click Configuration.
3. In the left hand side navigation pane, select Notifications.
4. Right click New Virtual Machine and select Properties.
5. In the Action field, remove nsrlog and specify the command appropriate for your
NetWorker server's operating system.
a. For UNIX servers, the native mailer program will be used, refer to the appropriate
operating system documentation for configuration details.
b. For Windows servers, smtpmail, included with NetWorker can be specified. The
action field would be:
Where:
subject is the subject line of the email notification
mailhost is the FQDN of an email server which allows SMTP relaying
receipient1@host.com is the email address that will receive the emails.
Note
For details regarding additional switches for the smtpmail command refer to
esg116292 on http://powerlink.emc.com.
Monitor VMs
Monitoring of VMs, including notification when there is a new VM, can be done through
NMC in the same manner used to monitor other events. The NetWorker Administration
Guide provides information on monitoring.
Launching the vSphere Web Client from the NetWorker Console (Windows only) 153
VADP Backup and Recovery (legacy)
Procedure
1. Launch the NetWorker User program on the NetWorker server or VADP proxy.
2. Browse the file system for the VM client and select file to recover, as outlined in the
NetWorker Administration Guide’s Recovery chapter.
3. Set the destination directory to the CIFS share of the VM client.
4. Recover the files onto the CIFS share.
5. At the VM client, move the files from the CIFS share to the appropriate directory.
Note
The user must have the Remote Access All Clients privilege.
Note
Image level recovery is only supported with VMware stand-alone converter version
3.0.3.
l The VADP proxy system must be running one of the following:
n Microsoft Windows 2003 (with at least SP1 installed)
n Microsoft Windows 2003 R2
n Microsoft Windows 2008
n Microsoft Windows 2008 R2
n Microsoft Windows 2012
l If any hardware level changes such as a new disk partition, are made to the VM, you
must perform a level full backup before you can perform an image level recovery of
the full VM.
l The VM can recover to the same VMware ESX server or VMware vCenter (VC) taken at
the time of backup or to a different ESX or VC. Recovery to different resource pools
and different datastores are also supported. A different datastore can be specified for
each disk and a configuration datastore can be specified to restore the configuration
files.
l During the recovery of a full VM (FULLVM save set), the recovered VM will start in
forceful powered off state because of a VADP snapshot limitation.
l For non-Windows VMs: If using traditional NetWorker client-based backups along
with VADP image based backups for the same VM client, ensure that the browse
policy for the client-based backups does not exceed the frequency of VADP image
based backups. This practice is recommended because the indices of client-based
backups may have to be removed prior to image-level recovery. The section Image
level recovery to a different FARM or vCenter on page 161 provides more details.
For example, a Linux client has a schedule of daily level FULL client-based backups
along with monthly VADP image based backups. In this case, it is recommended to
set the browse policy of the client-based backups to a maximum of 1 month.
l If the image level backup of the VM being recovered was performed with the
Encryption directive, the current Datazone pass phrase by default is automatically
used to recover the VM image. If the current Datazone pass phrase was created after
a password-protected backup was performed, you must provide the password that
was in effect when the VM image was originally backed up.
Note
Only level full of FULLVM save sets are supported for VM image restore.
5. In the VADP Restore dialog box, type the following information depending on the type
of recovery and then click the Start button.
Restore to VMware vCenter (VC):
Note
NBDSSL mode fails for recovery of VMs in NetWorker. The transport mode Hotadd
fails for ESX 5.0 and with VC 5.0. Recovering a VM using NBDSSL, SAN, or Hotadd
transport mode on page 162 provides a workaround to this issue.
l Data Store — Specify the name of the datastore for each disk on the VM.
Results
The following figure depicts a VADP Restore dialog box that is set up for a VMware
vCenter restore.
Figure 55 VMware vCenter restore
Note
During an image level recovery operation, multiple browse sessions will be displayed in
NMC’s Monitoring window. This is expected behavior.
Note
Only level FULL of FULLVM save sets are supported for VM image recovery.
VADP:datastore=”config=stor1#disk1=stor2#disk2=stor3”
The following command depicts a command to recover the FULLVM with a ssid of
413546679. The recovery is directed to the ESX server named
esxDemo1.emc.com. Default values are used for the datacenter, resource pool,
and datastores.
recover.exe -S 413546679 -o
VADP:host=esxDemo1.emc.com;
VADP:transmode=Hotadd
Recover VMs that have a mix of VADP image-level and traditional guest based backups
If your VMs have a mix of both VADP image level backups and traditional guest based
(also known as client based) backups, you may have to use one of the following recovery
procedures depending on the build number of your NetWorker software:
l Image-level recoveries of non-Windows VMs on page 159
This issue applies only to NetWorker 7.6.2 build 631 or earlier.
l Unable to browse guest based backups on non NTFS file systems on page 160
This issue applies only to NetWorker 7.6.2.1 build 638 or later.
If you want to recover the latest image-level backup (in the above example,
SSID=3852911942), first remove all the indices of browsable save sets that are from the
previous traditional backups.
In this case, because there are two instances of browsable level FULL of the save set
name /usr that need to be removed, the following command must be run twice on the
NetWorker server:
If you want to recover from the second last image-level backup, (for example, from
SSID=4104550902), first remove all the indices of browsable save sets which are from
the previous traditional backups.
In this case, because there is one instance of browsable level FULL for the save set
name /usr that needs to be removed, the following command must be run once on the
NetWorker server:
Note
Browsable recovery of the traditional backup save sets will no longer be possible after
the respective indexes are removed. If the traditional backup indexes are still needed,
they can be restored after the image-level recovery is complete by running the following
command on the NetWorker server:
Example
The following VM (host name mars) has a mix of both VADP and traditional guest based
backups. This example shows how to recover a traditional backup save set on the VM by
first locating the time of the backup save set using the mminfo command and then by
using that time with the recover command. The host name of the NetWorker server in this
example is jupiter.
C:\mminfo -av -s jupiter -q "client=mars"
If you choose to keep the UUID, select Keep, then click OK to continue starting the VM.
If you choose to create a new UUID, Select Create, then click OK to continue powering on
the VM.
In ESX/ESXi 4.x:
If you choose to keep the UUID, select I moved it, then click OK to continue starting the
VM.
If you choose to create a new UUID, select I copied it, then click OK to continue powering
on the VM.
Note
Before performing the following steps, ensure that you delete any snapshots that are
active on the VM. Do not power on the VM until these steps have been performed.
Procedure
1. Right click the VM and select Edit settings.
2. Select the virtual hard disk and select Remove but do not delete the VMDK. Click OK.
3. Return to the Edit settings menu and select Add.
4. Choose Hard Disk and use an existing virtual disk.
5. Associate the new hard disk with the VMDK file, then click OK. For example, use the
Add disk pop-up window and add the hard disks by pointing them to the correct
VMDK file in the datastore.
6. Power on the VM.
Note
Windows 2008 32-bit can only be used as VADP proxy, not as the NetWorker server.
When recovering a VM using either the san or Hotadd transport mode on a Windows 2008
system, perform the following one-time configuration on the proxy host before initiating
the recovery:
Procedure
1. Open a command prompt on the proxy host.
2. Run the following command:
DISKPART
SAN POLICY=OnlineALL
Note
After the recovery is successful, SAN POLICY can be changed back to the default value
(SAN POLICY=offline or SAN POLICY=offlineshared).
Note
If recovery is initiated from a Windows machine other than the proxy, these steps need to
be performed on the machine where the recovery is initiated.
Note
You can only perform single Step recovery of VCB backups when VMware Converter 3.0.3
is installed, however, due to the incompatibility of this version with vSphere 4.0/4.1,
EMC recommends not using Single Step recovery when recovering old VCB backups to a
vSphere host. Note also that VMware Converter 4.0.1 is the last version that supports
VCB. The knowledgebase article at http://kb.vmware.com/selfservice/microsites/
search.do?language=en_US&cmd=displayKC&externalId=1026944provides more
information.
Note
Backup and recovery directly to a standalone ESX/ESXi host is not supported. The
ESX/ESXi must be connected to either VirtualCenter or vCenter to perform backup and
recovery operations.
l VADP does not support IPv6. Instructions for disabling IPv6 and using IPv4 are
provided in the section Network and Firewall port requirements on page 170
l Ensure that the client parallelism on the VADP proxy machine is set to the maximum
number of VM backups to be run concurrently. The section Recommendations and
considerations for transport modes on page 173 provides information on the
maximum supported concurrent backups for each transport mode.
For example if running 10 VM backups simultaneously, ensure that the client
parallelism in the VADP proxy Client resource is set to 10.
l It is recommended to keep the vCenter and VADP proxy as separate machines to
avoid contention of CPU and memory resources.
l The vSphere client does not need to be installed on the NetWorker server.
l In previous NetWorker releases using VCB, extra space was required for the mount
point on the VCB proxy for copy operations during backup and recovery. NetWorker
releases using the VADP proxy require significantly less space. The section VADP
mount point recommendations and space considerations on page 171 provides
more information.
l Ensure the path specified in VixDisklib and VixMountAPI config files are enclosed in
double quotes as below:
Note
Double quotes should be specified in the path even though the path is already
present.
l EMC recommends using the VADP proxy host as the storage node. This provides the
optimal configuration for any given transport mode as data transfer occurs directly
from the ESX/ESXi datastore to the storage node.
disk.EnableUUID = "true"
Note
Due to the number of issues related to VMware Tools, for VSS integration the minimum
recommended version of VMware is ESX 4.1 Update 1.
Note
Note
This requires that data transport is set to NBD/NBDSSL mode since VMware does not
allow Hotadd mode in conjunction with VMDirectPath.
Note
There are no observed performance differences between physical and virtual proxies
when running on similar hardware.
l The maximum number of concurrent sessions when using a physical proxy is higher
than that of a virtual proxy. The section Recommendations and considerations for
transport modes on page 173 provides more information on concurrent sessions for
specific transport modes.
l Recommendations for a physical proxy is 4 CPU cores with 8GB of RAM.
Recommendations for a virtual proxy is 4 vCPUs and 8GB vRAM per proxy, where each
vCPU is equal to or greater than 2.66 GHz.
l NetWorker supports up to 12 parallel sessions using a single virtual proxy. This refers
to the number of virtual disks processed in parallel, so if a single VM contains
multiple virtual disks, this must be taken into account.
l Number of virtual proxies per ESX host depends only on the type of hardware on
which the ESX has been installed.
l For lower-end ESX hosts, it is recommended not to mix I/O load on ESX (with the
virtual proxy and backup VMs residing on a single ESX), but to have a separate ESX
for the virtual proxy.
l For high-end ESX hosts, it is recommended to have a maximum of 5 virtual proxies
concurrently running on a single ESX host.
l Optimal CPU load and performance when using DDBoost devices is observed with 4
concurrent backups per device. Lower number of parallel sessions to a single device
does not achieve full performance while higher number increases CPU load without
additional performance gain. Based on the CPU load, there is typically no
performance improvement from adding more than 3 DDBoost devices per proxy node.
Note
When the datastore is almost out of space, VMware creates a snapshot named
Consolidate Helper while attempting to delete snapshots. This snapshot cannot be
automatically deleted by the backup application. To remove the Consolidated Helper
snapshot, the VM must be shut down and the snapshot manually deleted from
vCenter before the next backup. Otherwise, change files may accumulate on the
datastore. The accumulation of such files can affect both the backup performance
and the I/O performance of the VM. Information about deleting the Consolidate
Helper snapshot is provided in the following VMware knowledge base article:
http://kb.vmware.com/kb/1003302
To avoid this issue, ensure that there is always sufficient space available for
snapshots.
l In the case of VMs that have a large amount of change rate during backups, the
snapshots can grow in size considerably while the backup is running. Therefore,
ensure that the snapshot working directory on the VMFS datastore has enough space
to accommodate the snapshot during the backup.
l VMs with physical and virtual compatibility RDM disks are not supported for VADP
backups, because VM snapshots cannot be applied to such VMs. During NetWorker
backup of a VM, no RDM related information is backed up, and no RDM disks/data
are restored upon VM recovery. If RDM disks are required, they must be reattached
after the recovery.
Note
If reattaching RDM disks after recovery, make note of all LUNs that are zoned to the
protected VMs.
l VMware snapshots by default reside on the datastore where the VM configuration
files are located. Therefore, ensure that the snapshot working directory supports the
size of all the disks attached to a given VM.
Starting with version 4.0, ESX and ESXi will compare the maximum size of a snapshot
redolog file with the maximum size of files on the datastore. If the file could grow
beyond the maximum size, ESX cancels the Create Snapshot operation and displays
the following error:
snapshots get stored in the working directory. In the case of Disk02, this may
indicate that the redolog file has grown beyond VMFS01’s maximum file limit of
256GB, which is where it will be stored.
To resolve this issue, either change the location of the VM configuration files, or
change the working directory to a datastore with enough block size.
To move the VM configuration files, use Storage VMotion or Cold migration with
relocation of files. More information is provided in the VMware KB article at the
following link:
http://kb.vmware.com/selfservice/microsites/search.do?
cmd=displayKC&externalId=1004040
To change the workingDir directory to a datastore with enough block size, refer to
the VMware KB article at the following link:
http://kb.vmware.com/selfservice/microsites/search.do?
cmd=displayKC&externalId=1002929
The following table indicates the maximum virtual disk file size corresponding to
block sizes on a datastore in ESX/ESXi 4.0:
Table 21 Maximum virtual disk file size and corresponding block size for ESX/ESXi 4.0
The following table identifies the maximum virtual disk file size corresponding to
block sizes on a datastore in ESX/ESXi 4.1:
Table 22 Maximum virtual disk size and corresponding block size for ESX/ESXi 4.1
2 MB 512 GB
4 MB 1024 GB
Procedure
1. Uninstall VMware Tools from the VM.
2. Reboot the system.
3. Reinstall VMware Tools. Ensure to select Custom Install.
4. Deselect VSS.
Note
ESX/ESXi refers to the actual host system and not the VMs to be backed up.
Disable IPv6 using Network Connections in the Control Panel, then add an IPv4
entry like the following to the hosts file on the system where vCenter is installed:
After this entry has been added, run the following command in the VADP proxy
host to verify that the IPv4 address is being resolved:
C:\Users\Administrator>ping <vCenter hostname>
Note
Once the backup of the VM completes, all the above processes exit, releasing the
memory consumed on the proxy host.
l For FLR-enabled Windows backups, use the following information to calculate the
memory required:
n When VADP backups are running, nsrvadp_save > , which runs on the VADP proxy
machine, consumes up to 2MB for every 1GB of virtual disk being backed up.
n The nsrvddk and save processes consume approximately 200MB memory per VM
As an example, if you are running backups for a maximum of 4 VMs concurrently,
then take the 4 Windows VMs with the largest disk sizes in the environment; in
this example, if each VM has the following disk layout:
n VM1: Windows= Disk1-50GB, Disk2-100GB, Disk3-512GB
n VM2: Windows=Disk1-50GB, Disk2-512GB, Disk3-1TB
n VM3: Windows=Disk1-50GB, Disk2-100GB, Disk3-256GB
n VM4: Windows=Disk1-100GB, Disk2-1.5TB
The memory consumed by VADP processes on the proxy would then be:
n VM1: (Maximum sized disk in GB for VM* 2 MB) + 200 MB**= 1224 MB
n VM2: (Maximum sized disk in GB for VM* 2 MB) + 200 MB** = 2248 MB
n VM3: (Maximum sized disk in GB for VM* 2 MB) + 200 MB** = 712 MB
n VM4: (Maximum sized disk in GB for VM* 2 MB) + 200 MB** = 3272 MB
Therefore, the total memory needed on the proxy for VADP processes would be
7456 MB.
Note
**200 MB is the memory needed per Windows VM for the nsrvddk and save
processes.
l If the proxy is also being used as storage node, the following nsrmmd overhead
needs to be included in the total memory requirement:
n DD BOOST per device memory usage- approximately 500MB
n backup to disk per device memory usage- approximately 50MB
in the environment. Allocate at least 10% of this total used space for the
VADP_BACKUPROOT mount point.
So, if each VM in the above example has around 2 disks and each disk has 40GB used
space.
l Total amount of data being backed up=40GB*2*5=400GB
l Total amount needed for mount point=400*10%=40GB
In this case, ensure that the drive specified for VADP_BACKUPROOT has at least 40GB
of free space.
Note
This mount point space is only needed when performing FLR-enabled image level
backups of Windows VMs. It is otherwise very minimal (in the order of a few MB per
VM) when performing image level backups of Linux VMs or FLR-disabled image level
backups of Windows VMs.
VMDirectPath restrictions
The following restrictions apply during the configuration of VMDirectPath:
l The ESX host must be rebooted after VMDirectPath is enabled.
l The VM must be powered down when VMDirectPath is enabled in order to add the
PCI/PCIe device directly to the VM.
l Using fiber channel tape drives in a VM is not supported without VMDirectPath in
production environments due to the lack of SCSI isolation. Tape drives can be
configured and used without VMDirectPath, but the support is limited to non-
production environments.
The VMware knowledge base article esg1010789 provides information on configuring
VMDirectPath:
http://kb.vmware.com/kb/1010789
The following features are not available for a VM configured with VMDirectPath, as the
VMkernel is configured without the respective device under its control when passed to a
VM:
l vMotion
l Storage vMotion
l Fault Tolerance
l Device hot add (CPU and memory)
l Suspend and resume
l VADP Hotadd transport mode (when used as virtual proxy)
Note
If using VMDirectPath in a NetWorker VADP virtual proxy host, then the transport
modes are limited to either NBD or NBDSSL. This is due to a VMware limitation.
Note
If the VMs in the environment have more than 12 disks attached per VM, then use
NBD or NBDSSL mode instead of Hotadd mode.
l The virtual proxy can only back up those VMs whose virtual disk size does not exceed
the maximum size supported by the VMFS datastore where the configuration files of
the virtual proxy reside.
As a best practice, always place the configuration files of the virtual proxy on a
datastore that has a block size of 8MB. This will ensure that the virtual proxy can
back up all of the supported virtual disk sizes.
l The datastore for the VADP proxy VM must have sufficient free space before the
Hotadd backup begins.
l If there are multiple virtual proxies, it is recommended to host all the virtual proxies
in a dedicated ESX/ESXi server. This would keep the virtual proxy resource
consumption of CPU and memory isolated within that ESX/ESXi environment without
impacting the production VMs.
l VMs having IDE virtual disks are not supported for Hotadd mode. Instead, nbd mode
is recommended for these.
l The VM to back up and the VM that contains the Hotadd VADP proxy host must reside
in the same VMware datacenter. This requirement also applies to VM restore — the
VM to restore and the VM where the restore is initiated must reside in the same
VMware datacenter.
l If a backup failure occurs, the virtual proxy may sometimes fail to unmount Hotadd
disks. In such cases, you must manually unmount the Hotadd disks from the virtual
proxy. If any of the client VM disks are still attached to the virtual proxy, perform the
following:
1. Right-click the virtual proxy and go to Edit Settings.
2. Select each of the Hotadd disks and choose Remove.
Note
Ensure that you select Remove from virtual machine and not Remove and delete…
when unmounting.
Note
In the following examples, the backup group parallelism would take effect only
if the VADP proxy host client parallelism is set to an equal or higher number.
One proxy in the environment, all VMs on the same ESX (no cluster)
In the following example, there is a single proxy in the environment and 11 VMs need to
be backed up via NBD/NBDSSL. All 11 VMs are hosted on the same ESX, which is not part
of a cluster, and both of these jobs have to be run at the same time:
l 8 VMs from ESX contains 2 disks disk.
l 3 VMs from same ESX contains 3 disks each.
Use one of the following best practices:
l Set the client parallelism of the proxy to 8.
l Create a single backup group containing all 11 VMs from the given ESX and set the
group parallelism to 8.
Either of the above would ensure that at any given time, the maximum number of disks
being backed up from that ESX will not exceed 20.
Two proxies in the environment, all VMs on the same ESX on DRS-disabled cluster
In the following example, there are two proxies in the environment to back up 11 VMs via
NBD/NBDSSL. All 11 VMs are hosted on the same ESX, which is part of a DRS-disabled
cluster, and both of these jobs have to be run at the same time:
l Proxy1 has been assigned to backup 8 VMs, each VM contains 2 disks.
l Proxy2 has been assigned to backup 3 VMs, each VM contains 3 disks.
Use one of the following best practices:
l Set the client parallelism of Proxy1 and Proxy2 to 5 and 2 respectively.
l Create a single backup group containing all 11 VMs from the given ESX and set the
group parallelism to 8.
Either of the above would ensure that at any given time, the maximum number of disks
being backed up from that ESX will not exceed 20.
Two proxies in the environment, all VMs hosted on DRS-enabled cluster
In the following example, there are two proxies in the environment to back up 11 VMs via
NBD/NBDSSL. All 11 VMs are hosted on one DRS-enabled cluster:
l Proxy1 has been assigned to backup 8 VMs, each VM contains 2 disks.
l Proxy2 has been assigned to backup 3 VMs, each VM contains 3 disks.
Both these jobs have to be run at the same time.
Use one of the following best practices:
l Set the client parallelism of Proxy1 and Proxy2 to 5 and 2 respectively.
l Create a single backup group containing all 11 VMs from the given cluster and set the
group parallelism to 8.
Either of the above would ensure that at any given time, the maximum number of disks
being backed up from that cluster will not exceed 20.
Note
Steps 1 and 2 are only applicable in the case of SAN transport mode where SAN fabric
zoning is already in place such that the VADP proxy host is already displaying the SAN
LUNs in Windows disk management. If this does not apply, skip to Step 3.
diskpart
The diskpart utility starts and prints its own command prompt.
5. Disable automatic drive letter assignment to newly discovered volumes by entering
the following in the diskpart command prompt:
automount disable
6. Clean out entries of previously mounted volumes in the registry by entering the
following in the diskpart command prompt:
automount scrub
nsrvadpserv_tool –p VM_proxy_hostname_or_IP_address
Note
After upgrading the NetWorker server from 7.6 SP1 to 7.6 SP2 or later, the VM Client
resource associated with the VCB proxy does not display the correct information in NMC.
For example, if you are using both VADP and VCB proxies, VM Client resources that are
still associated with VCB proxies will display the VADP proxy when viewing the VM
resource in NMC. The correct information displays in the nsradmin output for the Client
resource.
VCB_TRANSPORT_MODE=nbd VADP_TRANSPORT_MODE=nbd
VCB_HOST=10.31.78.120 VADP_HOST=10.31.78.120
VCB_BACKUPROOT=F:\mnt VADP_BACKUPROOT=F:\mnt
VCB_MAX_RETRIES=10 VADP_MAX_RETRIES=10
VCB_LOOKUP_METHOD=name removed
Assigning the VADP User role to the user specified in the NetWorker Hypervisor resource
Note
Procedure
1. Log in to the vCenter Server with Administrator privileges using vSphere Client.
2. In the left pane, select the vCenter server.
3. In the right pane, click the Permissions tab.
4. Right-click anywhere in the right pane and select Add Permission from the drop-down.
5. Add the NetWorker Hypervisor user and assign the VADP User role.
6. Ensure that Propagate to Child Objects is enabled, then click OK.
Note
The NetWorker server must be at a minimum of version 7.6. If the NetWorker server is not
version 7.6 or 7.6 SP1, it will need to be upgraded prior to performing the proxy client
upgrade.
A NetWorker 7.6 SP2 or later proxy can only be used for VADP based backups and should
be used with a NetWorker 7.6 SP2 or later server.
Make the following changes to the APPINFO attribute of the Client resource for the proxy:
Procedure
1. Change VCB_BACKUPROOT to VADP_BACKUP_ROOT.
2. Change VCB_HOST to VADP_HOST.
3. Change VCB_TRANSPORT_MODE to VADP_TRANSPORT_MODE.
4. If VCB_VM_LOOKUP_METHOD is set to ipdddr, remove that entry; if it is set to name,
the Client resource of the virtual client must be changed, as indicated in step 9.
5. Remove VCB_PREEXISTING_MOUNTPOINT and VCB_PREEXISTING_VCB_SNAPSHOT.
6. Change VCB_MAX_RETRIES to VADP_MAX_RETRIES.
7. Change VCB_BACKOFF_TIME to VADP_BACKOFF_TIME.
8. In the Client resource for the virtual client associated with the proxy, change the
Backup command from nsrvcb_save to nsrvadp_save.
9. If VCB_VM_LOOKUP_METHOD was set to name in the proxy Client resource, add
VADP_VM_NAME to the virtual Client resource’s APPINFO attribute with the value of
the VM Name that is known to the Virtual Center.
Note
The NMC Configuration wizards for NetWorker 7.6 SP2 or later will not work with a
pre-7.6 SP2 server. Information must be entered manually in the Client resource, even
for new proxy clients, until the server is upgraded to NetWorker 7.6 SP2 or later.
Upgrade to use vCenter if ESX/ESXi server was previously used for VM backups
The following upgrade steps must be performed if VM backups were previously
configured directly to the ESX/ESXi server instead of going through the vCenter server.
Licensing 185
Licensing
Guest-based licensing
For guest based backups (not using VCB/VADP) with the NetWorker client installed on
each physical host running a virtualization technology (Virtual Machine), only one Virtual
Edition Client license is required per physical host. The Virtual Edition Client license
backs up an unlimited number of VMs or guest host operating systems.
Guest based backups that use this license include:
l VMWare ESX servers
l Solaris zones
l LDOMs
l LPARs
l nPARs
l VPARs
l Microsoft Hyper-V
l Xen and others
The following licensing model is used:
l One NetWorker Module license per application type, per physical host for non-VCB/
VADP based backups.
l One client connection license per physical host for non-VADP based backups.
l When using VMotion, each ESX server that hosts the source Virtual Machine or
destination Virtual Machine will require the virtual edition client license and the
appropriate application module license.
l For ESX Servers using VMware Distributed Resource Scheduler (DRS) and VMware HA,
a NetWorker Virtual Edition Client is required for each ESX Server in the ESX Cluster
Farm. The appropriate number of module licenses depending upon the applications
running in the farm.
For example, an environment has 60 VMs on 5 ESX Servers. Of the 60 VMs, 6 host SQL
Server, 1 hosts Exchange and 1 hosts SharePoint. DRS and VMotion are used and the
entire farm needs to be protected. The following licenses are needed:
l Qty 5 of NetWorker Virtual Edition Clients (1 for each ESX Server in the farm)
l Qty 7 of NMM licenses
n For SQL, it would be Min (6, 5) = 5
n For SharePoint, it would be Min (1, 5) = 1
n For Exchange, it would be Min (1, 5) = 1
l For application backups, a NetWorker Virtual Edition Client and the appropriate
NetWorker Application module is required for each physical server. One license is
required for each application type (SQL, Exchange, SharePoint, Oracle, and SAP) used
within all of the VMs on a single physical server. There are no changes to model
codes for NetWorker Modules, so use the existing codes and license enablers.
For application protection, one NetWorker Module license is required per application
type, per physical host for all virtualization technologies, including VMware ESX
Server, IBM LPAR, and Solaris Domains.
For example, an ESX server hosting three (3) Exchange servers requires only a single
NMM license. An ESX server hosting three (3) Exchange servers and a SharePoint
server would require two NMM licenses; one license for the three Exchange servers
and one license for the SharePoint server.
VADP licensing
For VADP backups of a VMware environment, one Virtual Edition Client license is required
per VADP proxy host, regardless of the number of VMs and ESX servers configured to
perform backups by using the proxy backup host.
This glossary contains terms related to disk storage subsystems. Many of these terms are
used in this manual.
Backup proxy The system designated as the off-host backup system. This is a host with NetWorker client
package installed and the VADP software.
changed block tracking A VMkernel feature that keeps track of the storage blocks of virtual machines as they
change over time. The VMkernel keeps track of block changes on virtual machines, which
enhances the backup process for applications that have been developed to take
advantage of VMware’s vStorage APIs.
checkpoint A system-wide backup, taken only after 24 hours (and at the time of the checkpoint after
that first 24 hours have elapsed), that is initiated within the vSphere Web Client and
captures a point in time snapshot of the EMC Backup and Recovery appliance for disaster
recovery purposes.
client file index A database that tracks every database object, file, or file system that is backed up. The
NetWorker server maintains a single client index file for each client.
Console Server NetWorker servers and clients are managed from the NetWorker Console server. The
Console server also provides reporting and monitoring capabilities for all NetWorker
servers and clients.
EMC Backup and The EMC Backup and Recovery appliance (or VMware Backup Appliance) is an appliance
Recovery Appliance that, when deployed, enables VMware backup and clone policy creation in NMC, and
enables the EMC Backup and Recovery plug-in in the vSphere Web Client to assign VMs to
those policies.
EMC Data Protection A browser that allows for file-level restores, where specific folders and files are restored to
Restore Client the original virtual machine on Windows and Linux virtual machines.
file-level restore (FLR) Allows local administrators of protected virtual machines to browse and mount backups
for the local machine. From these mounted backups, the administrator can then restore
individual files. FLR is accomplished using the EMC Data Protection Restore Client. See
“Using File Level Restore” on page 63 for additional information on FLR.
hotadd A transport mode where the backup related I/O happens internally through the ESX I/O
stack using SCSI hot-add technology. This provides better backup I/O rates than NBD/
NBDSSL.
inactivity timeout The number of minutes to wait before a client is considered to be unavailable for backup.
JAR (Java Archive) A file that contains compressed components needed for a Java applet or application.
label A NetWorker assigned label that uniquely identifies a volume. Templates can be used to
define label parameters.
managed application A program that can be monitored and/or administered from the Console server.
media database Indexed entries about the location and the life cycle status of all data and volumes that the
NetWorker server manages.
metadata VSS-defined information that is passed from the writer to the requestor. Metadata includes
the writer name, a list of VSS components to back up, a list of components to exclude from
the backup, and the methods to use for recovery. See writer and See VSS component
NBD A transport mode over LAN that is typically slower than hotadd mode. In NBD mode, the
CPU, memory and I/O load gets directly placed on the ESX hosting the production VMs,
since the backup data has to move through the same ESX and reach the proxy over the
network. NBD mode can be used either for physical or virtual proxy, and also supports all
storage types.
NBDSSL A transport mode that is the same as NBD except that the data transferred over the
network is encrypted. Data transfer in NBDSSL mode can therefore be slower and use more
CPU due to the additional load on the VADP host from SLL encryption/decryption.
NetWorker Administrator A default NetWorker server user group that can add, change, or delete NetWorker server
user groups.
NetWorker server The host running the NetWorker server software, which contains the online indexes and
provides backup and recovery services to the clients on the same network. See online
indexes
online indexes Databases on the NetWorker server that contain information about client backups and
backup volumes. See client file index See media database
SAN (storage area A transport mode that, when used, completely offloads the backup related CPU, memory or
network) I/O load on the virtual infrastructure. The backup I/O is fully offloaded to the storage layer
where the data is read directly from the SAN or iSCSI LUN. SAN mode requires a physical
proxy.
save The command that backs up client files and makes entries in the online index.
save set A group of files or a file system that is backed up on storage media.
single step backup and See image level backup and recovery
recovery
storage node A storage device physically attached to another computer whose backup operations are
controlled by the NetWorker server.
update enabler A code that updates software from a previous release. Like other temporary enabler codes,
it expires after 45 days.
VADP An acronym for vStorage APIs for Data Protection. VADP enables backup software to
perform centralized virtual machine backups without the disruption and overhead of
running backup tasks from inside each virtual machineVADP supersedes the VCB
framework for VMware backups.
vCenter An infrastructure management tool that provides a central point for configuring,
provisioning, and managing virtualized IT environments, and is part of the VMware Virtual
Infrastructure package.
Virtual machine Software that creates a virtualized environment between the computer platform and its
operating system, so that the end user can install and operate software on an abstract
machine.
VMDK Virtual Machine Disk (VMDK) is a file or set of files that appears as a physical disk drive to
a guest operating system. These files can be on the host machine or on a remote file
system. These files are commonly called VMDK files because of the .vmdk extension that
VMware adds to these files.
VMWare Backup The VMware Backup Appliance (or EMC Backup and Recovery appliance) is an appliance
Appliance) that, when deployed, enables VMware backup and clone policy creation in NMC, and
enables the EMC Backup and Recovery plug-in in the vSphere Web Client to assign VMs to
those policies.
VMware Tools Installed inside each virtual machine, VMware Tools enhance virtual machine performance
and add additional backup-related functionality.
VSS (Volume Shadow Microsoft technology that creates a point-in-time snapshot of a disk volume. NetWorker
Copy Service) software backs up data from the snapshot. This allows applications to continue to write
data during the backup operation, and ensures that open files are not omitted
writer A database, system service, or application code that works with VSS to provide metadata
about what to back up and how to handle VSS components and applications during
backup and restore. See metadata and See VSS component