Best Prac of Maintenance
Best Prac of Maintenance
Best Prac of Maintenance
Abstract
Best practices to help provide a reliable, high-performance SAN deployment.
2 Best Practices for Networking and Network © 2019 NetApp, Inc. All rights reserved.
Maintenance on NetApp SolidFire Storage
Systems
TABLE OF CONTENTS
1 Introduction ........................................................................................................................................... 5
3 Best Practices for Networking and Network © 2019 NetApp, Inc. All rights reserved.
Maintenance on NetApp SolidFire Storage
Systems
Version History ......................................................................................................................................... 14
LIST OF FIGURES
Figure 1) NetApp solidfire network diagram. ................................................................................................................13
4 Best Practices for Networking and Network © 2019 NetApp, Inc. All rights reserved.
Maintenance on NetApp SolidFire Storage
Systems
1 Introduction
This report provides guidelines for a reliable, high-performance SAN deployment. Some, or all, of the
items mentioned might apply to your environment. You must consult your network and host systems
vendor for detailed implementation and configuration guidelines that apply to your specific equipment.
SFP+ Connectivity
NetApp SolidFire supports most industry standard SFP+ transceivers, either in the form of direct-attach
cables (DAC) or optical (fiber) transceivers.
Although NetApp SolidFire supports third-party cables, you should follow your network switch vendor's
recommendations for cable selection. Many vendors have restrictions on which cables they support.
5 Best Practices for Networking and Network © 2019 NetApp, Inc. All rights reserved.
Maintenance on NetApp SolidFire Storage
Systems
switch. You should use a switch that implements per-port packet buffers for dedicated high-bandwidth
storage networks.
If the switch does not support per-port packet buffers, try to configure adequate buffer space for the entire
group of ports to minimize the possibility of packet loss.
Flow Control
Ethernet flow control must be implemented consistently across the network infrastructure to handle
network oversubscriptions that can affect performance. Failure to do this can cause packet loss and
degraded network throughput.
You must consider the following for consistent flow control:
• Verify that switches are configured to only receive pause frames (rx).
• Verify that flow control is enabled only on edge ports connected to NetApp SolidFire storage nodes
and iSCSI hosts.
• Do not enable flow control within the network core or between Inter-Switch Links (ISLs). Enabling flow
control can negatively affect all traffic, instead only throttle back certain hosts.
• You do not need flow control between switches because most switches forward at line-rate speeds.
However, you should have adequate bandwidth between ISLs so that the links are not
oversubscribed.
6 Best Practices for Networking and Network © 2019 NetApp, Inc. All rights reserved.
Maintenance on NetApp SolidFire Storage
Systems
• Management 1GbE interfaces require an IP address, network mask, and gateway for proper
operation of the storage network.
• Storage-side 10GbE interfaces require at least an IP address and network mask. Storage-side
interfaces normally do not require any default gateway unless there is a requirement to access the
storage node 10GbE interfaces from a network or subnet other than the storage network itself.
• Bond1G and Bond10G interfaces should be configured with IP addresses that reside on separate,
distinct subnets, and that do not overlap. Configuring both interfaces with IP addresses out of the
same IP subnet is not supported.
Note: If you configure the node to use Bond10G for the management interface instead of the
default Bond1G, you must disable Bond1G on all the nodes.
7 Best Practices for Networking and Network © 2019 NetApp, Inc. All rights reserved.
Maintenance on NetApp SolidFire Storage
Systems
• Disable TCP delayed acknowledgment (ACK) because it is for low-bandwidth environments.
• Disable Large Receive Offload (LRO) on network cards because it is associated with TCP Offload
Engine (TOE) and is known to cause issues with iSCSI traffic.
8 Best Practices for Networking and Network © 2019 NetApp, Inc. All rights reserved.
Maintenance on NetApp SolidFire Storage
Systems
Note: If there is not enough capacity to remove active drives before removing a storage node, you
see the Not Enough Space error message.
3. Remove the storage node from the cluster by doing the following:
a. Click Nodes > Active Nodes and select the storage node you want to remove.
b. Click Remove.
Note: If a storage node is offline for more than five and a half minutes, Element software determines
that the storage node is not coming back to join the cluster and begins to write single replicated
blocks to another available storage node in the cluster. The drives in the offline node are changed
to Failed status. After the storage node is back online, the status of the drive’s changes to
Available.
Note: If you attempt to remove a storage node that has active drives, you see an error message
indicating that there are registered drives with data that are preventing the node from being
removed. You must remove all active drives for the storage node before it can be removed from
the cluster.
9 Best Practices for Networking and Network © 2019 NetApp, Inc. All rights reserved.
Maintenance on NetApp SolidFire Storage
Systems
After the storage node is back online, you must add the available drives to the cluster, depending on how
long it was offline.
10 Best Practices for Networking and Network © 2019 NetApp, Inc. All rights reserved.
Maintenance on NetApp SolidFire Storage
Systems
Changing VLAN Tags on a Switch or a Storage Node
The procedure to change VLAN tags can cause data unavailability issues. You must time the procedure
to coincide with changes on the switches. To avoid a data unavailability issue, you should configure your
switch ports to allow traffic from both the current and future VLAN tags.
Before Element software 9.0, you could not tag primary networks (1GbE or 10GbE) or route (layer 3)
storage traffic to VLAN interfaces. The following recommendations are based on the Element software
9.0 release. For recommendations for previous releases, contact NetApp SolidFire support.
Prerequisites
• The cluster has no unresolved faults, verified by clicking Reporting > Alerts in the Element software
web UI.
• All jobs are complete, verified by clicking Reporting > Running Tasks in the Element OS Web UI.
• All iSCSI client I/O is stopped and all iSCSI clients from the cluster are disconnected.
• All remote replicas are fully synchronized, verified by clicking Volumes > Replicating.
Procedure
1. Choose a nonensemble storage node, and on the Nodes > Active Nodes page, change the VLAN tag
to the new value.
2. Verify that the change succeeded by accessing the storage node UI from the new VLAN
(https://<NodeIP>:442). The change can take up to a minute to take effect.
3. Wait for five minutes.
4. Repeat Steps 1 to 3 for all nonensemble storage nodes.
5. Repeat Steps 1 to 3 for the remaining storage nodes.
6. Access the Element software web UI from the new VLAN and wait for all cluster faults to clear.
7. Add any Available drives back into the cluster.
11 Best Practices for Networking and Network © 2019 NetApp, Inc. All rights reserved.
Maintenance on NetApp SolidFire Storage
Systems
Changing the Bonding Method and MTU Setting
You can change network settings, such as the subnet mask, bonding method, and MTU value from the
storage node UI. Consider the following recommendations before making changes:
• Change one storage node at a time.
• Change the cluster master node only after you finish updating the storage nodes.
• Wait for the block data synchronization to complete between the updates. You can view the
synchronization status by clicking Reporting > Running Tasks in the Element software web UI.
Procedure
1. Select the storage node to update.
2. Review the Element software web UI to confirm that there are no active alerts.
3. Update the storage node UI at https://<NodeIP>:442.
4. View the UI for any faults.
5. Wait for faults, if any, to clear.
6. Navigated to the System Utilities tab on the storage node UI, and restart services.
7. Verify that the change succeeded by accessing the storage node UI from the new VLAN
(https://<NodeIP>:442). The change can take up to a minute to take effect.
8. Wait for faults, if any, to clear.
9. Repeat the above steps for each storage node, as needed.
10. Repeat the above steps for the cluster master node.
12 Best Practices for Networking and Network © 2019 NetApp, Inc. All rights reserved.
Maintenance on NetApp SolidFire Storage
Systems
4 NetApp SolidFire Network
Figure 1 shows the node configuration in a NetApp SolidFire storage network.
13 Best Practices for Networking and Network © 2019 NetApp, Inc. All rights reserved.
Maintenance on NetApp SolidFire Storage
Systems
Version History
Version Date Document Version History
Version 1.0 April 2019 Initial release
14 Best Practices for Networking and Network © 2019 NetApp, Inc. All rights reserved.
Maintenance on NetApp SolidFire Storage
Systems
Refer to the Interoperability Matrix Tool (IMT) on the NetApp Support site to validate that the exact
product and feature versions described in this document are supported for your specific environment. The
NetApp IMT defines the product components and versions that can be used to construct configurations
that are supported by NetApp. Specific results depend on each customer’s installation in accordance with
published specifications.
Copyright Information
Copyright © 2019 NetApp, Inc. All Rights Reserved. Printed in the U.S. No part of this document covered
by copyright may be reproduced in any form or by any means—graphic, electronic, or mechanical,
including photocopying, recording, taping, or storage in an electronic retrieval system—without prior
written permission of the copyright owner.
Software derived from copyrighted NetApp material is subject to the following license and disclaimer:
THIS SOFTWARE IS PROVIDED BY NETAPP “AS IS” AND WITHOUT ANY EXPRESS OR IMPLIED
WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF
MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE, WHICH ARE HEREBY
DISCLAIMED. IN NO EVENT SHALL NETAPP BE LIABLE FOR ANY DIRECT, INDIRECT,
INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF
LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR
OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF
THE POSSIBILITY OF SUCH DAMAGE.
NetApp reserves the right to change any products described herein at any time, and without notice.
NetApp assumes no responsibility or liability arising from the use of products described herein, except as
expressly agreed to in writing by NetApp. The use or purchase of this product does not convey a license
under any patent rights, trademark rights, or any other intellectual property rights of NetApp.
The product described in this manual may be protected by one or more U.S. patents, foreign patents, or
pending applications.
Data contained herein pertains to a commercial item (as defined in FAR 2.101) and is proprietary to
NetApp, Inc. The U.S. Government has a non-exclusive, non-transferrable, non-sublicensable, worldwide,
limited irrevocable license to use the Data only in connection with and in support of the U.S. Government
contract under which the Data was delivered. Except as provided herein, the Data may not be used,
disclosed, reproduced, modified, performed, or displayed without the prior written approval of NetApp,
Inc. United States Government license rights for the Department of Defense are limited to those rights
identified in DFARS clause 252.227-7015(b).
Trademark Information
NETAPP, the NETAPP logo, and the marks listed at http://www.netapp.com/TM are trademarks of
NetApp, Inc. Other company and product names may be trademarks of their respective owners.
15 Best Practices for Networking and Network © 2019 NetApp, Inc. All rights reserved.
Maintenance on NetApp SolidFire Storage
Systems