Stacking PowerConnect 8100 v1.1
Stacking PowerConnect 8100 v1.1
Stacking PowerConnect 8100 v1.1
Rev. 1.1
This document is for informational purposes only and may contain typographical errors and technical inaccuracies. The content is provided as is, without express or implied warranties of any kind. 2013 Dell Inc. All rights reserved. Dell and its affiliates cannot be responsible for errors or omissions in typography or photography. Dell, the Dell logo, and PowerEdge are trademarks of Dell Inc. Intel and Xeon are registered trademarks of Intel Corporation in the U.S. and other countries. Microsoft, Windows, and Windows Server are either trademarks or registered trademarks of Microsoft Corporation in the United States and/or other countries. Other trademarks and trade names may be used in this document to refer to either the entities claiming the marks and names or their products. Dell disclaims proprietary interest in the marks and names of others. May 2013| Rev 1.1
ii
Contents
Important Firmware Update for PowerConnect 81xx Stacking .................................... 4 Introduction ............................................................................................... 6
Stacking and management ....................................................................................... 7 Simplified firmware updates for stack members ............................................................ 7 Stacking and redundancy......................................................................................... 7 Nonstop forwarding on the stack ............................................................................... 7 Hot add/delete and firmware synchronization .............................................................. 7 Meta-data considerations ........................................................................................ 7 How a Master is selected ......................................................................................... 8 How to select a Master during initial stack setup ......................................................... 10
Appendix A Commands used in this document .................................................... 55 Appendix B - Network switch versions ............................................................... 55 About Dell ................................................................................................ 55
iii
Note: Dell recommends that all PowerConnect switches are updated to the latest firmware.
Note: Dell recommends that all PowerConnect switches are updated to the latest firmware.
Introduction
Most Dell PowerConnect switches today include a stacking feature that allows multiple switches to operate as a single unit. These stacks include up to six Dell PowerConnect 8132/8132F/8164/8164F switches in any combination, use up to four links between stack members, and use any port type on the front panel to create these links A single switch in the stack (known as the Master switch) manages all the units in the stack and uses a single IP address, which allows the user to manage every port in the stack from this one address. This IP address is copied from the Master to the Standby when the Standby is created. If for any reason the Master fails and the Standby takes over as Master, the IP address of the stack remains the same, allowing continuous management of the stack. The new Master unit also continues to use the original Master units MAC addresses, which helps to reduce disruptions to the network. When a failed Master re-joins the stack, it does so as a member (not a Master) unless a new Master has not had time to be elected. Note: Dell PowerConnect 8132, 8132F, 8164, and 8164F series switches can be mixed in any combination within a stack. This document provides an easy to use step-by-step guide on how to configure stacking for the Dell PowerConnect 8132 (Figure 1), PowerConnect 8132F (Figure 2), PowerConnect 8164 (Figure 3) and the PowerConnect 8164F (Figure 4).
Figure 1.
1
10
12
14
16
18
20
22
24
Figure 2.
1
10
12
14
16
18
20
22
24
Figure 3.
1 3 5 7 9 11 13 15 17 19 21 23
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
Figure 4.
1 3 5 7 9 11 13 15 17 19 21
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
Meta-data considerations
When creating a stack, the configuration information is meta-data that is part of the hardware configuration applied at boot time before the switch firmware is started (and before the startup configuration is read). The stack information shown in the startup and running configurations is simply
Stacking Dell PowerConnect Switches: 8132, 8132F, 8164, 8164F copies of the stack configuration for the users knowledge. The actual stack information used by the switch is not that which is stored in the startup configuration. A stack member configuration is always present on stacking capable switches, so there always is a line in the configuration that says stack and a second line that says member even if there are no devices stacked. Since these are stack-capable devices, an un-stacked device is still considered a stack of one. Here is an example configuration of a device that is not stacked. console#show run !Current Configuration: !System Description "PowerConnect 8164F, 5.0.0.0, Linux 2.6.27.47 !System Software Version 5.0.0.0 !Cut-through mode is configured as disabled ! configure slot 1/0 5 ! PowerConnect 8164F slot 1/1 8 ! Dell 10GBase-T Card stack member 1 4 ! PCT8164F exit interface out-of-band ip address 172.25.194.24 255.255.0.0 172.25.194.254 exit interface vlan 1 exit username "admin" password dec68e453164a2 privilege 15 encrypted line telnet enable authentication enableList exit snmp-server engineid local 800002a203001ec9ddad5b exit Notice there is only one member line in the configuration. If there were multiple members in the stack then there would be multiple member lines in the configuration, such as: stack member 1 1 member 2 1 member 3 1 ! PCT8164F ! PCT8164F ! PCT8132F
Note: A single stack member configuration is always present on stack-capable switches even if they are not part of an actual stack. The single switch is considered a stack of one.
3.
A unit is selected as standby by the administrator, and a fail over action is manually initiated or occurs due to a Master unit failure. Note: The terms Master and Manager/Management Unit are often used interchangeably in regards to stacking.
In most cases, a switch that is added to an existing stack becomes a stack member, and not the Management Unit. When a switch is added to the stack, one of the following scenarios takes place regarding the management status of the new switch:
If the switch has the Management Unit function enabled but another Master unit is already active, then the switch changes its configured Management Unit value to disabled. If the Management Unit function is unassigned and there is another Management Unit in the system, then the switch changes its configured Management Unit value to disabled. If the Management Unit function is enabled or unassigned and there is no other Management Unit in the system, then the switch becomes Management Unit. If the Management Unit function is disabled, the unit remains a non-Management Unit.
If the entire stack is powered OFF and ON again, the unit that was the Management Unit before the reboot remains the Management Unit after the stack resumes operation. A Unit number for the switch can be manually set. To avoid unit-number conflicts, one of the following scenarios takes place when adding a new member to the stack:
If the switch has a unit number that is already in use, then the unit added to the stack changes its configured unit number to the lowest unassigned unit number. If the switch added does not have an assigned unit number, then the switch sets its configured unit number to the lowest unassigned unit number. If the unit number is configured and there are no other devices using the unit number, then the switch starts using the configured unit number. If the switch detects that the maximum number of units already exist in the stack making it unable to assign a unit number, then the switch sets its unit number to unassigned and does not participate in the stack.
After the stack is created, the show switch command displays the roles of each switch. console#show switch SW --1 2 3 4 5 6 Management Status ---------Mgmt Sw Stack Mbr Stack Mbr Stack Mbr Stack Mbr Stack Mbr Standby Preconfig Status Model ID --------- ---------PCT8164F Oper Stby PCT8132F PCT8132F PCT8164F PCT8164 PCT8164F Plugged-in Model ID ------------PCT8164F PCT8132F PCT8132F PCT8164F PCT8164 PCT8164F Switch Status ---------OK OK OK OK OK OK Code Version --------5.0.0.3 5.0.0.3 5.0.0.3 5.0.0.3 5.0.0.3 5.0.0.3
Stacking Dell PowerConnect Switches: 8132, 8132F, 8164, 8164F Note that in this example Switch 1 is the Master (Mgmt Sw) and Switch 2 is the Standby (Oper Stby) ready to take over as Master in the event the Master fails. To find the same information from the Web UI go to System > Stack Management > Stack Summary .
Or from the Web UI, go to the System > General > System Information page:
10
Stacking scenarios
The following sections present examples in a variety of areas concerning stacking the Dell PowerConnect 8100 switches and provides step-by-step guidance using the CLI and Web UI, with screen shots as a visual guide. Consult the table of contents above for a list of examples covered in this document. Each scenario in this document assumes that all Dell PowerConnect devices are using the same firmware revision. It is also recommended that all devices are using the latest firmware version. Note: Upgrade the firmware to the latest revision on the units before stacking them. Unless mentioned otherwise, all scenarios below assume the switches are using the static ports that are hard-wired into the switches, and that no modules are installed providing additional ports. However, ports from an installed expansion module are supported and may be used for stacking. The following expansion modules are supported for stacking in the Dell PowerConnect series:
11
Figure 5.
10Gbase-T four-port expansion module for the Dell PowerConnect 81xx and 81xxF
LNK ACT
10GBASE-T MODULE
Figure 6.
40G QSFP+ two-port expansion module for the Dell PowerConnect 81xx and 81xxF
LNK LNK
ACT
QSFP+ MODULE
ACT
Figure 7.
10G SFP+ four-port expansion modules for the Dell PowerConnect 81xx and 81xxF
LNK ACT
With an expansion module installed, the command show switch stack-ports shows the link status, link speed, and stack mode for each port in the module.
Creating a Stack
Examples below provide steps on how to create a stack. Graphics shown in this section only depict some of the possibilities of how to cable together members of a stack. Note: While the cable pictures below come before the configuration steps, it is important not to cable the stack until instructed to do so. Cabling is one of the last steps and comes after configuring all switches used in the stack; however, it is necessary to know exactly each port that is going to be cabled to configure each switch correctly. The Dell PowerConnect 8100 series switches can be stacked up to six high, supporting up to 336x10G ports when two 40G ports on each unit are configured as stacking ports. The stack can contain any combination of Dell PowerConnect 8100 and Dell PowerConnect 8100F switches. The switches can be stacked using any Ethernet port on the front panel, which includes 40Gb QSFP+ ports, 10Gb SFP+ fiber ports, and 10Gb baseT copper ports. Each of these default to Ethernet mode and must be reconfigured as stacking ports in order to stack. This scenario shows steps to create a stack. Figure 8 shows one example of connectivity between stack members.
12
Figure 8.
Stacking Dell PowerConnect 8100 series switches using 40G and 10G stack links
1 3 5 7 9 11 13 15 17 19 21 LNK 23 ACT
LNK
LNK
10
12
14
16
18
20
22
24
ACT
QSFP+ MODULE
ACT
11
13
15
17
19
21
23
25
27
29
31
33
35
37
39
41
43
45
LN K
A 47 CT
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
11
13
15
17
19
21
23
25
27
29
31
33
35
37
39
41
43
45
LN K
A 47 CT
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
11
13
15
17
19
21
23
25
27
29
31
33
35
37
39
41
43
45
LN K
A 47 CT
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
11
13
15
17
19
21
23
25
27
29
31
33
35
37
39
41
43
45
LN K
A 47 CT
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
11
13
15
17
19
21
LNK 23 ACT
LNK
LNK
10
12
14
16
18
20
22
24
ACT
QSFP+ MODULE
ACT
Notice the top two switches are stacked together using four cables plugged into 10G ports. For each remaining switch in the stack, one cable from a 40G stacking port on a switch is connected to a 40G stacking port on the next switch. This process is repeated until all of the devices are connected. To complete the ring topology for the stack, one stacking port on the last switch is connected to a stacking port on the first switch. Things to consider when cabling a stack together: Only use interfaces with the same bandwidth to stack between members. It is not supported to mix 40G QSFP+ ports with 10G SFP+ or 10Gbase-T ports on a switch when stacking. It is okay however to use one interface type between two stack members, then a different interface type between two other stacking members as shown in Figure 8. A QSFP+ port is counted as one port when stacking. Therefore if stacking only two switches together, all QSFP+ ports (including those on an expansion module) can be used to stack between them when in 40G port mode. Up to eight ports may be used on any switch for stacking purposes.
Connecting additional cables in parallel increases the stacking bandwidth. Up to eight ports can be connected in parallel when only stacking two switches. When stacking three or more switches, up to 4 cables can be connected in parallel between members. It is recommended to have the same bandwidth between the stack members. It is also recommended to connect the stack in a ring topology for resiliency. Figure 9 shows an example of connecting four stack ports between each stacking peer. Note: In a stack of three or more switches, Dell strongly recommends connecting the stack in a ring topology so that each switch is connected to two other switches.
13
Figure 9.
1 3
Stacking Dell PowerConnect 8100/8100F series switches using multiple stack links
5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45
LN K A 47 CT
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
11
13
15
17
19
21
23
25
27
29
31
33
35
37
39
41
43
45
LN K
A 47 CT
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
11
13
15
17
19
21
LNK 23 ACT
10
12
14
16
18
20
22
24
Figure 10.
10
12
14
16
18
20
22
24
ACT
QSFP+ MODULE
ACT
11
13
15
17
19
21
LNK 23 ACT
LNK
LNK
10
12
14
16
18
20
22
24
ACT
QSFP+ MODULE
ACT
To use a QSFP+ quad-breakout cable to stack two peers, the QSFP+ port must be set to port mode 4x10G and reloaded before setting it to stack mode (described in the next section). From the interface configuration CLI prompt, use the hardware profile command to set the port to this mode. The command is: console(config-if-Fo5/0/1)#hardware profile portmode 4x10g This command will not take effect until the switch is rebooted. When the portmode changes on a port, so do the interface names. For example, a QSFP+ port may be named Fo1/0/1 when in 40G mode but takes on a new identity as Te1/1/1 through Te1/0/4 when changed to 10G mode. Therefore, if it is desired to use the QSFP+ quad-breakout cable, be sure to set the port mode to 4x10G and reload the switch before setting the ports to stack mode since configuration settings on one port mode does not translate to the other portmode. Also, when in port mode 4x10G it is required that all four of the breakout ports be moved from Ethernet mode to Stack mode to use them for stacking.
14
Te1/0/22 Te1/0/23 Te1/0/24 Fo1/1/1 Fo1/1/2 Te1/1/1 Te1/1/2 Te1/1/3 Te1/1/4 Te1/1/5 Te1/1/6 Te1/1/7 Te1/1/8
Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet
Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet
Link Down Link Down Link Down Link Down Link Down Detach Detach Detach Detach Detach Detach Detach Detach
The example above shows a Dell PowerConnect 8132F with a QSFP+ two-port expansion module installed. The two 40G QSFP+ ports are represented by interfaces F01/1/1 and F01/1/2. We will use these two interfaces for stacking in the example below. Notice that Configured Stack Mode and the Running Stack Mode are currently both Ethernet. Perform the following commands to convert each desired port to Stack mode.
console#config console(config)#stack console(config-stack)#stack-port fortygigabitethernet 1/1/1 stack console(config-stack)#stack-port fortygigabitethernet 1/1/2 stack console(config-stack)#show switch stack-ports
15
Configured Stack Interface Mode ---------- ---------Te1/0/1 Ethernet Te1/0/2 Ethernet Te1/0/3 Ethernet
. . .
Unknown Unknown 40 40
The Configured Stack Mode is now Stack, but the Running Stack Mode is still Ethernet. The Running Mode changes to Stack upon reloading the switch, as instructed below. Save the configuration to the Startup-Configuration. console#copy running-config startup-config This operation may take a few minutes. Management interfaces will not be available during this time. Are you sure you want to save? (y/n) y Configuration Saved! Perform the same steps for the remaining switches. Do not forget to configure the stacking ports on the last and first switch to create a ring topology if desired. Once the switches have been configured, remove power from all switches. While powered off, cable all of the switches together using the stack ports that were configured. Select the switch to be the Master switch and power up that switch only allowing a few minutes to boot up completely. Verify the switch is up by logging into the CLI. Once the Master is up, power up the next switch in line. Allow the second switch 30 seconds to boot up, then power up the third switch. Continue to power up each switch allowing 30 seconds between powering switches. This allows each adjacent switch to be active before the next one. Failure to wait may result in another switch becoming the Master. All subsequent switches will enter the stack as Member Units. Stack Member units serial ports and management IP addresses are not accessible for managing those devices. Only the Masters management ports can be used to monitor and configure ports in the stack. Validation After the entire stack is created, it can be validated with the show switch command from the Master switch:
16
console#show switch SW --1 2 3 Management Status ---------Mgmt Sw Stack Mbr Stack Mbr Standby Preconfig Status Model ID --------- ----------PCT8164F Oper Stby PCT8164 PCT8132 Plugged-in Model ID ----------PCT8164F PCT8164 PCT8132 Switch Status -------OK OK OK Code Version ------5.0.0.3 5.0.0.3 5.0.0.3
The show switch stack-ports command can also be used to see all of the ports that have been added to the stack as well as which ones are being used for stacking. To view only ports that are configured for stacking, use the command show switch stack-ports | include Stack. Figure 11 shows the Stack LED that is located on the back panel of every Dell PowerConnect 8100 series switch.
Figure 11.
When the switch is the Master of a stack, the LED glows solid blue. If it is a stack member only, it glows a solid amber. When in stand-alone mode, the LED is off. Note: Each stack members role (including the Master and Standby) can be defined any time after the initial stack is created.
17
After login, the first screen to appear is the Home screen, which shows the current stacking member number. Before stacking, the single member has the Stack number of 1 (one).
The example above shows a Dell PowerConnect 8132F with a QSFP+ two-port expansion module installed in Slot 1. The two 40G QSFP+ ports are interfaces F01/1/1 and F01/1/2. We will use these two interfaces for stacking in the example below. Click System > Stack Management > Stack Port Summary to bring up the next page used to select the ports for stacking. For this example ports F01/1/1 and F01/1/2 are used.
18
Stacking Dell PowerConnect Switches: 8132, 8132F, 8164, 8164F Selecting the Edit check box activates the drop-down menu in the Configured Stack-mode column. Use this menu to change port modes from Ethernet to Stack.
Clicking Apply at the bottom of the screen with set the Configured Stack Mode to Stack, but the Running Stack Mode remains Ethernet until the switch is reloaded as instructed below. Save the configuration to the Startup-Configuration on the System > File Management > Copy Files page.
19
Perform the same steps for the remaining switches. Dont forget to configure stacking ports on the last and first switch to create a ring topology if desired. Once every switch has been configured, remove power from all switches. While powered off, cable all of the switches together using the stack ports that were configured. Select the switch that is desired to be the Master switch and power up that switch only, allowing a few minutes to boot up completely. Verify the switch is up by logging into the CLI. Once the Master is up, power up the next switch in line. Allow the second switch 30 seconds to boot up, then power up the third switch. Continue to power up each switch allowing 30 seconds between powering switches. This allows each adjacent switch to be active before the next one. Failure to wait may result in another switch becoming the Master. All subsequent switches enter the stack as Member Units. Stack Member units serial ports and management IP addresses are not accessible for managing those devices. Only the Masters management ports can be used to monitor and configure ports in the stack. Validation After the entire stack is created, it can be validated from the Master switch Web UI by going to System > Stack Management > Stack Summary.
20
The following figure shows shows the Stack LED that is located on the back panel of every Dell PowerConnect 8100 series switch.
Figure 12.
When the switch is the Master of a stack, the LED glows solid blue. If it is a stack member only, it glows solid amber. When in stand-alone mode, the LED is off. Note: Each stack members role (including the Master and Standby) can be defined at any time after the initial stack is created.
21
Stacking Dell PowerConnect Switches: 8132, 8132F, 8164, 8164F Caution: 5.0.x.x firmware will not load on a switch with the newer B1 CPU. It is therefore recommended to upgrade all PowerConnect 8100 switches to the latest firmware. See Important Firmware Update for PowerConnect 81xx Stacking at the beginning of this document for more information.
Save the configuration to the Startup-Configuration on the System > File Management > Copy Files page.
22
Te1/0/22 Te1/0/23 Te1/0/24 Fo1/1/1 Fo1/1/2 Te1/1/1 Te1/1/2 Te1/1/3 Te1/1/4 Te1/1/5 Te1/1/6 Te1/1/7 Te1/1/8
Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet
Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet Ethernet
Link Down Link Down Link Down Link Down Link Down Detach Detach Detach Detach Detach Detach Detach Detach
23
Stacking Dell PowerConnect Switches: 8132, 8132F, 8164, 8164F Notice the two 40G QSFP+ ports represented by interfaces F01/1/1 and F01/1/2. These two interfaces will be used for stacking in the example below, though any of the interfaces listed may be used. Perform the following commands to convert each desired port to Stack mode. console#config console(config)#stack console(config-stack)#stack-port fortygigabitethernet 1/1/1 stack console(config-stack)#stack-port fortygigabitethernet 1/1/2 stack
console(config-stack)#show switch stack-ports | include Stack Fo1/1/1 Fo1/1/2 Stack Stack Stack Stack Ethernet Ethernet Link Link Down Link Down Link 40 40
The Configured Stack Mode is now Stack, but the Running Stack Mode is still Ethernet. The Running Mode changes to Stack upon reloading the switch, as instructed below. Save the configuration to the Startup-Configuration. console#copy running-config startup-config This operation may take a few minutes. Management interfaces will not be available during this time. Are you sure you want to save? (y/n) y Configuration Saved! Remove power from the switch. Note: Hot insertion of units into the stack is not supported. Do not connect a new member to the stack while the new unit is powered up. Follow the steps in the following section to properly add the stacking cables and complete the process. Ring vs. daisy-chain topology If the original stack is cabled in a ring topology where a stacking port on the last switch is connected to a stacking port on the first switch, the entire stack continues to work correctly through the process of adding a new switch regardless of where the new switch is cabled within the stack. This is due to the built-in resiliency of the ring topology that allows all switches to remain in communication with each other in the event a single link or switch is lost or removed. When adding a switch to a daisy-chain topology stack, add it to one end of the stack and not in the middle. Adding to the middle requires breaking the daisy-chained stack which will cause the stack to split, creating a new Master on the group of switches that lost contact with the original Master. This 24
Stacking Dell PowerConnect Switches: 8132, 8132F, 8164, 8164F would result in two stacks. Adding a new switch to the either end of the daisy-chain allows all other members to stay in constant communication and in turn allow the stack to stay intact during the process. On a daisy-chain stack: 1. Configure the existing stack with new stack ports to be used to connect to the new switch. 2. Cable the new switch into the existing stack. 3. Power up the new switch. The switch will be added to the stack.
On a ring topology stack: 1. Plug new cables into half of the stack ports configured on the new switch to be added. 2. Unplug the stacking cables from any existing member going to another existing member in the stack. Only unplug the cables from one end, leaving them plugged into the other member. Note: Only half of the stack cables in this member will be unplugged. The cables going in the other direction to a third existing member will not be removed. 3. Plug the other end of the new cables of the switch being added into the stack ports that were unplugged in step 2. 4. Plug the remaining cable ends (removed in step 2) into the remaining stack ports configured on the new switch unit. 5. Power up the new switch. The switch will be added to the stack. Allow a few minutes for the new switch to boot up completely. Validation After the entire stack is created, it can be validated with the show switch command from the Master switch: console#show switch SW --1 2 3 4 Management Status ---------Mgmt Sw Stack Mbr Stack Mbr Stack Mbr Standby Preconfig Status Model ID --------- ----------PCT8164F Oper Stby PCT8164 PCT8132 PCT8132F Plugged-in Model ID ----------PCT8164F PCT8164 PCT8132 PCT8132F Switch Status -------OK OK OK OK Code Version ------5.0.0.3 5.0.0.3 5.0.0.3 5.0.0.3
The example above shows a new stack member (PCT8132F) was added. The show switch stackports command can also be used to see all of the ports that have been added to the stack as well as which ones are being used for stacking. If a switch (SW) number is configured prior to adding it to the stack and there are no other devices using that number, then the switch continues to use the same number. Otherwise, the switch sets its number to the lowest unassigned number upon joining the stack. 25
Stacking Dell PowerConnect Switches: 8132, 8132F, 8164, 8164F Note: Once added to a stack, a switchs out -of-band IP address and console port are no longer accessible. Use the IP address and console port of the Master unit for management access, since the stack now acts as a single large switch. Repeat the above steps to add more new members to the stack.
26
In the Edit column, select the check box to allow editing on the ports to be used for stacking. Then use the drop-down menu in the Configured Stack-mode column to put each port in stack mode. The Configured Stack Mode is now Stack, but the Running Stack-mode does not show Stack until the switch is reloaded, as instructed below. Save the configuration to the Startup-Configuration using the System > File Management > Copy Files page.
27
After saving the configuration, remove power from the switch. Note: Hot insertion of units into the stack is not supported. Do not connect a new member to the stack while the new unit is powered up. Follow the steps in the following section to properly add the stacking cables and complete the process. Ring vs. daisy-chain topology If the original stack is cabled in a ring topology, where a stacking port on the last switch is connected to a stacking port on the first switch, the entire stack continues to work correctly through the process of adding a new switch regardless of where the new switch is cabled within the stack. This is due to the built-in resiliency of the ring topology that allows all switches to remain in communication with each other in the event a single link or switch is lost or removed. When adding a switch to a daisy-chain topology stack, add it to one end of the stack and not in the middle. Adding to the middle requires breaking the daisy-chained stack, which causes the stack to split, creating a new Master on the group of switches that lost contact with the original Master. This would result in two stacks. Adding a new switch to the either end of the daisy-chain allows all other members to stay in constant communication and in turn allow the stack to stay intact during the process. On a daisy-chain stack: 1. Configure the existing stack with new stack ports to be used to connect to the new switch. 2. Cable the new switch into the existing stack. 3. Power up the new switch. The switch will be added to the stack. On a ring topology stack: 1. Plug new cables into half of the stack ports configured on the new switch to be added. 28
Stacking Dell PowerConnect Switches: 8132, 8132F, 8164, 8164F 2. Unplug the stacking cables from any existing member going to another existing member in the stack. Only unplug the cables from one end, leaving them plugged into the other member. Note: Only half of the stack cables in this member will be unplugged. The cables going in the other direction to a third existing member will not be removed. 3. Plug the other end of the new cables of the switch being added into the stack ports that were unplugged in step 2. 4. Plug the remaining cable ends (removed in step 2) into the remaining stack ports configured on the new switch unit. 5. Power up the new switch. The switch will be added to the stack. Allow a few minutes for the new switch to boot up completely. Validation After the entire stack is created, validate it with the show switch command from the Master switch:
The example above shows a new stack member (Unit 4) was added. If a switch (SW) number is configured prior to adding it to the stack and there are no other devices using that number, then the switch continues to use the same number. Otherwise, the switch sets its number to the lowest unassigned number upon joining the stack. Note: Once added to a stack, a switchs out -of-band IP address and console port are no longer accessible to the user. Use the IP address and console port of the Master unit for management access, since the stack now acts as a single large switch. Repeat the above steps to add more new members to the stack.
29
Each member of the stack is updated with the latest firmware simply by updating the Master switch. The commands below demonstrate how to copy the firmware file down to the Master using a TFTP server. The stack needs access to the TFTP server on the network and the firmware file needs to be present in the download folder of the TFTP server. Perform the following command from the CLI interface. Press y when prompted. console#copy tftp://10.10.1.10/PC8100v5.0.0.3.stk backup Transfer Mode.................................. Server IP Address.............................. Source File Path............................... Source Filename................................ Data Type...................................... Destination Filename........................... TFTP 10.10.1.10 ./ PC8100v5.0.0.3.stk Code backup
Management access will be blocked for the duration of the transfer Are you sure you want to start? (y/n) y TFTP code transfer starting 12487236 bytes transferred... File contents are valid. Copying file to flash... 30
Attempting to send the STK file to other units in the stack File transfer operation completed successfully.
Note: This procedure may take a few minutes longer than updating a single, non-stacked switch. Perform another show version command to see the new firmware has been downloaded to all members of the stack. Notice the firmware was only copied into the backup image for each member. console#show version Image Descriptions active : backup : Images currently available on Flash unit ----1 2 3 4 active -----------5.0.0.1 5.0.0.1 5.0.0.1 5.0.0.1 backup -----------5.0.0.3 5.0.0.3 5.0.0.3 5.0.0.3 current-active next-active ----------------- ----------------5.0.0.1 5.0.0.1 5.0.0.1 5.0.0.1 5.0.0.1 5.0.0.1 5.0.0.1 5.0.0.1
The backup column now shows the same values as the active column. The next step is to activate the image that contains the new firmware by using the boot system backup command. console#boot system backup Activating image backup .. console#show version Image Descriptions active : backup : Images currently available on Flash unit ----1 2 3 4 active -----------5.0.0.1 5.0.0.1 5.0.0.1 5.0.0.1 backup -----------5.0.0.3 5.0.0.3 5.0.0.3 5.0.0.3 current-active next-active ----------------- ----------------5.0.0.1 5.0.0.3 5.0.0.1 5.0.0.3 5.0.0.1 5.0.0.3 5.0.0.1 5.0.0.3
31
Stacking Dell PowerConnect Switches: 8132, 8132F, 8164, 8164F Notice the next-active column now shows the same version as the backup column. Next, type the reload command to complete the update. All switches in the stack reloads. console#reload Are you sure you want to reload the stack? (y/n) y Connection to host lost. The Connection to host lost message appears only if performing the reload from a telnet session. It will not appear if performing the command from a console session. Updating and rebooting the stack takes a few minutes longer than a single switch. After reload, the firmware upgrade is complete. To validate, login to the stack Master and perform a show version command. For the example given the following is displayed. console#show version Image Descriptions active : backup : Images currently available on Flash unit ----1 2 3 4 active -----------5.0.0.3 5.0.0.3 5.0.0.3 5.0.0.3 backup -----------5.0.0.1 5.0.0.1 5.0.0.1 5.0.0.1 current-active next-active ----------------- ----------------5.0.0.3 5.0.0.3 5.0.0.3 5.0.0.3 5.0.0.3 5.0.0.3 5.0.0.3 5.0.0.3
Notice as the backup becomes active, the active becomes the backup.
32
Stacking Dell PowerConnect Switches: 8132, 8132F, 8164, 8164F To find the firmware versions the stack members are using, go to System > File Management > Active Images.
Each member of the stack will be updated with the latest firmware simply by updating the Master switch. The screenshot below demonstrate how to copy the firmware to the Master using a TFTP server. The stack needs access to a TFTP server on the network and the firmware file needs to be present in the download folder of the TFTP server. From the System > File Management > File Download page, select the appropriate settings. The most common settings are shown here.
33
Click OK. Note: Be patient as this procedure may take several minutes longer than updating a single, non-stacked switch. The following screen appears for several minutes while the firmware is being downloaded to the Master and distributed to all members of the stack.
34
Once the file has been distributed to the entire stack, the following dialog box appears.
Click Close. Go back to the Active Images screen to confirm that the new firmware was downloaded to all members of the stack. Notice the firmware was only copied into the backup image for each member.
35
The next step is to activate the image that contains the new firmware using the drop-down menus in the Next Active Image column. In this example the backup image is selected for each unit.
After selecting backup for each unit, click Apply. Go to the System > General > Reset page to reload the switch.
36
Click Apply to reload all switches in the stack. If the following screen appears, click OK.
If either of the following screens appear, they are simply notifying the user that the network has been lost. This is only temporarily while the stack reloads.
37
Click OK if prompted with the above screen. Rebooting the stack may take a few minutes longer than a single switch. After reload, the firmware upgrade is complete. To validate each switch, login again to the Web UI of the stack Master, and then go to System > File Management > Active Images.
Notice that as the backup versions become active, the previous active versions now become the backup. This allows the administrator to toggle back to the previous image if needed for troubleshooting. Going back to the previous version is rarely ever used and must be done with extreme caution if the newer firmware has been running a long time with several configuration changes since the initial upgrade. Newer firmware can have dozens of valuable bug fixes that will not be there on the older firmware.
38
:
Te2/0/21 Te2/0/22 Te2/0/23 Te2/0/24 Stack Stack Stack Stack Stack Stack Stack Stack Stack Stack Stack Stack Stack Stack Stack Stack Link Link Link Link Link Link Link Link Up Up Up Up Up Up Up Up 10 10 10 10 10 10 10 10
:
Te3/0/45 Te3/0/46 Te3/0/47 Te3/0/48
:
Note: To narrow the list to only view ports configured for stacking, use the command show switch stack-ports | include Stack. Make sure to capitalize Stack since the command is case sensitive. Look for interfaces shown to be in Stack mode. The logical stack unit number is represented in each interface name. The first number in the interface name is the logical stack unit. For example, interface Te2/0/21 is in logical unit number 2. A blinking LED light can be generated on the back of each PowerConnect 81xx to locate each physical unit. This blinking LED is useful when identifying physical units and ports for running diags, sniffing, mirroring ports, and other basic troubleshooting. It is also helpful when adding, removing, replacing or tracing cables associated with these interfaces. Use the locate switch command to blink the blue Locator LED on the switch unit you are trying to locate. console#locate switch 2 The LED locator light on switch 2 blinks for 20 seconds. The length of time the LED continues to blink can be changed using the locate time <ssss> command, where ssss is the time in seconds for the LED to blink. Removing the physical switch unit from the stack Before removing a physical unit from a stack, prepare ports on the other stack member units to receive the cables and traffic that is redirected to them from the member unit being removed. Consider all
39
Stacking Dell PowerConnect Switches: 8132, 8132F, 8164, 8164F LAGs, VLANs, STP, ACLs, security, and so on, that needs to be configured on the new ports to accept cables, establish links, and begin to forward traffic. Note: It is highly recommended not to continue until these things have been considered and proper preparations are made. Note: Do not remove or re-route stacking cables until prompted in the last step below. Do not remove or re-route stacking cables until prompted. Disconnect all other links on the member to be removed and re-route the traffic that was going through this unit so it now goes through the ports that were prepared on the remaining stack unit members. Caution: In the next step, make sure to keep track of all ports being used for stacking that will be temporarily unplugged. They need to be re-cabled in the following step. Only after re-routing the traffic through the remaining stack units, remove the stacking cables from the switch to be removed. The switch being removed does not need to be powered off. Keeping the switches power on automatically brings it to a stand-along state as the stack cables are removed. In the example below (Figure 13), the red quad-breakout cable is removed along with the switch.
Figure 13.
LNK
LNK
10
12
14
16
18
20
22
24
ACT
QSFP+ MODULE
ACT
11
13
15
17
19
21
23
25
27
29
31
33
35
37
39
41
43
45
LN K
A 47 CT
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
11
13
15
17
19
21
23
25
27
29
31
33
35
37
39
41
43
45
LN K
A 47 CT
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
11
13
15
17
19
21
LNK 23 ACT
LNK
LNK
10
12
14
16
18
20
22
24
ACT
QSFP+ MODULE
ACT
11
13
15
17
19
21
LNK 23 ACT
Use the freed cables or new cables to connect the two switches together that were previously adjacent to the switch being removed. Since there are multiple interface and cable types supported for stacking, a different set of cables may be required to make this connection.
40
Figure 14.
1
LNK
LNK
10
12
14
16
18
20
22
24
ACT
QSFP+ MODULE
ACT
11
13
15
17
19
21
23
25
27
29
31
33
35
37
39
41
43
45
LN K
A 47 CT
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
11
13
15
17
19
21
23
25
27
29
31
33
35
37
39
41
43
45
LN K
A 47 CT
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
11
13
15
17
19
21
LNK 23 ACT
LNK
LNK
10
12
14
16
18
20
22
24
ACT
QSFP+ MODULE
ACT
11
13
15
17
19
21
LNK 23 ACT
10
12
14
16
18
20
22
24
Removal of a stack unit results in one or more freed cables. In this example, there is a freed quadbreakout cable (red) that was used to link the bottom unit to the one directly above it. The second quad-breakout cable is then used to connect the top and bottom units to again complete the ring topology. Note: A QSFP+ quad-breakout cable connects one QSFP+ 40GE port to four SFP+ 10GE ports. Alternatively, once the unit is removed, the remaining quad-breakout cable could be replaced with a QSFP+ cable to connect the top and bottom stack members. This would free up four SFP+ interfaces, but would require the use of another QSFP+ interface. The interfaces used for stacking is based on the administrators preference. Validation To validate the stack unit has been removed and that the remaining stack members are still intact, type the show switch command. console#show switch SW --1 2 3 4 5 Management Status ---------Mgmt Sw Stack Mbr Stack Mbr Stack Mbr Unassigned Standby Preconfig Status Model ID --------- ----------PCT8132 Oper Stby PCT8164 PCT8164 PCT8132F PCT8132F Plugged-in Model ID -----------PCT8132 PCT8164 PCT8164 PCT8132F Switch Status ----------OK OK OK OK Not Present Code Version --------5.0.0.3 5.0.0.3 5.0.0.3 5.0.0.3 5.0.0.3
41
Stacking Dell PowerConnect Switches: 8132, 8132F, 8164, 8164F Removing units from the stack configuration Once a unit has been physically removed, it may be desired to remove it from the configuration as well, if there are no plans on restoring it later. For the above example Unit 5 wasremoved; however, the show switch command continues to show the removed switch in the configuration. Issuing a no member command in Stack Configuration mode deletes the removed switch from the configured stack information. console(config)#stack console(config-stack)#no member 5 console(config-stack)#show switch Management Status ---------Mgmt Sw Stack Mbr Stack Mbr Stack Mbr Standby Preconfig Status Model ID --------- ----------PCT8132 Oper Stby PCT8164 PCT8164 PCT8132F Plugged-in Model ID -----------PCT8132 PCT8164 PCT8164 PCT8132F Switch Status ----------OK OK OK OK Code Version --------5.0.0.3 5.0.0.3 5.0.0.3 5.0.0.3
SW --1 2 3 4
Notice that Unit 5 is no longer present in the configuration. A backup of the configuration (copy running-config startup-config) is required to make the change persist after a reload. Renumbering stack units It may be desired to renumber switches in the stack. While this feature may be used at any time, it is most commonly used after a switch has been removed and the remaining unit numbers are no longer consecutive. While inconsecutive numbers or numbers out of order do not impact traffic in any way, keeping an order can help quickly identify individual units and ports. A switch may be any number between 1 and 6 as long as it is not already taken by another switch. If it is desired to renumber the switch units to show units 1-2-3, instead of 1-2-4, it will require a brief reset of the stack and clear the configuration of the interfaces on the switch receiving the new number. Type the command show switch to see the current order of the units before renumbering. console#show switch Management Standby SW Status Status --- ---------- --------1 Stack Mbr Oper Stby 2 Mgmt Sw 4 Stack Mbr Preconfig Model ID ---------PCT8164F PCT8132F PCT8164F Plugged-in Model ID ----------PCT8164F PCT8132F PCT8164F Switch Status ---------OK OK OK Code Version ---------5.0.0.3 5.0.0.3 5.0.0.3
Caution: Renumbering stack units may hinder management scripts and monitoring software that collects data based on particular port traffic. Use renumbering with caution when monitoring ports and be aware that scripts and monitoring parameters may need to be modified.
42
Type the switch renumber command to change the number of the switch. console(config)#switch 4 The switch will be reset and the configuration of Are you sure you want to renumber 3 to perform unit renumbering switch interfaces will be cleared. renumber? (y/n)y
Allow a few minutes for the switch to renumber, then enter the following. console#show switch Management Standby SW Status Status --- ---------- --------1 Stack Mbr Oper Stby 2 Mgmt Sw 3 Stack Mbr 4 Unassigned
The switch that was Unit #4 is now Unit #3. Unit #4 is no longer present. To remove it from the list, perform the no member command in Stack Configuration Mode. console(config)#stack console(config-stack)#no member 4 console(config-stack)#show switch Management Standby Preconfig SW Status Status Model ID --- ---------- --------- ---------1 Stack Mbr Oper Stby PCT8164F 2 Mgmt Sw PCT8132F 3 Stack Mbr PCT8164F
Configuring a removed unit to be stand-alone After removing a unit from a stack, the unit converts back to its original configuration that it had prior to adding it to the stack, retaining the IP address, VLAN, LAG, and other settings. This allows immediate access to the stand-alone through the out-of-band port if previously configured. Note: A duplicate address could occur on the network if another device was assigned the IP address of the device while it was a stack member. If this occurs simply detach the device from the network and change the IP address through the console port. Meta-data will remains on the switch until cleared or changes are made to the stack settings, but will not affect functions of the switch. For example, a stand-alone switch is assigned to be unit #1. Upon joining the stack it was assigned to be unit #3. When it is removed from the stack it will retain the assignment of unit #3 until changed by the administrator. For instructions on how to make this change, see Renumbering stack on page 42.
43
Note: Clicking the Configured Stack-mode column header brings all Stack ports to the top of the list. Look for interfaces shown to be in Stack mode. The logical stack unit number is represented in each interface name. The first number in the interface name is the logical stack unit. For example, interface Te2/0/21 is in logical unit number 2. A blinking LED light is generated on the back of each Dell PowerConnect 81xx to locate each physical unit. This blinking LED is useful when identifying physical units and ports for running diags, sniffing, mirroring ports, and other basic troubleshooting. It is also helpful when needing to add, remove, replace or trace cables associated with these interfaces. Use the locate switch CLI command to blink the blue Locator LED on the switch unit you are trying to locate. console#locate switch 2 The LED locator light on switch 2 blinks for 20 seconds. The length of time the LED continues to blink can be changed using the locate time <ssss> command, where ssss is the time in seconds for the LED to blink. Removing the physical switch unit from the stack Before removing a physical unit from a stack, prepare the ports on the other stack member units to receive the cables and traffic that will be redirected to them from the member unit being removed. 44
Stacking Dell PowerConnect Switches: 8132, 8132F, 8164, 8164F Consider all LAGs, VLANs, STP, ACLs, security, and so on, that needs to be configured on the new ports in order to accept cables, establish links, and begin to forward traffic. Note: It is highly recommended not to continue until these things have been considered and proper preparations are made. Note: Do not remove or re-route stacking cables until prompted in the last step below. Do not remove or re-route stacking cables until prompted. Disconnect all other links on the member to be removed and re-route the traffic that was going through this unit so it now goes through the ports that were prepared on the remaining stack unit members. Caution: In the next step, be sure to keep track of all ports being used for stacking that will be temporarily unplugged. They need to be re-cabled in the following step. Only after re-routing the traffic through the remaining stack units, remove the stacking cables from the switch to be removed. The switch being removed does not need to be powered off. Keeping the switches powered on automatically brings it to a stand-along state as the stack cables are removed. In the example below, the red quad-breakout cable will be removed along with the switch.
Figure 15.
LNK
LNK
10
12
14
16
18
20
22
24
ACT
QSFP+ MODULE
ACT
11
13
15
17
19
21
23
25
27
29
31
33
35
37
39
41
43
45
LN K
A 47 CT
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
11
13
15
17
19
21
23
25
27
29
31
33
35
37
39
41
43
45
LN K
A 47 CT
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
11
13
15
17
19
21
LNK 23 ACT
LNK
LNK
10
12
14
16
18
20
22
24
ACT
QSFP+ MODULE
ACT
11
13
15
17
19
21
LNK 23 ACT
Use the freed cables or new cables to connect the two switches together that were previously adjacent to the switch being removed. Since there are multiple interface and cable types supported for stacking, a different set of cables may be required to make this connection.
45
Figure 16.
1
LNK
LNK
10
12
14
16
18
20
22
24
ACT
QSFP+ MODULE
ACT
11
13
15
17
19
21
23
25
27
29
31
33
35
37
39
41
43
45
LN K
A 47 CT
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
11
13
15
17
19
21
23
25
27
29
31
33
35
37
39
41
43
45
LN K
A 47 CT
LNK
LNK
10
12
14
16
18
20
22
24
26
28
30
32
34
36
38
40
42
44
46
48
ACT
ACT
11
13
15
17
19
21
LNK 23 ACT
LNK
LNK
10
12
14
16
18
20
22
24
ACT
QSFP+ MODULE
ACT
11
13
15
17
19
21
LNK 23 ACT
10
12
14
16
18
20
22
24
Removal of a stack unit results in one or more freed cables. In this example, there is a freed quadbreakout cable (red) that was used to link the bottom unit to the one directly above it. The second quad-breakout cable is then used to connect the top and bottom units to again complete the ring topology. Note: A QSFP+ quad-breakout cable is one that allows the user to connect one QSFP+ 40GE port to four SFP+ 10GE ports. Alternatively, once the unit is removed, the remaining quad-breakout cable could be replaced with a QSFP+ cable to connect the top and bottom stack members. This would free up four SFP+ interfaces, but requires the use of another QSFP+ interface. The interfaces used for stacking is based on the users preference. Validation To validate the stack unit was removed and that the remaining stack members are still intact, go to System > Stack Management > Stack Summary.
46
Stacking Dell PowerConnect Switches: 8132, 8132F, 8164, 8164F Removing units from the stack configuration Once a unit has been physically removed, it may be desired to remove it from the configuration as well, if there are no plans on restoring it later. For the above example Unit 5 was removed; however, the Stack Summary screen continues to show the removed switch in the configuration. To remove the switch from the configuration, go to the System > Stack Management > Unit Configuration screen. Select the Switch ID of the switch to be removed, and then check the Remove Switch check box at the bottom of the bottom of the screen.
Clicking Apply deletes the removed switch from the stack configuration on the running-configuration. Go back to the Stack Summary screen to verify the switch was removed. A backup of the configuration (copying the running-configuration to the startup-configuration) in System > File Management > Copy Files is required to make the change persist after a reload. Renumbering stack units It may be desired to renumber switches in the stack. While this feature may be used at any time, it is most commonly preferred after a switch has been removed and the remaining unit numbers are no longer consecutive. While inconsecutive numbers or numbers out of order do not impact traffic in any way, keeping an order can help quickly identify individual units and ports. A switch may be any number between 1 and 6 as long as it is not already taken by another switch. If it is desired to renumber the switch units to show units 1-2-3, instead of 1-2-4, it requires a brief reset of the stack and clear the configuration of the interfaces on the switch receiving the new number. View the System > Stack Management > Stack Summary to see the current numbering of each unit. 47
Select the Switch ID to be assigned as the Standby. Use the Unit Type drop-down menu and select Configured Standby. Note: Assigning the current Stack Master to the Standby role is not allowed using this method and results in an error. Instead, use the initiate failover method described below. Click Apply. Copying the running-configuration to the startup-configuration is not required. This setting will be persistent after a reload. Verify the new Standby switch from the Stack Summary screen.
53
If there is a need to change the role of the Master or make the Standby the Master, use the initiate failover command from the Command Line Interface. This command results in a warm restart of the stack Master, triggering the Standby unit to take over as a new Master switch. console(config)#stack console(config-stack)#initiate failover The system has unsaved changes. Would you like to save them now? (y/n) y Configuration Saved! Management unit will be reloaded. Are you sure you want to failover to the backup unit? (y/n) y Connection to host lost. This message is seen in telnet sessions.
If using the CLI through the console port, the session will no longer be valid. The console port on the new Master switch will now be activated for management. The IP and MAC addresses of the stack remains the same with the new Master. If using a telnet session, log in using the same IP address as before.
54
About Dell
Dell is a leading technology provider to commercial and public enterprises around the world.
55