Xiv Model11x 21x Isg
Xiv Model11x 21x Isg
Xiv Model11x 21x Isg
GC27-3921-16
Note
Before using this information and the product it supports, read the information in “Safety and environmental notices” on
page xiii and “Notices” on page 409.
iv IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Replacing module-to-module (Ethernet and Running basic diagnostic test . . . . . . . 323
serial-to-USB) cables . . . . . . . . . . 273 Collecting system logs . . . . . . . . . 324
Replacing module-to-switch (serial-to-USB) Viewing the event log . . . . . . . . . 325
cables . . . . . . . . . . . . . . . 274 Identifying status LEDs . . . . . . . . . 325
Replacing the InfiniBand switch-to-switch cables 275 Verifying host-system configurations . . . . 335
Replacing the ac-sensor cable from the ATS to Troubleshooting the XIV system . . . . . . . 336
uninterruptible power supply 3 . . . . . . 276 Notebook computer is not communicating with
Replacing the ac-sensor cable from the ATS to the XIV system . . . . . . . . . . . . 336
module 1 . . . . . . . . . . . . . . 277 Troubleshooting data and interface modules . . . 337
Replacing patch-panel (Ethernet and Fibre Physically installed modules are not displayed
Channel) cables. . . . . . . . . . . . 279 in the IBM XIV Storage Management GUI . . . 337
Replacing power cables . . . . . . . . . 281 Module not receiving power . . . . . . . 338
Replacing the rack top cover . . . . . . . . 285 Two modules report input power failures . . . 339
Removing the rack top cover . . . . . . . 286 Communication problems on modules 1, 2, and
Installing the rack top cover . . . . . . . 287 3 . . . . . . . . . . . . . . . . 340
Replacing the standard front and rear rack doors 287 Multiple modules are in the Failed state . . . 340
Removing the standard front and rear rack Module PSU status LED flashes for more than
doors . . . . . . . . . . . . . . . 288 10 seconds . . . . . . . . . . . . . 342
Installing the standard front and rear rack doors 289 Troubleshooting the solid-state drive . . . . . 343
Replacing the rear-door heat exchanger. . . . . 289 Solid-state drive does not pass component test 343
Replacing the rear-door heat exchanger. . . . 291 Troubleshooting InfiniBand switches. . . . . . 344
Draining the heat exchanger . . . . . . . 293 InfiniBand-switch power supply unit status LED
Attaching and detaching the supply hose . . . 294 is not lit or is lit red . . . . . . . . . . 344
Attaching and detaching the return hose . . . 295 InfiniBand switch fan status LED is not lit or is
Removing and installing the hose-retention plate 296 lit red . . . . . . . . . . . . . . . 344
Purging air from the heat exchanger. . . . . 296 InfiniBand switch is not working and
Opening and closing the air-purging valves . . 297 unresponsive . . . . . . . . . . . . 344
Replacing rack side panels . . . . . . . . . 298 Troubleshooting uninterruptible power supplies 345
Removing rack side panels . . . . . . . . 298 Uninterruptible power supply does not power
Installing rack side panels . . . . . . . . 300 on . . . . . . . . . . . . . . . . 345
Replacing the ruggedized brace . . . . . . . 302 Bypass LED on the uninterruptible power
Removing the ruggedized brace . . . . . . 302 supply is lit . . . . . . . . . . . . . 345
Installing the ruggedized brace . . . . . . 302 Fault LED on the uninterruptible power supply
Replacing the radio frequency identification device is lit . . . . . . . . . . . . . . . 345
tag . . . . . . . . . . . . . . . . . 303 Overload and Fault LEDs on the uninterruptible
Removing and recycling coin batteries . . . . . 304 power supply are lit . . . . . . . . . . 346
Removing the coin battery from the M3 and M4 Overload and Bypass LEDs on the
maintenance modules . . . . . . . . . 305 uninterruptible power supply are lit . . . . . 346
Removing the coin battery from the Replace Battery LED on the uninterruptible
maintenance module . . . . . . . . . . 307 power supply is lit or flashing. . . . . . . 346
Removing the coin battery from a data or LEDs on the uninterruptible power supply are
interface module . . . . . . . . . . . 311 flashing sequentially . . . . . . . . . . 347
Troubleshooting cables and ports . . . . . . . 347
Chapter 7. Powering on and off the Failed Fibre Channel ports . . . . . . . . 347
XIV system . . . . . . . . . . . . 313 Running the rack cabling verification test . . . 348
Troubleshooting rear-door heat exchanger . . . . 349
Powering on the XIV system after shutdown . . . 313
Repairing a leak in the water-supply circuit . . 349
Powering on the XIV system after shutdown 313
Powering on the XIV model 281x-215 after
shutdown . . . . . . . . . . . . . 315 Chapter 10. Parts listing . . . . . . . 351
Powering off the XIV system . . . . . . . . 317 Components FRUs . . . . . . . . . . . 351
Powering off XIV system . . . . . . . . 317 Cable FRUs . . . . . . . . . . . . . . 355
Powering off XIV model 281x-215 after Serial cable FRUs . . . . . . . . . . . 355
shutdown . . . . . . . . . . . . . 318 Ethernet cable FRUs . . . . . . . . . . 355
Fibre Channel cable FRU . . . . . . . . 356
Chapter 8. Temperature threshold and InfiniBand cable FRUs . . . . . . . . . 356
Automatic transfer switch ac-sensor cable FRUs 356
events . . . . . . . . . . . . . . 321 Modem cable FRUs . . . . . . . . . . 356
Front-door logo-LED cable FRU . . . . . . 357
Chapter 9. Troubleshooting . . . . . 323 Host-attachment cable FRUs . . . . . . . 357
Tips and techniques for troubleshooting a problem 323 Main-power cable FRUs . . . . . . . . . 357
Verifying the XIV system health . . . . . . 323 Power cord FRUs . . . . . . . . . . . 358
Contents v
Nonstocked FRUs . . . . . . . . . . . . 360 Power-distribution unit 1 (U1). . . . . . . 398
Patch panel cable connections . . . . . . . . 399
Chapter 11. Cable connections . . . . 361 Utility patch panel (U) cable connections . . . 399
Data and interface module cable connections . . . 361 1GbE host-connections patch-panel cable
Upper data-module cable connections . . . . 361 connections . . . . . . . . . . . . . 400
Interface-module cable connections . . . . . 368 10 GbE host-connections patch-panel cable
Lower data-module cable connections . . . . 380 connections . . . . . . . . . . . . . 403
InfiniBand switch cable connections . . . . . . 384 Modem cable connection . . . . . . . . . 406
InfiniBand switch 2 (N2) . . . . . . . . 384 Front-door logo LED cable connection . . . . . 407
InfiniBand switch 1 (N1) . . . . . . . . 386
Maintenance module cable connections . . . . . 388 Notices . . . . . . . . . . . . . . 409
Uninterruptible power-supply cable connections 389 Trademarks . . . . . . . . . . . . . . 410
Uninterruptible power supply 3 (U3) . . . . 389 Homologation statement . . . . . . . . . 410
Uninterruptible power supply 2 (U2) . . . . 391
Uninterruptible power supply 1 (U1) . . . . 392 Glossary . . . . . . . . . . . . . 411
Automatic transfer switch cable connections . . . 394
Power-distribution-unit cable connections . . . . 396
Index . . . . . . . . . . . . . . . 417
Power-distribution unit 2 (U2). . . . . . . 397
vi IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figures
1. Support settings window . . . . . . . . 1 49. Ground and male pins on the main-power
2. Example of a fully-populated XIV system model cable . . . . . . . . . . . . . . . 61
281x-114 or model 281x-214 . . . . . . . 5 50. Removing the filler panel . . . . . . . . 63
3. Example of a minimally populated XIV system 6 51. Securing main-power cables to the patch panel 64
4. Host-connections patch panel with Fibre 52. Top view of the ATS . . . . . . . . . 64
Channel and 10 Gb Ethernet iSCSI ports . . . 8 53. Power sockets and circuit breakers on the side
5. Host-connections patch panel with Fibre of the ATS . . . . . . . . . . . . . 65
Channel and 1 Gb Ethernet iSCSI ports . . . 9 54. LEDs on the single-phase ATS . . . . . . 65
6. Installing the side panel . . . . . . . . 19 55. LEDs on the three-phase ATS . . . . . . 65
7. Rack top cover . . . . . . . . . . . 20 56. Front view of the uninterruptible power
8. Locking screw . . . . . . . . . . . 21 supply . . . . . . . . . . . . . . 66
9. Rack top cover . . . . . . . . . . . 21 57. Uninterruptible power-supply batteries 66
10. Leveling feet . . . . . . . . . . . . 23 58. Uninterruptible power-supply circuit breakers 67
11. Rack tie-down kit for non-raised floors 25 59. Front view of the uninterruptible power
12. Recommended bolt holes in the rack-mounting supply . . . . . . . . . . . . . . 67
plate . . . . . . . . . . . . . . . 26 60. Front view of the maintenance module 68
13. Assembled rack tie-down kit for non-raised 61. Circuit-breaker guards on the
floors . . . . . . . . . . . . . . 27 power-distribution-units . . . . . . . . 69
14. Leveling feet . . . . . . . . . . . . 27 62. Circuit-breakers on the power-distribution-
15. Eyebolts installed in the subfloor . . . . . 28 units . . . . . . . . . . . . . . . 69
16. Rack tie-down kit for raised floors . . . . . 29 63. LEDs on the front of the data and interface
17. Layout and dimensions for circular cutouts 30 modules . . . . . . . . . . . . . 70
18. Assembled rack tie-down kit for raised floors 31 64. Front view of the maintenance module 70
19. Leveling feet . . . . . . . . . . . . 32 65. LEDs on the rear of the data and interface
20. Ruggedized door supports . . . . . . . 33 modules . . . . . . . . . . . . . 71
21. Ruggedized x-brace . . . . . . . . . . 33 66. LEDs on the rear of the maintenance module 71
22. Side-panel retention kit . . . . . . . . 34 67. LEDs on the rear of the InfiniBand switch 71
23. Installing the side panel . . . . . . . . 35 68. Front view of the uninterruptible power
24. Disk-drive-module numbering sequence 36 supply . . . . . . . . . . . . . . 82
25. Front view of a disk drive module . . . . . 37 69. Power sockets and circuit breakers on the side
26. Front view of the data and interface modules 38 of the ATS . . . . . . . . . . . . . 83
27. Disk-drive module latch in the closed and 70. Uninterruptible power-supply cable ports 83
open positions . . . . . . . . . . . 39 71. LEDs on the front of the data and interface
28. Inserting the disk-drive modules into the bay 40 modules . . . . . . . . . . . . . 84
29. Rear view of upper data modules (10 - 15) 41 72. Circuit-breaker guards on the
30. Rear-door heat exchanger option kit . . . . 43 power-distribution-units . . . . . . . . 85
31. Hinge kit . . . . . . . . . . . . . 44 73. Circuit-breakers on the power-distribution-
32. Rear-door heat exchanger . . . . . . . . 45 units . . . . . . . . . . . . . . . 85
33. Hose-retention plate. . . . . . . . . . 46 74. Circuit-breakers on the power-distribution-
34. Water-supply hoses . . . . . . . . . . 46 units . . . . . . . . . . . . . . . 86
35. Air-purging valves . . . . . . . . . . 48 75. LEDs on the front of the data and interface
36. Air-purging tool . . . . . . . . . . . 48 modules . . . . . . . . . . . . . 86
37. Water-return hose . . . . . . . . . . 49 76. Host-connections patch panel with Fibre
38. Hose-retention plate. . . . . . . . . . 50 Channel and 1 Gb Ethernet iSCSI ports . . . 87
39. Water hoses assembled in a raised and 77. Host-connections patch panel with Fibre
non-raised floor. . . . . . . . . . . . 51 Channel and 10 Gb Ethernet iSCSI ports . . . 88
40. Standard door latch . . . . . . . . . . 52 78. Disk-drive-module numbering sequence 95
41. Ruggedized door latch . . . . . . . . . 53 79. Front view of a disk drive module . . . . . 99
42. Rear view of the uninterruptible power supply 55 80. Disk-drive modules in a data or interface
43. Power sockets and circuit breakers on the side module . . . . . . . . . . . . . 100
of the ATS . . . . . . . . . . . . . 56 81. Front view of the data and interface modules 100
44. Uninterruptible power-supply cable ports 57 82. Rear view of upper data modules (10 - 15) 101
45. Ground pin in customer ac-power outlet 58 83. Rear view of lower data modules (1 - 3) 101
46. Voltage pins in customer ac-power outlet 59 84. Front view of the data and interface modules 103
47. Voltage pins in customer ac-power outlet 60 85. Rear view of interface modules (4 - 9) with 10
48. Agency label . . . . . . . . . . . . 61 Gb Ethernet ports . . . . . . . . . . 104
viii IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
181. ATS-to-uninterruptible power-supply 226. Front view of the maintenance module
connections in a two-main-power-cable information and connection panel. . . . . 247
configuration . . . . . . . . . . . 200 227. ATS installation stage A . . . . . . . . 248
182. Power sockets and circuit breakers on the 228. ATS installation stage B . . . . . . . . 248
side of the ATS . . . . . . . . . . . 200 229. ATS installation stage C . . . . . . . . 250
183. Power-cable retainer that is clipped . . . . 201 230. ATS installation stage D . . . . . . . . 252
184. ATS-to-uninterruptible power-supply 231. LEDs on the single-phase ATS . . . . . . 252
connections in a four-main-power-cable 232. LEDs on the three-phase ATS . . . . . . 252
configuration . . . . . . . . . . . 201 233. ATS installation stage E . . . . . . . . 253
185. Power sockets and circuit breakers on the 234. Side view of the ATS . . . . . . . . . 253
side of the ATS . . . . . . . . . . . 202 235. ATS installation stage F . . . . . . . . 254
186. Power-cable retainer that is clipped . . . . 202 236. ATS installation stage G . . . . . . . . 254
187. Main-power cable pigtail retention bracket 203 237. ATS installation stage H . . . . . . . . 255
188. Power sockets and circuit breakers on the 238. ATS installation stage I . . . . . . . . 256
side of the ATS . . . . . . . . . . . 204 239. Side view of the ATS . . . . . . . . . 257
189. Uninterruptible power-supply circuit breakers 204 240. Front view of the maintenance module
190. Front view of the uninterruptible power information and connection panel. . . . . 257
supply . . . . . . . . . . . . . . 205 241. LEDs on the single-phase ATS . . . . . . 263
191. Uninterruptible power-supply serial number 207 242. LEDs on the three-phase ATS . . . . . . 263
192. Front view of the uninterruptible power 243. Front panel of the uninterruptible power
supply . . . . . . . . . . . . . . 209 supply . . . . . . . . . . . . . . 264
193. Uninterruptible power-supply battery cover 209 244. LEDs on the single-phase ATS . . . . . . 266
194. Uninterruptible power-supply batteries 209 245. LEDs on the three-phase ATS . . . . . . 266
195. Uninterruptible power-supply circuit breakers 213 246. LEDs on the single-phase ATS . . . . . . 268
196. Power sockets and circuit breakers on the 247. LEDs on the three-phase ATS . . . . . . 268
side of the ATS . . . . . . . . . . . 213 248. Uninterruptible power-supply cable ports 276
197. Rear view of the uninterruptible power 249. Side view of the ATS . . . . . . . . . 277
supply . . . . . . . . . . . . . . 214 250. Rear view of lower data modules (1 - 3) 278
198. Front view of the uninterruptible power 251. Side view of the ATS . . . . . . . . . 279
supply . . . . . . . . . . . . . . 215 252. Uninterruptible power-supply cable ports 282
199. Power sockets and circuit breakers on the 253. Power sockets and circuit breakers on the
side of the ATS . . . . . . . . . . . 218 side of the ATS . . . . . . . . . . . 283
200. Top view of the ATS . . . . . . . . . 219 254. Front view of the uninterruptible power
201. Side view of the ATS . . . . . . . . . 220 supply . . . . . . . . . . . . . . 284
202. Side view of the ATS . . . . . . . . . 222 255. Rack top cover . . . . . . . . . . . 286
203. Top view of the ATS . . . . . . . . . 222 256. Rack top cover . . . . . . . . . . . 287
204. Side view of the ATS . . . . . . . . . 223 257. Rack doors . . . . . . . . . . . . 288
205. Front view of the uninterruptible power 258. Rack doors . . . . . . . . . . . . 289
supply with the power-off cover removed . . 224 259. Rear-door heat exchanger components 290
206. LEDs on the single-phase ATS . . . . . . 228 260. Rear-door heat exchanger . . . . . . . 292
207. LEDs on the three-phase ATS . . . . . . 228 261. Water-supply hoses . . . . . . . . . 294
208. Front panel of the uninterruptible power 262. Water-return hose . . . . . . . . . . 295
supply . . . . . . . . . . . . . . 229 263. Hose-retention plate . . . . . . . . . 296
209. ATS installation stage A . . . . . . . . 231 264. Air-purging tool . . . . . . . . . . 297
210. ATS installation stage B . . . . . . . . 231 265. Air-purging tool . . . . . . . . . . 298
211. ATS installation stage C . . . . . . . . 233 266. Side-panel retention kit . . . . . . . . 299
212. Power-cable retainer that is not clipped 234 267. Installing the side panel . . . . . . . . 300
213. Power-cable retainer that is clipped . . . . 235 268. Installing the side panel . . . . . . . . 301
214. ATS installation stage D . . . . . . . . 235 269. Side-panel retention kit . . . . . . . . 301
215. ATS installation stage E . . . . . . . . 237 270. Ruggedized x-brace . . . . . . . . . 302
216. ATS installation stage F . . . . . . . . 239 271. Ruggedized x-brace . . . . . . . . . 303
217. LEDs on the single-phase ATS . . . . . . 239 272. Radio frequency identification device tag on
218. LEDs on the three-phase ATS . . . . . . 239 the rack front cover . . . . . . . . . 304
219. ATS installation stage G . . . . . . . . 240 273. Radio frequency identification device tag 304
220. Side view of the ATS . . . . . . . . . 240 274. Riser-card assembly in the maintenance
221. ATS installation stage H . . . . . . . . 241 module . . . . . . . . . . . . . 306
222. ATS installation stage I . . . . . . . . 241 275. Maintenance module battery . . . . . . 306
223. ATS installation stage J . . . . . . . . 242 276. Maintenance module cover removal . . . . 308
224. ATS installation stage K . . . . . . . . 246 277. Air baffle removal . . . . . . . . . . 309
225. Side view of the ATS . . . . . . . . . 246 278. Coin battery location . . . . . . . . . 310
279. Coin battery removal . . . . . . . . . 310
Figures ix
280. Power sockets and circuit breakers on the 314. Cable connections for data module 8 with 10
side of the ATS . . . . . . . . . . . 314 Gb Ethernet ports . . . . . . . . . . 371
281. Uninterruptible power-supply circuit breakers 314 315. Cable connections for data module 7 with 1
282. Front view of the uninterruptible power Gb Ethernet ports . . . . . . . . . . 372
supply . . . . . . . . . . . . . . 315 316. Cable connections for data module 7 with 10
283. Circuit-breaker guards on the Gb Ethernet ports . . . . . . . . . . 373
power-distribution-units . . . . . . . . 316 317. Cable connections for data module 6 with 1
284. Circuit-breakers on the power-distribution- Gb Ethernet ports . . . . . . . . . . 374
units . . . . . . . . . . . . . . 316 318. Cable connections for data module 6 with 10
285. LEDs on the front of the data and interface Gb Ethernet ports . . . . . . . . . . 375
modules . . . . . . . . . . . . . 317 319. Cable connections for data module 5 (front
286. LEDs on the front of the data and interface view) . . . . . . . . . . . . . . 376
modules . . . . . . . . . . . . . 318 320. Cable connections for data module 5 with 1
287. Circuit-breaker guards on the Gb Ethernet ports (rear view) . . . . . . 377
power-distribution-units . . . . . . . . 319 321. Cable connections for data module 5 with 10
288. Circuit-breakers on the power-distribution- Gb Ethernet ports (rear view) . . . . . . 377
units . . . . . . . . . . . . . . 319 322. Cable connections for data module 4 with 10
289. LEDs on the disk drive module . . . . . 325 Gb Ethernet ports . . . . . . . . . . 379
290. LEDs on the front of the data and interface 323. Cable connections for data module 3 with 1
modules . . . . . . . . . . . . . 326 Gb Ethernet ports . . . . . . . . . . 381
291. LEDs on the rear of the data and interface 324. Cable connections for data module 2 382
modules with 1 Gb Ethernet ports only. . . 327 325. Cable connections for data module 1 383
292. Rear view of interface modules (4 - 9) with 326. Cable connections on front side of InfiniBand
10 Gb Ethernet ports . . . . . . . . . 327 switch 2 . . . . . . . . . . . . . 385
293. Front view of the maintenance module 327. Cable connections on rear side of InfiniBand
information and connection panel. . . . . 329 switch 2 . . . . . . . . . . . . . 385
294. LEDs on the rear of the maintenance module 330 328. Port numbering scheme on the InfiniBand
295. LEDs on the rear of the InfiniBand switch 331 switch . . . . . . . . . . . . . . 385
296. LEDs on the front of the InfiniBand switch 331 329. Cable connections on front of InfiniBand
297. Front panel of the uninterruptible power switch 1 . . . . . . . . . . . . . 386
supply . . . . . . . . . . . . . . 332 330. Cable connections on rear of InfiniBand
298. LEDs on the single-phase ATS . . . . . . 333 switch 1 . . . . . . . . . . . . . 387
299. LEDs on the three-phase ATS . . . . . . 334 331. Port numbering scheme on the InfiniBand
300. ATS output power LEDs . . . . . . . . 334 switch . . . . . . . . . . . . . . 387
301. Ethernet ports for connecting to the notebook 332. Maintenance module cabling ports . . . . 388
computer . . . . . . . . . . . . . 337 333. Uninterruptible power-supply 3cable ports 390
302. LEDs on the rear of the data and interface 334. Power-socket number scheme for the
modules . . . . . . . . . . . . . 339 uninterruptible power-supply . . . . . . 390
303. LEDs on the rear of the data and interface 335. Uninterruptible power-supply 2 cable ports 391
modules . . . . . . . . . . . . . 342 336. Power-socket number scheme for the
304. Solid-state disk . . . . . . . . . . . 343 uninterruptible power-supply . . . . . . 392
305. Cable connections for data module 15 361 337. Uninterruptible power-supply 1 cable ports 393
306. Cable connections for data module 14 362 338. Power-socket number scheme for the
307. Cable connections for data module 13 364 uninterruptible power-supply . . . . . . 393
308. Cable connections for data module 12 365 339. ATS cable ports . . . . . . . . . . . 395
309. Cable connections for data module 11 366 340. Power-distribution-unit cable ports . . . . 397
310. Cable connections for data module 10 367 341. Host-connections patch panel with Fibre
311. Cable connections for data module 9 with 1 Channel and 1 Gb Ethernet iSCSI ports . . . 400
Gb Ethernet ports . . . . . . . . . . 368 342. Host-connections patch panel with Fibre
312. Cable connections for data module 9 with 10 Channel and 10 Gb Ethernet iSCSI ports . . 404
Gb Ethernet ports . . . . . . . . . . 369 343. Modem . . . . . . . . . . . . . 407
313. Cable connections for data module 8 with 1 344. Front-door logo LED cable . . . . . . . 408
Gb Ethernet ports . . . . . . . . . . 370
x IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Tables
1. IBM XIV related publications . . . . . . xxiv 37. Module 14 cable connections . . . . . . 363
2. IBM XIV related websites . . . . . . . xxv 38. Module 13 cable connections . . . . . . 364
3. Feature codes for rack configurations . . . . 4 39. Module 12 cable connections . . . . . . 365
4. Fully populated rack limits for data storage 4 40. Module 11 cable connections . . . . . . 366
5. Minimally populated rack limits for data 41. Module 10 cable connections . . . . . . 367
storage . . . . . . . . . . . . . . 5 42. Module 9 cable connections . . . . . . . 369
6. Capacity for XIV systems . . . . . . . . 7 43. Module 8 cable connections . . . . . . . 371
7. Fibre Channel and iSCSI ports on interface 44. Module 7 cable connections . . . . . . . 373
modules . . . . . . . . . . . . . . 7 45. Module 6 cable connections . . . . . . . 375
8. Utility patch panel connections . . . . . . 10 46. Module 5 cable connections . . . . . . . 377
9. Data module weight . . . . . . . . . 101 47. Module 4 cable connections . . . . . . . 379
10. Feature codes for data modules . . . . . 102 48. Module 3 cable connections . . . . . . . 381
11. Interface module weights . . . . . . . 104 49. Module 2 cable connections . . . . . . . 382
12. Feature codes for interface modules . . . . 105 50. Module 1 cable connections . . . . . . . 383
13. Minimum code requirements for DDM 51. InfiniBand switch 2 cable connections 385
intermix . . . . . . . . . . . . . 124 52. InfiniBand switch 1 cable connections 387
14. IBM Storage System temperature thresholds 53. Maintenance module cable connections for
and events . . . . . . . . . . . . 321 1 Gb Ethernet configuration systems. . . . 388
15. Disk drive module LED status . . . . . . 326 54. Maintenance module cable connections for
16. Status LEDs on the front of data and interface 10 Gb Ethernet configuration systems . . . 389
modules . . . . . . . . . . . . . 327 55. Uninterruptible power supply 3 cable
17. Status LEDs on the rear of data and interface connections . . . . . . . . . . . . 390
modules . . . . . . . . . . . . . 328 56. Uninterruptible power supply 2 cable
18. Status LEDs on the front of the maintenance connections . . . . . . . . . . . . 392
module . . . . . . . . . . . . . 329 57. Uninterruptible power supply 1 cable
19. Status LEDs on the front of the maintenance connections . . . . . . . . . . . . 393
module . . . . . . . . . . . . . 330 58. Automatic transfer switch cable connections 395
20. InfiniBand switch LED . . . . . . . . 331 59. Power-distribution-unit cable connections 397
21. Uninterruptible power-supply LEDs . . . . 332 60. Power-distribution-unit cable connections 398
22. ATS LEDs. . . . . . . . . . . . . 334 61. Utility panel cables . . . . . . . . . 400
23. Module to uninterruptible power supply 62. Patch panel 6 cable connections . . . . . 401
connectivity . . . . . . . . . . . . 340 63. Patch panel 5 cable connections . . . . . 401
24. Uninterruptible power supply failure chart 341 64. Patch panel 4 cable connections . . . . . 401
25. XIV system component FRUs . . . . . . 351 65. Patch panel 3 cable connections . . . . . 402
26. Serial cable FRUs . . . . . . . . . . 355 66. Patch panel 2 cable connections . . . . . 402
27. Ethernet cable FRUs . . . . . . . . . 355 67. Patch panel 1 cable connections . . . . . 403
28. Fibre Channel cable FRU. . . . . . . . 356 68. Patch panel 6 cable connections . . . . . 404
29. InfiniBand cables FRUs . . . . . . . . 356 69. Patch panel 5 cable connections . . . . . 404
30. ATS ac-sensor cable FRUs . . . . . . . 356 70. Patch panel 4 cable connections . . . . . 405
31. Modem cable FRUs . . . . . . . . . 356 71. Patch panel 3 cable connections . . . . . 405
32. Front-door logo-LED cable FRU . . . . . 357 72. Patch panel 2 cable connections . . . . . 406
33. Host-attachment cable FRUs . . . . . . 357 73. Patch panel 1 cable connections . . . . . 406
34. Main-power cable FRUs . . . . . . . . 357 74. Modem cable connection. . . . . . . . 407
35. Nonstocked component FRUs . . . . . . 360 75. Front-door logo LED cable connection 408
36. Module 15 cable connections . . . . . . 361
This publication contains the safety notices for the IBM Systems products in
English and other languages. Anyone who plans, installs, operates, or services the
system must be familiar with and understand the safety notices. Read the related
safety notices before beginning work.
Note: This product has been designed, tested, and manufactured to comply with
IEC 60950-1, and where required, to relevant national standards that are based on
IEC 60950-1.
Each safety notice contains an identification number. You can use this identification
number to check the safety notice in each language.
CAUTION:
A caution notice indicates the presence of a hazard that has the potential of
causing moderate or minor personal injury. (C001)
2. Open the IBM Systems Safety Notices.
3. Under the language, find the matching identification number. Review the topics
concerning the safety notices to ensure that you are in compliance.
To view a PDF file, you need Adobe Reader. You can download it at no charge
from the Adobe website (get.adobe.com/reader/).
Laser safety
When using an NVRAM5 or NVRAM6 cluster media converter, the storage system
must be installed in a restricted access location.
CAUTION:
This product contains a Class 1M laser. Do not view directly with optical
instruments. (C028)
This equipment contains Class 1 laser products, and complies with FDA radiation
Performance Standards, 21 CFR Subchapter J, and the international laser safety
standard IEC 825-2.
CAUTION:
Class I
Data processing environments can contain equipment transmitting on system
links with laser modules that operate at greater than Class 1 power levels. For
this reason, never look into the end of an optical fiber cable or open receptacle.
(C027)
Attention: In the United States, use only SFP or GBIC optical transceivers that
comply with the FDA radiation performance standards, 21 CFR Subchapter J.
Internationally, use only SFP or GBIC optical transceivers that comply with IEC
standard 825–1. Optical products that do not comply with these standards might
produce light that is hazardous to the eyes.
xiv IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Usage restrictions: The optical ports of the modules must be terminated with an
optical connector or with a dust plug.
Ladder usage
A step or platform ladder might be necessary to service higher modules.
IBM designs and manufactures equipment to internal and external standards that
require certain environments for reliable operation. Because IBM does not test any
equipment for compatibility with fire suppression systems, IBM does not make
compatibility claims of any kind nor does IBM provide recommendations on fire
suppression systems.
Power cables
Use only IBM approved UL power cables.
For your safety, IBM provides a power cable with a grounded attachment plug to
use with this IBM product. To avoid electrical shock, always use the power cable
and plug with a correctly grounded outlet. IBM power cables used in the United
States and Canada are listed by Underwriters Laboratories (UL) and certified by
the Canadian Standards Association (CSA). For units intended to be operated at
115 volts: Use a UL-listed and CSA-certified cable set consisting of a minimum 18
AWG, Type SVT or SJT, three-conductor cable, a maximum of 15 feet in length and
a parallel blade, grounding-type attachment plug rated 15 amperes, 125 volts. For
units intended to be operated at 230 volts (U.S. use), use a UL-listed and
CSA-certified cable set consisting of a minimum 18 AWG, Type SVT or SJT,
three-conductor cable, a maximum of 15 feet in length and a tandem blade,
grounding-type attachment plug rated 15 amperes, 250 volts. For units intended to
be operated at 230 volts (outside the U.S.), use a cable set with a grounding type
attachment plug. The cable set must have the appropriate safety approvals for the
country in which the equipment is to be installed. IBM power cables for a specific
country or region are usually available only in that country or region.
Connect all power cables to a correctly wired and grounded electrical outlet.
Ensure that the outlets supplies correct voltage and phase rotation according to the
system rating plate. Ensure that all customer facility outlets are protected with
circuit breakers rated at maximum for 30 Amps. The power cable plugs operate as
the system main-disconnection method.
CAUTION:
Depending upon local conditions, the sound pressure might exceed 85 dB(A)
during service operations. Hearing protection must be worn when you are in a
room that has an XIV system while either the front or rear door is open or when
the front and rear doors are not installed.
Leakage current
XIV systems incorporate electromagnetic-interference filter capacitors that are
required to prevent electrical noise from penetrating the power grid. A
characteristic of filter capacitors, during normal operation, is a high amount of
leakage current.
Depending on the storage configuration, this leakage current can reach 100 mA.
For the most reliable operation, do not use Ground Fault Circuit Interrupter
(GFCI), Earth Leakage Circuit Breaker (ELCB), and Residual Current Circuit
Breaker (RCCB) type circuit breakers with XIV systems. The XIV system is certified
for safe operation and is compliant with IEC, EN, UL, CSA 60950-1 standards.
However, if leakage detection circuit breakers are required by local electrical
practice, the breakers must be sized for a leakage-current rating of 300 mA or
greater to reduce the risk of server outage caused by erroneous and spurious
tripping.
Site preparation
The IBM service representative can only minimally reposition the rack at the
installation site, as needed to service the XIV system. The customer is responsible
for using professional movers or riggers in the case of equipment relocation or
disposal.
Attention: Do not tilt the XIV system rack more than 12.5 degrees.
DANGER
xvi IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
xiv10012
Environmental notices
This publication contains all the required environmental notices for IBM Systems
products in 26 languages. The environmental notices that are included are
limitations, product recycling and disposal, product information, battery return
program, flat panel display, monitors and workstations, refrigeration, and
water-cooling system.
To view a PDF file, you need Adobe Reader. You can download it at no charge
from the Adobe website (get.adobe.com/reader/).
Summary of changes
Use this information to learn about new features and enhancements.
This table describes the current technical changes and enhancements to IBM XIV
Storage System as of June 4, 2015.
Function Description
System overview v Updated rack components to include model 281x-216 (see “Rack
components” on page 3).
Installing v Updated instructions for verifying the rack setup for the new M5
maintenance module (see “Verifying the XIV system rack setup”
on page 69).
Relocating an XIV v Updated part number for relocation kit (see “Packing an XIV
system system” on page 96).
Replacing hardware v Added instructions for the M5 maintenance module and guide
components rails (see “Replacing the maintenance module” on page 177).
v Updated instructions for replacing the automatic transfer switch
(see “Preparing to replace the automatic transfer switch” on
page 227).
v Added instructions for maintenance module coin battery
removal (see “Removing and recycling coin batteries” on page
304).
Temperature v Added support for temperature thresholds and events (see
thresholds and events Chapter 8, “Temperature threshold and events,” on page 321).
Troubleshooting v Added support for 10 Gb Ethernet iSCSI LEDs (see “Data and
interface module LEDs” on page 326).
v Added support for the M5 maintenance module (see
“Maintenance module LEDs” on page 329).
Parts listing v Added support for 6 TB Self Encrypting Drives (see
“Components FRUs” on page 351).
v Added support for 480 GB Micron M500DC SSD (see
“Components FRUs” on page 351).
Cable connections v Updated cable connections for M5 maintenance module (see
“Maintenance module cable connections” on page 388).
This table describes the current technical changes and enhancements to IBM XIV
Storage System as of August 21, 2014.
This table describes the current technical changes and enhancements to IBM XIV
Storage System as of November 15, 2013.
Function Description
New XIV system Added installation and service information for the new XIV system
model Model 281x-216.
Replacing hardware v Added instructions for replacing the main-power cables (see
components “Replacing the main-power cables (concurrent)” on page 261).
v Updated instructions for cable placement when removing and
installing the InfiniBand switch (see “Removing the InfiniBand
switch” on page 169 and “Installing the InfiniBand switch” on
page 170).
Powering on and off Updated instructions for powering on after a shutdown (see
the XIV system “Powering on the XIV system after shutdown” on page 313).
Relocating an XIV Updated relocation kit part number (see “Relocating model
system 281x-114 and 281x-214” on page 93).
Parts listing v Added support for 800 GB Micron M500DC SSD (see
“Components FRUs” on page 351).
v Added support for 2 TB, 3 TB, and 4 TB Self Encrypting Drives
(see “Components FRUs” on page 351).
Troubleshooting Added instructions for running the rack cabling verification test
(see “Running the rack cabling verification test” on page 348).
This table describes the current technical changes and enhancements to IBM XIV
Storage System as of August 7, 2013.
Function Description
Replacing hardware Updated instructions for replacing the uninterruptible power
components supplies (see “Replacing uninterruptible power supplies” on page
187) and replacing uninterruptible power-supply batteries (see
“Replacing uninterruptible power-supply batteries” on page 206)
using the Technician Assistant tool.
This table describes the current technical changes and enhancements to IBM XIV
Storage System as of June 27, 2013.
xx IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Function Description
Replacing hardware Updated minimum code requirements for disk drive module
components intermix (see “Enabling DDM intermix” on page 124).
Parts listing Added support for 4 TB disk drive module (see “Components
FRUs” on page 351).
Overview, Replacing Added information for the new model 281x-214 4 TB
hardware components self-encrypting disk drive modules (DDMs), including the
following items: (see “Rack configurations” on page 4, “Capacity”
on page 6, “Processors and memory” on page 7, “Interface
modules” on page 103, and “Data modules” on page 100).
This table describes the current technical changes and enhancements to IBM XIV
Storage System as of May 13, 2013.
Function Description
Replacing hardware Update concurrent ATS replacement procedure to disable
components automatic uninterruptible power-supply calibration before starting
the replacement, and enabling calibration when the replacement is
complete (see “Preparing to replace the automatic transfer switch”
on page 227 and “Completing the service call” on page 258).
MES and RPQ Updated the following installation instructions with additional
installation model support (see “Service publications” on page xxii)
instructions v Capacity Expansion: Data Modules and Interface Modules FFBM
(98Y4955,M08475)
v Ruggedized Rack Kit Installation RPQ (98Y4950,M08491)
v Single-Phase 60 A Two-Main-Power Cable Configuration to
Single-Phase 30 A Four-Main-Power Cable Configuration
Conversion RPQ (98Y4953,M08491)
v Ruggedized Rack Kit Installation MES (98Y5052,M08512)
v ATS and Line Cords Installation FFBM (98Y5050,M08512)
v Main-Power Cables Installation FFBM (98Y5048,M08512)
v USB Modem Installation FFBM (98Y5049,M08512)
v Host-Attachment Cables Installation FFBM (98Y5051,M08512)
CAUTION:
Servicing of this product or unit is to be performed by trained service
personnel only. (C032)
CAUTION:
These notices indicate a situation that is potentially hazardous to people because
of some existing condition or where a potentially dangerous situation might
develop because of some unsafe practice.
DANGER
These notices indicate a situation that is potentially lethal or hazardous to
people. For example, after a computer side panel is removed, exposed
high-voltage wires might be lethal.
Service publications
Use these links to access the service-related information for the IBM XIV Storage
System models 281x-114, 281x-214, 281x-215, and 281x-216.
To view a PDF file, you need Adobe Reader. You can download it at no charge
from the Adobe website (get.adobe.com/reader/).
Information center
From the IBM XIV Storage System Service information center, you can browse all
product and service documentation.
Publications
xxii IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Title Description Order number
IBM XIV Storage System Gen3 This document describes how to SC27-5416
Model 281x-215 Rack Installation set up the XIV model 281x-215
Guide rack, including installing the rack
migration kit and inserting the
hardware components into the
customer rack.
Note: This document is used with
the IBM XIV Storage System Gen3
Models 281x-11x and 281x-21x
Installation and Service Guide to
complete the installation.
IBM XIV Storage System Safety This document provides service GA32-0832
Notices information for the IBM XIV
Storage System, including
installing a new system, replacing
FRU components, and
troubleshooting hardware
problems.
To view a PDF file, you need Adobe Reader. You can download it at no charge
from the Adobe website (get.adobe.com/reader/).
Information centers
v IBM XIV Storage System Information Center website (ibm.com/support/
knowledgecenter/STJTAG)
From the IBM XIV Storage System Information Center, you can browse all
product documentation.
v IBM Storage Host Software Solutions Information Center website
(http://pic.dhe.ibm.com/infocenter/strhosts/ic/index.jsp)
From the Storage Host Software Solutions Information Center, you can browse
documentation for platform and application integration software that is
supported by IBM XIV Storage System.
Publications
Various IBM Redbooks® publications, Redpapers, and white papers are available
for the IBM XIV Storage System. For more papers, see the IBM XIV Storage System
website (http://www.ibm.com/systems/storage/disk/xiv/).
Table 1. IBM XIV related publications
Title Description
IBM XIV Storage System: This Redbooks publication describes the concepts,
Architecture, Implementation, and architecture, and implementation of the XIV system,
Usage which is a scalable enterprise storage system that is
based on a grid array of hardware components.
IBM XIV Storage System with the This Redbooks publication describes how you can
Virtual I/O Server and IBM i connect the XIV system to the IBM i operating system
through the Virtual I/O Server (VIOS). A connection
through the VIOS is especially useful for IT centers
that have many small IBM i partitions. When you use
the VIOS, the Fibre Channel host adapters can be
installed in the VIOS and shared by many IBM i
clients by using virtual connectivity to the VIOS.
xxiv IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 1. IBM XIV related publications (continued)
Title Description
XIV Storage System: Host Attachment This Redbooks publication describes how to attach an
and Interoperability XIV system to various hosting operating systems in
combination with databases and other
storage-oriented application software. It also provides
solutions for combining the IBM XIV Storage System
with other storage systems, host servers, or gateways.
IBM XIV Storage System: Copy This Redbooks publication describes IBM XIV Storage
Services and Migration System copy and migration functions for various data
protection scenarios to enhance your business
continuance, data migration, and online-backup
solutions. These include point-in-time copies (also
known as snapshots and full volume copies) and
remote-copy capabilities in synchronous or
asynchronous mode. This book also describes how to
integrate the snapshot function with the IBM Tivoli®
FlashCopy® Manager, built-in migration capability,
and migration alternatives that are based on the IBM
SAN Volume Controller.
Related websites
View these websites to get more information about the XIV system.
Table 2. IBM XIV related websites
Title Description
IBM website Find more information about IBM products and
services.
IBM Support Portal website Find support-related information such as downloads,
(www.ibm.com/storage/support) documentation, troubleshooting, and service requests
and PMRs.
IBM Directory of Worldwide Find contact information for general inquiries,
Contacts website technical support, and hardware and software
support by country.
IBM XIV Storage System website Use this website to learn about the XIV system,
(http://www.ibm.com/systems/ including features and hardware summary. This
storage/disk/xiv/) website also has links to white papers, Redbooks
publications, and product documentation.
IBM Systems Storage forum website Use this forum to share ideas with knowledgeable
(www.ibm.com/developerworks/ experts and discover how the latest IBM storage
forums/forum.jspa?forumID=846) solutions can address your business challenges.
Forum topics include storage management, storage
virtualization, business continuity, infrastructure
simplification, disk storage systems, and storage
software products and solutions.
Ordering publications
The IBM Publications Center is a worldwide central repository for IBM product
publications and marketing material.
Procedure
To submit any comments about this book or any other IBM XIV Storage System
documentation:
xxvi IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Chapter 1. Setting the activity level for Support access
An activity level can be set for Support access allowable by the customer.
Select the activity level for Support access. Any activity level above the selected
level is subject to customer permission.
Procedure
1. From the XIV GUI, select Systems > System Settings > Support. The following
window is displayed:
2. In the Support Access Level field, select one of the following options:
v None - No access is allowed without customer permission. Connecting to the
system requires previous approval from the customer. If approval is received,
all actions can be performed. Once approved, connecting to the system,
guided repairs, reports and the rest are not blocked.
v Diagnostic - Access is granted for diagnostic purposes only (for example,
X-Ray). Allows X-Ray collection and view/list/status actions. Other actions
require permission.
v No impact - Access is granted for diagnostic and non-impacting changes.
Any change that could possibly result in impaired/reduced/impacted host
IO requires customer permission.
v Full - No prior permission is required to perform any repair action. Access is
granted for all activities.
3. Click Update to save your settings.
Rack components
This information lists the components that are supplied with each XIV system.
The following components are supplied with each XIV model 281x-216:
v Three to nine data modules, each with 12 disk drive modules (DDMs) and one
optional solid-state drive (SSD)
v Three or six interface modules, each with 12 DDMs and one optional SSD
v Three uninterruptible power supplies
v Two InfiniBand switches
v One maintenance module
v One automatic transfer switch (ATS)
v One modem
v Six host-connections patch panels with Fibre Channel and Ethernet (iSCSI) ports
Rack configurations
The IBM XIV Storage System supports racks that contain a total of 6 or 9-15
modules Seven-module and eight-module configurations are not supported.
Table 3 shows the various system configuration options with their feature codes.
Table 3. Feature codes for rack configurations
Feature description Feature code
6 module initial capacity 806
9 module initial capacity 809
10 module initial capacity 810
11 module initial capacity 811
12 module initial capacity 812
13 module initial capacity 813
14 module initial capacity 814
15 module initial capacity 815
The IBM XIV Storage System requires a corresponding software license for each
entitled data or interface module.
Partially populated configurations have the same power, floor planning, hardware,
software, and cabling configurations as fully populated systems. In other words,
partially populated racks are identical to fully populated rack, except that they
have fewer modules and therefore less storage capacity. XIV systems with only six
modules also have fewer usable Fibre Channel and iSCSI ports.
A fully populated rack contains nine data modules and six interface modules, for a
total of 15 modules.
Each module contains twelve 1 TB limited capacity, 2 TB, 3 TB, 4 TB, or 6 TB disk
drive modules (DDMs), for a total of 180 DDMs.
Table 4 shows the various configuration limits for a fully populated rack's data
storage.
Table 4. Fully populated rack limits for data storage
XIV systems with limited capacity DDMs Amount to be used for data storage
1 TB 81 TB
2 TB 161 TB
3 TB 243 TB
4 TB 325 TB
6 TB 485 TB
4 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
The following figure shows an example of the front and rear views of a fully
populated XIV system.
a aa
aaaaaaaaa
a
aaaaaaaaa aaaaaaaaaaaaaa
aaaaa aaaaaaa aaaaaaa aaaaa aaaaaa aaaaaaaaa aaaaaaaa
aaaaaaa aaaaaaa
aaaaaaaa
aaaaa
aaaaaaaaaa
aaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
aaaaa
aaaaaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
aaaaaaaa
aaaaa
aaaaaaaaaa
aaaaaaa
Data module 15 aaaaaa
a a a
aaaaaaaaa
aaaaaa
aaaaaa
a a a
aaaaaaaaa
aaaaaaa
aaaaaaa
a a a a
a a a a
aaaaaaaaaaaaaaaaa
a a a a a a a a a a a a aaaaaaaaa aaaaaaaaaaaaaaa
aaaaaaa aaaaaaa aaaaaaa aaaaaaa aaaaaa aaaaaaaa aa a a aa
aaaaa
aaaaaaaaaa
aaaaa
a
aaaaaaaaa
a a a
aaaaaaaaaa
a a a
aaaaaaaaaa
Data module 14 aaaaaa
aaaaaa aaaaaaaaaa aaaaaaaaaaa
aaaaaaa a a a a
aaaaaaaa
aaaaa aaaaa aaaaaaa aaaaaaa aaaaaa
aaaaaa aaaaaaa
a
aaaaaaaaa a
aaaaaaaaa aaaaaaaa aaaaaaaa aaaaaa aaaaaaa
aaaaa aaaaa aaaaa aaaaa a a a a a a a
a aa aa a aa aa aaaaaaa aaaaaaa aaaaaaaaa aaaaaaaaaaaaaaa
a a a aaaaa aaaaa aaaaa
aaaaaaa aaaaa aaaaa aaaaa aaaaaa aaaaaaaa aa a a aa
aaaaaaaaaaa
aaaaaaaa
aaaaa
aaaaaaaaaa
aaaaaaa
a a a
aaaaaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
a a a
aaaaaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
a a a
aaaaaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
a a a
Data module 13 aaaaaa
a a a
aaaaaaaaa
aaaaaa
aaaaaa
a a a
aaaaaaaaaa
aaaaaaa a a a a
aaaaaaa
aaaaaaa
a a a a
aaaaaaa aaaaaaa aaaaaaa aaaaaaa aaaaaaaaa aaaaaaaaaaaaaaa
a a a
aaaaaaaaaa
aaaaaaa
aaaaa
a
aaaaaaaaa
aaaaa
a
aaaaaaaaa
a a a
aaaaaaaaaa
aaaaaaa Data module 12 aaaaaa
aaaaaa
aaaaaa
aaaaaa
aaaaaaaaa a a a a
aaaaaaaaaaaaaaaaaaaa
aaaaaaaa a a a aa
a
aaaaa aaaaa aaaaaa aaaaaaa
aaaaaaaa a
aaaaaaaaa a
aaaaaaaaa aaaaaaaa aaaaaaa
a
aaaaaa a a a a
aaaaa aaaaa aaaaa aaaaa a a a
aaaaaaa aa aa a aa aa a aaaaaaa
aaaaa aaaaa a a a
aaaaaaa
a a a
aaaaaaa
Data module 11 aaaaaaaaa
aaaaaa aaaaaaaaa
aaaaaaaaaaaaaa
a
aaaaa aaaaa aaaaaaaa
aaaaaaaaaa aaaaaaaaaa aaaaaaaa aaaaaaaa aaaaaa aaaaaaaaa a a a a
aaaaa aaaaa
a a a aaaaaaaaaaaaaaaaa
a a
aaaaa aaaaa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaa aaaaaaa
aaaaaaa
aaaaaaaaaa aaaaaaaaaa aaaaaa aaaaaaa
aaaaaaa aaaaaaa aaaaaa
aaaaa
a a a
aaaaaaa
a a a
aaaaaaaaaa
aaaaa
a a a
aaaaaaa
aaaaa
aaaaaaaaaa
a a a
aaaaaaa
aaaaa
aaaaaaaaaa
a a a
aaaaaaa
a a a
aaaaaaaaaa
Data module 10 a a a
aaaaaaaaa
aaaaaa
aaaaaa
a a a
a a a a
aaaaaaaa
aaaaaaaaaaaaaaa
aaaaaaaaaa
aaaaaaaa
a a a a
aaaaaaa aaaaaaaaa
aaaaaaa aaaaa aaaaa aaaaaaa aaaaaaaaa aaaaaaa
aaaaaaaa
aaaaa
aaaaaaa
a a a
aaaaaaa
aaaaaaaaaa
aaaaa
a a a
aaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
a a a
aaaaaaa
aaaaa
aaaaaaaa
aaaaa
aaaaaaa
a a a
aaaaaaa
Interface module 9 aaaaaa
aaaaaa
aa aa aa
aaaaaa
aaaaaa
aaaaaa
aaaaaaa
a a a a
aaaaaaaa
aaaaaaaaaaaaaaa
aaaaaaaaaa
aaaaaaaa
aaaaaaaa
aaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaa a a a a
aaaaaaa a a a a
aaaa
aaaaaaa
aaaaa
aaaaaaaaaa
aaaaaaa
a a a
aaaaa
aaaaaaaaaa
aaaaa
a a a
aaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
a a a
aaaaaaa aaaaaaa
aaaaa
aaaaaaaaaa
aaaaaaa
a a a
Interface module 8 aaaaaaaaa
aaaaaa
aaaaaa
a a a
aaaaaaaaa
aaaaaa
aaaaaaa
aaaaaaa
a a a a
aaaaaaaaaaaaaaa
aaaaaaaa aaaaaaaa
aaaaa aaaaa aaaaa aaaaa aaaaaa aaaaaaaaaa a a a a
aaaaaaaaaa
aaaaa
a
aaaaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
aaaaaaaa
aaaaa
aaaaaaaaaa
aaaaaaa
aaaaaaaa
aaaaa
aaaaaaaaaa
aaaaaaa
Interface module 7 a a a
aaaaaaaaa
aaaaaa
aaaaaa
a a a
aaaaaaa aaaaaaaaa
aaaaaaa
aaaaaaa
a a a a
a a a a a a a a a a a a aaaaaaaaa aaaaaaaaaaaaaaa
aaaaaaa
aaaaa
aaaaaaaa
aaaaaaa
aaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
aaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
aaaaaaa
aaaaa
aaaaaaaa
aaaaaaa
InfiniBand switch 2 aaaaaa
aaaaaa
a a a
aaaaaaaaa
aaaaaa
aaaaaaaa
aa aaaaaaaaaa
a aaaaa a a a a
aaaaa
aaaaaa
a a
a
a a aa
aaaaaaaaaaa
aaaaa
aaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaa aaaaaa a a aaa
aaaaaa a aa
a a
aaaa
aaaaaaa
a
aa
aaaaa
aaaaaa aaaaaaaa
a a aaaaaaa
aaaa aaaaaaaaaa
aaaaa
aaaaaaaa
a a a
aaaaa
aaaa a aaaa
a a
aaaa
aaaaaaa
a
aa
InfiniBand switch 1 a a a
a
a a aa aaaa aaaaaaaaaa aaaaa aaaa a
aaaa a a a a a a a a a a a a aa
a
aaaa
aaa
aaaaaaa
a a
aaaaaaa aaaaaaa aaaaaaa
Interface module 6 aaaaaaaaa
aaaaaa aaaaaaaaaaaaaaa
a
aaaaaaaa aaaaaaaa
aaaaa aaaaa aaaaa aaaaa aaaaaa aaaaaaaaaa a a a a
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa a a a
aaaaaaaaa aaaaaaa aaaaaaaaa
a a
aaaaa aaaaa aaaaa aaaaa aaaaaa aaaaaaa
a a a a
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaa aaaaaaa
Interface module 5
a
a a a aaaaa aaaaa a a a a a a
aaaaa a a a a a a aaaaa aaaaaaaaa aaaaaaaaaaaaaaa
aaaaaaa aaaaaaa aaaaaaa aaaaaaa aaaaaa
aaa
a
a aaaaaaaa a a aa
aaaaa aaaaa aaaaa aaaaa aaaaaa aaaa a aaaaaaaaaaaaaaaa
aa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa a a a aa aaaa a
a
aaaaa aaaaa aaaaa aaaaa aaaaaaaaa a
aaaaaaaa
aaaaaa aa a a a
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa a aaaaa
Interface module 4 aaaaaa
a
a a a aaaaa aaaaa a a a a a a
aaaaa a a a a a a aaaaa aaaaaaaaa aaaaaaaaaaaaaaa
aaaaaaa aaaaaaa aaaaaaa aaaaaaa aaaaaa
a
aaaaa aaaaa aaaaa aaaaa aaaaaa aaaaaaaa a
aaaa a a
aaaaaa
a aaaaaaaa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa a a a aa aaaaa aaaaaaaa
a
aaaaaaaaa a
aaaaa
aaaaaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
aaaaaaaaaa
Data module 3 aaaaaa
aaaaaa
aaaaaaa
aa a a a
a aaaaa
a
a a a aaaaa aaaaa a a a a a a
aaaaa a a a a a a aaaaa aaaaaaaaa aaaaaaaaaaaaaaa
aaaaaaa aaaaaaa aaaaaaa aaaaaaa
aaaa
aaaaaa aaaaaaaa aa a a a
aaaaa aaaaa aaaaa aaaaa aaaaaa a a a aaaa aaaaaaaa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa a a a
aaaaaaaaa aaaaaa a aaaaaaaa
aaaaa aaa
aaaaa
aaaaaaaaaa
a a a
aaaaa
aaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
a a a
aaaaaaa
aaaaa
aaaaaaaaaa
aaaaa
a a a
aaaaaaa
aaaaa
aaaaaaaaaa
a a a
aaaaa
aaaaaaa
Data module 2 aaaaaa
aaaaaa
a a a
aaaaaaaaa
aaaaaa
a aaaaa
aaaaaaa
aaaaaaaa
aaaaaaaaaaaaaaa
a
aaaa a a
aaaaa aaaaa aaaaa aaaaa aaaaaa a a a aaaa aaaaaa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa
a a a
aaaaaaaaa aaaaaa a aaaaaaaa
aaaaa aaa
Data module 1
aa
aaaaa aaaaa aaaaa aaaaa aaaaaa a aaaaa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaa
a a a aaaaaaa
a a a aaaaa aaaaa a a a aaaaaaaaa aaaaaaaaaaaaaaa
aaaaa a a a a a a aaaaa aaaaaa
aaaaaaa aaaaaaa aaaaaaa aaaaaaa aaaaaa aaaaaaaa aaaaaaaaa
aaaaa aaaaa aaaaa aaaaa a a a aaaaaaaaaaaaaaaaaaaa aa
aaaaaaaaa aa a aaa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaa a a
aaaaaa a aaaaa
aaaaa
aaaaaaaaaa
a a a
aaaaa
aaaaa
aaaaaaaaaa
aaaaa
a a a
aaaaa
aaaaaaaaaa
aaaaa
a a a
aaaaa
aaaaaaaaaa
a a a
aaaaa
Modem aaaaaa
a a a aaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
a a a a a a a a a a a a a a a a a a a a
Uninterruptible power supply 3
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
Uninterruptible power supply 2
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa aaaaaaaaa
a a a a a a a a a a a a a a a a a a a a aaaaaa
aaaaaa
aaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
Uninterruptible power supply 1 aaaaaa
aaaaaa
a a a
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
a a a a a a a a a a a a a a a a a a a a
xiv10398
Front Rear
Figure 2. Example of a fully-populated XIV system model 281x-114 or model 281x-214
A minimally populated rack contains three data modules and three interface
modules, for a total of six modules.
Table 5 shows the various minimal configuration limits for a rack's data storage.
Table 5. Minimally populated rack limits for data storage
XIV systems with limited capacity DDMs Amount to be used for data storage
1 TB 28 TB
2 TB 55 TB
3 TB 84 TB
4 TB 112 TB
6 TB 169 TB
The following figure shows an example of the front and rear views of a minimally
populated XIV system.
Chapter 2. Overview 5
InfiniBand switch 2
InfiniBand switch 1
aaa
aaaa aa a a a a a aaaaa aaaa aa
a a a aaaa aaaaaaaaaaa a a a a a a
aaaa aa a a aaaaaaa aaaaa aaaa aa
aaaaaa aaa aaaaaa aaaaaaaaaa aaaaaa aaa
aaaaaaaa
Maintenance module
a
a a a aaaa aaaaaaaaaaa a a a a a a
aaaa
a a a a a aaaaaaa aaaaa a a a
aaaa aa aaaa aaaaaaa a a a aaaa aa
a
aaaa
aaa
aaaaaaa aaaaaaa
a a
aaaaaaa aaaaaaa
Interface module 6 aa
aa
aa
aa
aa
aa aaaaaaaaaaaaaaa
a
aa aaaa aaaaaaaa aaaaaaaa
aaaaa aaaaa aaaaa aaaaa aa aaa aaaaaaaaaaa a a a
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aa
aaaa aa aaaaaaa aaaaaaaaa
a
aaaaa aaaaa aaaaa aaaaa aa aaaa
a aaaaaaa
aaaaaaa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaa a
a aaaa a a a a
a a a
aaaaa
aaaaaaa
a a a
aaaaa
aaaaaaa
a a a
aaaaa
aaaaaaa
a a a
aaaaa
aaaaaaa Interface module 5 aaaa
aa a
aa
aaa aaaaaaaaaaaaaaa
aaa
aa aaa aaaaaaaa aa a a a
aaaaaaaa
aaaaa aaaaa aaaaa aaaaa aa aaa aaaaaaaaaa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aa aa aaaaaaa aaaaaaaa
a
a aaaa aaaaaaa
aaaaa aaaaa aaaaa aaaaa aaaa aa aaaaaaa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aa aaaa a a a a
a
aaaaaa
Interface module 4
a
a a a a a a a a a a a a
aaaaa aaaaa aaaaa aaaaa aa a
a aa aaaaaaaaaaaaaaa
aaaaaaa aaaaaaa aaaaaaa aaaaaaa aaaa a
a
aaaaa aaaaa aaaaa aaaaa aaaa a aaaaaaaa aa a a a
aaaaaaaa
aa
aa aaaaaaaaaa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaa aaaaaaa aaaaaaaa
a
aaaaa aaaaa aaaaa aaaaa a aaaa aaaaaaa
aaaa aa aaaaaaa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aa aaaa
Data module 3 aa aaaa a a a a
a
a a a a a a a a a a a a
aaaaa aaaaa aaaaa aaaaa aa
aa a
aa aaaaaaaaaaaaaaa
aaaaaaa aaaaaaa aaaaaaa aaaaaaa aaaa
aaaa
a aaaaaaaa aa a a a
aaaaa aaaaa aaaaa aaaaa aaaaaa
a
a aaaaaaaaaaaaaaaaaa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaa aa
a aaaa aaaaaaa aaaaaaaa
aaaaa aaaaa aaaaa aaaaa aaaa a aaaaaaa
aa aaaa aaaaaaa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aa aaaa a a a a
a a a
aaaaa
aaaaa
aaaaaaa
aaaaaaaaaa
a a a
aaaaa
aaaaa
aaaaaaa
aaaaaaaaaa
a a a
aaaaa
aaaaa
aaaaaaa
aaaaaaaaaa
a a a
aaaaa
aaaaa
aaaaaaa
aaaaaaaaaa
Data module 2 aa
aa
aaaa
aaaa
a aa
aa
aa
a
aa
aa
a
aa
aaaaaaaaaaaaaaa
aaaaaaaa
aaaaaaaaaa
a
aaaa
aaaaaaa aaaaaaaa
a a
aaaaaa
aa
a a aaaaaaa
aaaaa aaaaa aaaaa aaaaa aaaaaaa aaaaaaa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aa aaaa a a a a
aa aaaa
a a a
aaaaaaa
aaaaa
aaaaa
aaaaaaaaaa
a a a
aaaaaaa
aaaaa
aaaaa
aaaaaaaaaa
a a a
aaaaaaa
aaaaa
aaaaa
aaaaaaaaaa
a a a
aaaaaaa
aaaaa
aaaaa
aaaaaaaaaa
Data module 1 aa
aa
aa
aaaa
a
aaaaaa
a aaaa
aa a a
a
aa aaaaaaaaaaaaaaa
aaaaaaaa
aaaaaaaaaa
a a
aaaaaa
aaaaaaa aaaaaaaa
aaaaaaa
a
aaaa
aaaaa aaaaa aaaaa aaaaa aaaaaaa aaaaaaa
aa a aa
aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaaaaaa aaaaaa a a a a
a a a a a a a a a a a a
aaaaa aaaaa aaaaa aaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
Modem
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
a a a a a a a a a a a a a a a a a a a a
Uninterruptible power supply 3
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
a a a a a a a a a a a a a a a a a a a a
Uninterruptible power supply 2 aa
aa
aa
aa
aa
aa
aaaa aa
aaaaaa
aaaa aa
aaaaaa
aaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
Uninterruptible power supply 1
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
a a a a a a a a a a a a a a a a a a a a
xiv10296
Front Rear
Figure 3. Example of a minimally populated XIV system
Capacity
Each data and interface module contains twelve 1 TB limited capacity, 2 TB or 3 TB
disk drive modules (DDMs), for a total of 72 DDMs.
You can order an XIV system with DDMs of the same capacity, either 1 TB limited
capacity, 2 TB, 3 TB, 4 TB, or 6 TB. You cannot order an XIV system with a mix of
DDM capacities.
For data and interface modules with 1 TB limited-capacity, the modules contain 2
TB DDMs, but the usable capacity is limited to 1 TB by using the short-stroking
method. By short stroking the DDM, only the outer sectors of the disk platters are
used to store data. Head repositioning delays are minimized, which results in
shorter access times and increased I/O performance.
DDMs in the XIV system do not need to be repaired immediately upon failure
because the XIV system is fully redundant, even with the failures. Replacement for
failed DDMs is deferred until the third DDM fails, or until another component
requires immediate onsite maintenance. For administrators, if a DDM fails but
replacement is deferred, the IBM XIV Storage Management GUI displays the DDM
as pale red, and the Status as Failed (Deferred). When there are three or more
DDMs in failed state, the IBM XIV Storage Management GUI displays the failed
DDMs as bright red, and the Status as Failed. For IBM service representative
(technicians), the IBM XIV Storage Management GUI displays the failed DDM as
bright red, and the Status as Failed regardless of whether the replacement is
deferred.
6 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
The following table lists the total capacity and usable capacity available in fully
populated and partially populated racks for each supported DDM capacity. The
usable capacity is the amount of space that can be used for data storage. The
remaining space is used for system activities, data redundancy, and spare capacity.
For usable capacity, the decimal is rounded down.
Table 6. Capacity for XIV systems
Number of Total usable capacity in TB
modules in the Number of Number of data Number of disk (1 TB limited capacity / 2
rack interface modules modules drives TB / 3 TB / 4 TB / 6 TB)
6 3 3 72 28 / 55 / 84 / 112 / 169
9 6 3 108 44 / 88 / 132 / 177 / 267
10 6 4 120 51 / 102 / 154 / 207 / 311
11 6 5 132 56 / 111 / 168 / 225 / 338
12 6 6 144 63 / 125 / 190 / 254 / 382
13 6 7 156 67 / 134 / 203 / 272 / 409
14 6 8 168 75 / 149 / 225 / 301 / 453
15 6 9 180 80 / 161 / 243 / 325 / 485
Connectivity
This information lists the number of Fibre Channel and Ethernet (iSCSI) ports that
are available in fully and partially populated racks.
The maximum number of iSCSI host ports that can be logged-in concurrently is
700 per interface module. The maximum number of Fibre Channel (FC) host ports
that can be logged-in concurrently is 350 per target port and 700 per interface
module. However, the limit of 700 per interface module includes FC and iSCSI
host ports logged-in concurrently, and mirror connectivity. The per system limit is
1400 concurrent port log-ins for a six module system and 2000 concurrent port
log-ins for nine or more module systems (including FC, iSCSI and mirror
connectivity). This applies to XIV Gen3 microcode version 11.1.1 or later.
The following table lists the number of Fibre Channel and iSCSI ports and
identifies the interface modules from which Fibre Channel and iSCSI ports are
available for each module configuration. For XIV systems with 1 Gb Ethernet
ports, interface module 4 has four Fibre Channel ports and two Ethernet (iSCSI)
ports. Interface modules 5 - 9 have four Fibre Channel ports and four Ethernet
(iSCSI) ports each. For XIV systems with 10 Gb Ethernet ports, all interface
modules have four Fibre Channel ports and two Ethernet (iSCSI) ports.
Table 7. Fibre Channel and iSCSI ports on interface modules
Interface modules Number of iSCSI
Number of modules with Fibre Channel Number of Fibre ports (1 Gb3
in the rack and iSCSI ports Channel ports / 10 Gb)
6 4, 5 81, 2 6/4
1, 2
9 4, 5, 7, 8 16 14 / 8
1, 2
10 4, 5, 7, 8 16 14 / 8
Chapter 2. Overview 7
Table 7. Fibre Channel and iSCSI ports on interface modules (continued)
Interface modules Number of iSCSI
Number of modules with Fibre Channel Number of Fibre ports (1 Gb3
in the rack and iSCSI ports Channel ports / 10 Gb)
11 4, 5, 7, 8, 9 201 18 / 10
1
12 4, 5, 7, 8, 9 20 18 / 10
13 4, 5, 6, 7, 8, 9 24 22 / 12
14 4, 5, 6, 7, 8, 9 24 22 / 12
15 4, 5, 6, 7, 8, 9 24 22 / 12
Notes:
1. Fibre Channel and iSCSI ports on module 6 are not active in configurations of 12 or
fewer modules.
2. Fibre Channel and iSCSI ports on module 9 are not active in configurations of 10 or
fewer modules.
3. On interface module 4, only two of the four available Ethernet ports are used.
Network connections
This information describes the patch panel and utility panels, which are used for
network connectivity for IBM XIV Storage System.
Host systems are connected to the XIV system through a SAN network by using
Fibre Channel or Ethernet (iSCSI) ports in the host-connections patch panel. There
is a host-connections patch panel for each interface module.
The following figures illustrate the host-connections patch panels for XIV systems
with 1 Gb Ethernet ports or 10 Gb Ethernet ports.
Module
1
F
I
B
R 2 1 1
E 0
C G
H b
A 3 E 2
N
N
E
xiv10424
L 4
Figure 4. Host-connections patch panel with Fibre Channel and 10 Gb Ethernet iSCSI ports
8 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Module
1 1
F
I
B
R 2 2
E i
S
C C
H S
A 3 I 3
N
N
E
xiv10087
L 4 4
Figure 5. Host-connections patch panel with Fibre Channel and 1 Gb Ethernet iSCSI ports
The following table describes the ports that are available in the patch panel and
the component to which each patch-panel port connects. A diagram of the utility
patch panel is also shown in the “Patch panel” column.
Chapter 2. Overview 9
Table 8. Utility patch panel connections
Patch panel Patch panel port Component Description
RMM Maint (maintenance Maintenance Use these two ports to connect directly to the
1
module) ports module maintenance module.
M
A Management ports Modules 1, 2, Use these three redundant ports to connect to systems
I RMM
N 3 that are used for managing the XIV system using the
T 2 IBM XIV Storage Management GUI and IBM XIV
command-line interface (XCLI). These ports can also be
Spare
used for sending email notifications and SNMP traps
about event alerts, and communication with key servers
for managing encryption keys.
Module 3 Note: Use all three connections for redundancy. If the
M 1 customer uses only one path and the module for that
A connection goes down, the ability to manage the XIV
N
A
Module 2 system is lost.
G 2
E For information about IP configuration and protocol
M requirements, see “Management ports requirements” on
E Module 1
N page 11.
T 3
VPN (remote support) Modules 1, 3 Use these two virtual private network (VPN) ports are
Module 3 ports used to connect to the XIV Remote Support Center.
Note: Use both VPN connections for redundancy to
1
V avoid losing remote support if one of the modules fails.
P Module 1
N Tech (technician) ports (Model Use these two ports to connect the XIV system directly
2 218x-11x to a notebook computer on which the GUI and XCLI are
only) installed. The IBM service representative uses these
Module 3 Modules 2, 4 ports to initial configure and service the XIV system.
1
T (Model A Dynamic Host Configuration Protocol (DHCP) server
E
C Module 2 218x-21x is implemented over this port. The DHCP server
H only) automatically assigns IP addresses to the notebook
2
Modules 2, 3 computer and establishes a connection to the XIV
Modem system.
xiv10088
10 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Management ports requirements
The management ports are connected to systems that are used for managing the
XIV system through the IBM XIV Storage Management GUI and IBM XIV
command-line interface (XCLI). These ports can also be used for sending e-mail
notifications and SNMP traps about event alerts.
IP configuration
For each of the three management ports, the customer or technical assistant must
provide the following information to the IBM service representative before the
installation is started:
v IP address of the port
v Net mask
v Default IP gateway
v Maximum transmission unit (MTU)
Note: All management IP interfaces must be connected to the same subnet and use
the same network mask, gateway, and MTU.
Protocols
The XIV system is managed through dedicated management ports that are running
TCP/IP over an Ethernet connection. Management is carried out through the
following protocols:
v The XIV system communicates with key servers using the KMIP protocol over
TCP port 5696 (if the encryption feature is enabled).
v Proprietary protocols are used to manage the XIV system from the IBM XIV
Storage Management GUI and IBM XIV command-line interface (XCLI). This
management communication is over TCP port 7778. The XIV GUI and XCLI act
as the client and initiate the connection. The XIV system acts as the server. All
traffic over this port is encrypted through the Secure Sockets Layer (SSL)
protocol.
v The XIV system responds to SNMP requests when sending replies to SNMP
managers.
v The XIV system initiates SNMP packets when sending traps to SNMP managers.
Chapter 2. Overview 11
v The XIV system initiates SMTP traffic when sending emails for either event
notifications or for SMS gateways. SMTP connections use port 25.
v The IBM XIV Storage Management GUI and XCLI communication is Secure
Sockets Layer (SSL) encrypted, which provides security for passwords and
various information.
v The management ports must be on a different subnet than the VPN ports that
are used for remote access.
12 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Chapter 3. Installing the XIV system
This information describes how to initially install and configure the XIV systems.
The customer must plan for each XIV system installation with assistance from an
IBM installation planning representative or IBM service representative. The IBM
XIV Storage SystemGen3 Model 281x-11x and 281x-21x Planning Guide
(www.ibm.com/support/knowledgecenter/STJTAG/com.ibm.help.xivgen3.doc/
docs/xiv_model11x_21x_pg.pdf) describes how to plan and prepare for an XIV
system installation. The Technical Delivery Assessment (TDA) pre-installation
checklist and worksheets document (http://w3-03.ibm.com/support/assure/
assur30i.nsf/WebIndex/SA830) provides several worksheets that the customer
must complete for each XIV system and give to the IBM installation planning
representative or IBM service representative. The recorded information in the
worksheets is used to install and configure the XIV system. Before you start an
installation, ensure that you have these completed worksheets.
The customer must prepare the installation site before the equipment is delivered.
If the site cannot be prepared before the delivery date, the customer must make
arrangements to have professional movers return to finish the transportation later.
Only professional movers can transport the equipment. The IBM service
representative can only minimally reposition the rack at the installation site to
complete required service actions. The customer is responsible for using
professional movers when you relocate or dispose of an XIV system.
14 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
v Set of socket wrenches, including 7, 8, 9, and 10 mm and 3/8-in. with a 15 cm
(6-in.) extension bar
v A flashlight or other moveable light source
v A notebook computer with the most current version of the following
configuration and management tools:
– IBM XIV Storage Management GUI
– IBM XIV command-line interface (XCLI)
– Technician Assistant tool
v If you are installing the optional rear-door heat exchanger, the following tools
are required:
– Hose assemblies, as described in the IBM XIV Storage SystemGen3 Model
281x-11x and 281x-21x Planning Guide
– An enclosed container with a capacity of at least 2 liters (2 quarts)
– Water-absorbent material to place beneath the door assembly
Model 281x-215
v Set of Phillips screwdrivers, including PH2X100 and H3X100
v Set of flathead screwdrivers, including 1.2X6.0X100
v Set of socket wrenches, including 8 mm and 11 mm, with a 10 cm (4 in.)
extension bar
v A tie-wrap cutter
v A flashlight or other moveable light source
v A ruler or tape measure
v A plastic hammer
v A notebook computer with the most current version of the following
configuration and management tools:
– IBM XIV Storage Management GUI
– IBM XIV command-line interface (XCLI)
– Technician Assistant tool
For installation requirements and a list of available packages, see the Release Notes
on the IBM Support Portal website (www.ibm.com/storage/support).
Procedure
Complete the following steps to download and install the IBM XIV management
tools on your notebook computer:
1. Download the IBM XIV Management Tools installation package and
Release Notes from the IBM Support Portal website (www.ibm.com/storage/
support).
2. Complete one of the following procedures for your operating system:
You can run the Technician Assistant tool directly from the downloaded executable
file. If you choose to install the Technician Assistant tool, an agent is installed on
your local system. The agent runs in the background to check for updates, and
then automatically downloads and installs the updates. The installation also adds
shortcuts to the Start menu for starting the Technician Assistant tool.
Procedure
Complete the following steps to download and install the Technician Assistant tool
1. Download the latest version of the Technician Assistant tool to your notebook
computer from the XIV Code Download website (https://
servicecenter.xiv.ibm.com/ta/).
a. Select XIV Utilities, and then click Continue.
b. Read and understand the license agreement. If you agree, select I Agree,
and then click I Confirm.
c. Select Technician Assistant tool under the Software Update Tools section.
d. Click Download now.
2. Optional: Install the Technician Assistant tool by completing the following
steps:
a. Double-click the Technician Assistant tool executable file (for example,
TechnicianAssistantTool_v.r.m.exe where v.r.m is the version, release, and
modification). The Technician Assistant Setup window is displayed.
b. Click the Install radio button.
c. Click the Install button.
d. When the installation is complete, click Close to close the Technician
Assistant Setup window.
Getting started
Use this checklist as a guide to complete the IBM XIV Software System installation.
The checklist contains a list of required and optional steps.
__ 1. “Setting up the XIV system rack” on page 17
__ 2. (Optional) (Models 281x-114 281x-214, and 281x-216 only) “Setting up an
emergency power off circuit” on page 54
16 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
__ 3. (Models 281x-114 281x-214, and 281x-216 only) “Inspecting receptacles and
ac-power source” on page 57
__ 4. “Inspecting the main-power cables” on page 61
__ 5. “Powering on the XIV system” on page 62
__ 6. “Verifying the XIV system rack setup” on page 69
__ 7. “Connecting your notebook computer to the XIV system” on page 72
__ 8. “Starting the IBM XIV Storage Management GUI and command-line
interface” on page 72
__ 9. “Verifying the system state” on page 73
__ 10. “Starting the Technician Assistant tool” on page 74
__ 11. “Configuring system parameters” on page 75
__ 12. “Routing and connecting customer cables” on page 76
__ 13. “Configuring Call Home” on page 76
__ 14. “Configuring remote support” on page 77
__ 15. “Configuring contact information” on page 78
__ 16. “Verifying the customer management interfaces” on page 79
__ 17. (Optional) “Configuring email notifications and rules” on page 80
__ 18. “Completing the installation for XIV system” on page 81
__ 19. (Optional) “Routing and connecting customer host cables” on page 86
__ 20. “Upgrading IBM XIV Storage System code” on page 88
__ 21. (Optional) “Collecting system logs” on page 88
Procedure
v “Setting up XIV model 281x-114 and 281x-214”
v “Setting up the XIV model 281x-215 rack” on page 53
Professional movers are contracted to unpack the XIV system, following the
instructions that are shipped with the XIV system, as part of the shipping
agreement. Only professional movers can transport the XIV system.
Attention: Do not tilt the XIV system rack more than 12.5 degrees.
If the site does not meet the delivery clearances and the weight-and-height-reduced
shipping is ordered, you must remove the doors, side panels, and rack top cover
before the rack can be moved to the final location. Only professional movers can
transport the equipment. After the rack is in its final location, you must return to
complete the installation, including reinstalling the rack top cover, side panels and
doors.
CAUTION:
Before proceeding, ensure that you read and fully understand the rack safety
notices described in the IBM XIV Storage System Safety Notices (GA32-0832).
18 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Procedure
Complete the following steps to remove the standard front and rear doors.
1. Open the rack door.
2. (Front door only) Disconnect the logo LED cable from the mUSB port on
module 5.
Procedure
Locking latches
Door
xiv10076
A 10 mm box socket with an extension bar is required to remove the screws from
the top cover. Other tools might cause the screw heads to become rounded and
unremovable.
Procedure
Top cover
Top-cover side
panel
Procedure
Complete the following steps to correctly position the rack and lock the wheels:
1. Place the rack in its final location according to the customer floor plan.
Tip: While moving the XIV system to its final location and during relocation,
lay down floor covering (such as Lexan sheets) to avoid floor-panel damage.
Place the last floor covering exactly adjacent and in front of the final location.
20 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
2. Lock each caster wheel by tightening the locking screw.
Locking screw
xiv10072
Wheel
Procedure
Top cover
Top-cover side
panel
3. Install the four bolts on the left side of the top cover by using an 8 mm socket
wrench, and then remove the top-cover side panel. Repeat on the right side.
A single blue Ethernet cable is included with the cable bundle. This cable is
intended for used by IBM service representatives when servicing the XIV system. It
is used to connect the technician notebook computer to the technician port.
Procedure
Procedure
22 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Leveling feet
Leveling feet
xiv10074
Figure 10. Leveling feet
Procedure
Ground the rack frame by using the grounding screw that is connected to the rack
just below the ATS. This screw is also used to ground the ATS to the rack.
The ruggedized rack includes a rack tie-down kit, door supports, ruggedized
x-brace, and ruggedized door latch. The ruggedized door latch is installed in a
later procedure.
Complete the following procedures to install the rack tie-down kit, door supports,
and ruggedized x-brace:
1. “Attaching the rack tie-down kit” on page 24
2. “Installing the ruggedized-door supports and brace” on page 32
The rack tie downs are intended for securing a frame weighing 1,134 kg (2500 lbs)
per rack. These tie downs are designed to secure the rack on either a non-raised
floor or a raised floor installation. Instructions, drawings, and data are provided on
an "as is" basis, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED,
INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OR
CONDITIONS OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
PURPOSE. IBM has made every effort to conduct limited tests, but not all
Use this information to install the rack tie-down kit to secure the rack to the floor.
Complete one of the following procedures to attach the rack tie-down kit:
v “Attaching the rack to a concrete (non-raised) floor”
v “Attaching the rack to a raised floor” on page 27
Ensure that the rack is in its predetermined location and the locking screws on the
casters are tightened.
Important: Eight concrete anchors (two per rack corner) must be supplied by the
customer. Each anchor must be able to withstand 2268 kg (5000 lb) pull force. See
the IBM XIV Storage SystemGen3 Model 281x-11x and 281x-21x Planning Guide for
more information.
Procedure
24 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Rack-mounting bolt
Thin washer
Plastic-isolator bushing
Thick washer
Spacer
Leveling foot
Plastic-isolator bushing
Rack-mounting plate
xiv10196
Bracket bolt-down holes
xiv10236
Threaded bolt holes
19. Drill holes at the selected locations into the concrete floor.
20. Insert the concrete anchors into the drilled holes by following instructions that
came with the concrete anchors. Each anchor must be able to withstand
2268 kg (5000 lb) pull force.
21. Position both rack-mounting plates over the concrete anchors.
22. Securely bolt the front and rear rack-mounting plate to the concrete floor.
Note: The size of the anchor bolts and concrete anchors must be determined
by a mechanical contractor.
23. Position the rack over the rack-mounting plate.
24. Insert each of the rack-mounting bolts through a flat washer, a plastic-isolator
bushing, a thick washer, and a leveling foot.
26 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Jam nut
Leveling foot
Plastic-isolator bushing
Rack-mounting plate 19 mm (0.75 in.)
Non-raised
(concrete)
floor
xiv10189
Figure 13. Assembled rack tie-down kit for non-raised floors
25. Align the four rack-mounting bolts with the four tapped holes in each of the
two mounting plates and turn three to four rotations.
26. Tighten the locking screw on each caster.
27. Level the rack by completing the following steps:
Leveling feet
Leveling feet
xiv10074
Use this procedure to attach the rack to a concrete subfloor beneath a raised floor
by using the tie-down kit.
Chapter 3. Installing the XIV system 27
Before you begin
The raised-floor tie-down kit can be installed on raised floors with a depth of
228.6 - 558.8 mm (9 - 22 in.). If the rack is to be attached to a raised floor with a
depth more than 558.8 mm (22 in.), a steel beam or steel channel adapter is
required for mounting the subfloor eyelets. The customer must supply the
eyebolts.
Ensure that the rack is in its predetermined location and the locking screws on the
casters are tightened.
Important: Verify that the customer installed four 0.5x13 in. subfloor eyebolts,
with an internal diameter of 1-3/16 in. before the ruggedized rack can be installed.
The eyebolts but be installed 527.8 mm (20.8 in.) side to side and 965 mm (40 in.)
front to back. The height from the floor surface to the center of the internal
diameter of the eyebolts must be 25.4 - 63.5 mm (1 - 2.5 in.) (see Figure 15).
Higher than 63.5 mm (2.5 in.) might cause excessive lateral deflection to the tie
down hardware. Each anchor must be able to withstand 2268 kg (5000 lb) pull
force. See the IBM XIV Storage SystemGen3 Model 281x-11x and 281x-21x Planning
Guide for more information.
Concrete floor
Eyebolt
xiv10188
25.4 - 63.5 mm
(1.0 - 2.5 in.)
Procedure
28 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Hex nut
Thin washer
Plastic-isolator bushing
Thick washer
Spacer
Rack-mounting bolt
Leveling foot
Plastic-isolator bushing
Rack-mounting plate
Rubber bushing
Plastic bushing
Hex nut
Turnbuckle
Hex nut
Yoke
xiv10197
Note: You must use a minimum of two anchor bolts for each rack-mounting
plate to securely attach the plate through the raised-floor panel to the concrete
floor. Some rack-mounting plate holes might not be usable if they align with
concrete reinforcement rods embedded in the concrete.
Rear
casters rack base
965 mm
(38.0 in.)
52 mm 527.8 mm
xiv10192
18. Transfer the locations of the anchor-bolt holes (excluding the clearance holes
for the rack-mounting bolts) from the raised-floor panel to the concrete floor
directly beneath. Mark the hole locations on the concrete floor.
19. Position the raised-floor panel over the anchor bolt holes.
20. Position the front rack-mounting plate within the marked area on the
raised-floor panel.
30 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
21. Using the anchor bolts, secure the front rack-mounting plates on top of the
raised floor and through to the concrete floor.
22. Position the rear rack-mounting plates within the marked area on the
raised-floor panel.
23. Using the customer-supplied anchor bolts, secure the back rack-mounting
plate on top of the raised floor and through to the concrete floor.
24. Replace all raised-floor panels that were removed when you align and secure
the anchor bolts to the concrete floor.
25. Align the rack over the front and back rack-mounting plates.
26. Insert each of the bolt assemblies through a leveling foot.
Jam nut
Leveling foot
Plastic-isolator bushing
Rack-mounting plate
Raised-floor tile
228.6 - 558.8 mm
(9 - 22 in.)
Eyebolt
25.4 - 63.5 mm
(1 - 2.5 in.)
Concrete floor
xiv10190
27. Align the rack-mounting bolts with the threaded holes in each rack-mounting
plate. Turn each bolt three to four rotations.
28. Tighten the locking screw on each caster.
29. Level the rack by completing the following steps:
Leveling feet
xiv10074
Figure 19. Leveling feet
Use this information to install the ruggedized-door supports and brace on the front
and rear of the rack.
Procedure
Complete the following steps to install the ruggedized-door supports and brace:
1. From the front of the rack, install the door-support brackets at the top and
bottom opening on the right side of the rack. Secure each bracket by using two
screws (see Figure 20 on page 33).
32 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Door-support bracket
Screws
X-brace-mounting
X-brace-mounting
bracket (left)
bracket (right)
Door-support bracket
Screws
xiv10206
Figure 20. Ruggedized door supports
2. Install the x-brace mounting bracket on the left and right side of the rack
opening (see Figure 21).
X-brace
Hex screws
xiv10198
Verify that the side-panel retention kit contains the following parts:
v Two nut clips
v Two flat washers
v Two screws
Procedure
Side panel
Nut clip
Washer
Screw xiv10194
34 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Locking latches
Door
xiv10076
Figure 23. Installing the side panel
4. Push the top of the side panel towards the rack until the latches lock in place.
5. If the ruggedized rack was ordered, slide the washer onto the screw, and secure
the screw in the nut clip.
All data modules to be installed are labeled with a serial number and the position
of the module in the rack. You must install the rack components in the correct
positions. For a full rack configuration, there are 15 data and interface modules,
numbered 1 through 15. Module 1 is the lowest module and module 15 is the
highest module.
CAUTION:
Before proceeding, ensure that you read and understand the rack safety
guidelines described in the IBM XIV Storage System Safety Notices (GA32-0832).
Install all components from the bottom up to prevent the rack from becoming
top heavy.
Complete the following procedures to install data modules 12 - 15. Complete these
procedures for each module before proceeding to the next module. Install the
modules starting with module 12 and working up to prevent the rack from
becoming top heavy.
1. “Removing the disk drive modules”
2. “Removing the module power-supply units” on page 37
3. “Inserting the module into the rack” on page 37
4. “Installing the module power-supply units” on page 39
5. “Installing the disk drive modules” on page 39
6. “Connecting the cables to the data modules” on page 40
All disk drive modules (DDMs) must be removed from the module before
removing the module from the rack to reduce the weight of the module.
Procedure
Complete the following steps to remove the DDMs from the module:
1. Label each DDM with its position in the module using the numbering sequence
in the following figure.
Each DDM must be returned to its original position in the module after the
module is installed in the rack.
36 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
2. Release the DDM latch by pinching together the release tab with the orange
stripe and the depression in the latch.
Latch
Latch depression Green LED
xiv10176
Release tab Amber LED
Use this procedure to remove the power-supply units (PSUs) from a data or
interface module.
Procedure
Complete the following steps from the front of the rack to remove the PSU:
1. Unhook the power-cord retaining clip.
2. Disconnect the power cord. The green LED goes off.
3. Push the locking tab to the left.
4. While you hold the locking tab, use the handle to slide the PSU out of its
mounting cage.
Note: As you start to remove the PSU, you can release the locking tab.
5. Repeat these steps for the remaining PSU.
CAUTION:
Attention:
v Each module is labeled with a serial number, as well as the position of the
module in the rack. You must install the modules in the correct positions.
v You must install the modules starting at the lowest module and working up to
prevent the rack from becoming top heavy.
Procedure
Grip Grip
Retaining screw Retaining screw
38 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Installing the module power-supply units:
Do not force the PSU into the module. Ensure that you do not damage the
connector pins when replacing the PSU. Do not install the PSU if any of the
connector pins are bent.
Procedure
Complete the following steps from the front of the rack to install the PSUs:
1. Use the power-supply unit handle to slide the PSU into the bay.
An audible click is heard when the securing pin engages.
2. Verify that the PSU appears flush with the module.
Use this procedure to reinstall the disk drive modules (DDMs) in the data module.
Important: You must reinstall each disk drive module (DDM) in the same bay
from which it was removed.
Procedure
Figure 27. Disk-drive module latch in the closed and open positions
3. Carefully insert the DDM into the module (see Figure 28 on page 40).
Ensure that the DDM is oriented so that the latch swings open from the left
(see Figure 27).
xiv10174
Figure 28. Inserting the disk-drive modules into the bay
4. Carefully slide the DDM all the way into the drive bay until it is fully engaged.
5. Close the DDM latch.
An audible click is heard when the handle is snapped shut and closed. When
closed, the DDM is fully seated in the drive bay.
6. Repeat the procedure for each DDM.
7. Verify that all DDMs are inserted flush with the module cage. Firmly push each
replaced DDM into position to ensure that all assemblies are fully engaged.
Use this procedure to connect the power cords, data cables, and serial-to-USB
cables.
Figure 29 on page 41 shows connection ports on the rear of the upper data
modules.
40 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 29. Rear view of upper data modules (10 - 15)
All cables are labeled at both ends with the component and port location to which
the cable ends connect. The labels at both ends of the cable are identical. For
example, a cable with label “M9S1-M7USB3” connects from serial port S1 on
module 9 to USB3 port on module 7.
Each cable end is color coded to aid in ensuring that cables are correctly
connected.
The cabling is different for each module. For a detailed list of cables and cable-end
colors for each module, see “Data and interface module cable connections” on page
361.
Procedure
The customer must prepare the site with a water delivery system for the secondary
cooling loop that provides chilled water to the rear-door heat exchanger. The water
delivery system includes pipes, hoses, and the required connection hardware to
connect to the rear-door heat exchanger. Procurement and installation of the
Attention: The water must not originate from the primary chilled-water system
for the building. Conditioned water for the heat exchanger must be supplied as
part of a secondary, closed-loop system.
Note: Connecting the hoses from the pump unit to the heat exchanger creates the
required secondary loop in the water-circulation system. See the IBM XIV Storage
SystemGen3 Model 281x-11x and 281x-21x Planning Guide for information about
primary and secondary loops in a water-circulation system.
This information describes the tools and materials that are needed to install the
rear-door heat exchanger.
After you unpack the rear-door heat exchanger, verify that the kit contains the
following parts:
v Door assembly
v Hinge kit
v Air-purging tool
42 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Door assembly
Hinge kit
xiv10128
Air-purging tool
In addition to the items that come in the option kit, the following tools are
required:
v 7 mm wrench to remove and install the hinges.
v 8 mm wrench to adjust the latch mechanism.
v The hose assemblies that are described in the IBM XIV Storage SystemGen3 Model
281x-11x and 281x-21x Planning Guide. The hose assemblies connect the rear-door
heat exchanger to the pump unit, creating the secondary loop.
Note: For a non-raised floor, you must use the elbow-style hose assemblies that
are described in the IBM XIV Storage SystemGen3 Model 281x-11x and 281x-21x
Planning Guide.
v One container with a minimum capacity of 2 liters (0.5 gallons) for purging air.
v One container with a minimum capacity of 6 liters (1.6 gallons) for draining the
rear-door heat exchanger.
v Water absorbent material.
Use this procedure to attach the door assembly for the rear-door heat exchanger.
Procedure
Top hinge
short pin
Bottom hinge
long pin
xiv10219
3. Remove the two screws that hold the top-rear hinge in place on the rack
cabinet, and remove the hinge.
4. Install the new hinge with the short pin in the same location on the rack
cabinet.
5. Remove the two screws that hold the bottom hinge in place on the rack cabinet,
and remove the hinge.
6. Install the new hinge with the long pin in the same location on the rack
cabinet.
Store both old hinges with the old rear door for possible future use.
7. Position the door at a 90° angle to the rack cabinet as shown in the following
figure.
44 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
CAUTION:
The weight of this part or unit is 18 - 32 kg (39.7 - 70.5 lb). It takes two
persons to safely lift this part or unit. (C009)
Lift handles
xiv10217
Bottom hinge
(long pin)
Attention: Ensure that you engage the bottom hinge pin first when you install
a rear door on the rack cabinet.
8. Place the door so that the bottom hinge pin on the rack cabinet goes into the
locator hole in the bottom hinge area of the door. While keeping the door on
the bottom hinge pin, lift the door slightly and place the door top hinge on the
top hinge pin on the rack. Then, lower the door onto the hinge pins.
9. Close and adjust the latch mechanism so that all door gaskets touch the rack
and compress to a gap of approximately 7 mm (0.25 in.) on all four sides of the
door.
Use this procedure to connect the water supply to the rear-door heat exchanger.
Procedure
Complete the following steps to connect the secondary-loop water supply to the
heat exchanger:
1. Open the rear door to 90°, and remove the hose-retention plate.
Captive screw
Hose retention
plate
xiv10222
2. If the rack cabinet is on a raised floor, remove the floor tile that the hoses are to
pass through. Pull the hoses up to provide slack.
3. Attach the water-supply hose to the female coupling (on the supply manifold)
on the heat exchanger. Complete the following step to attach the supply hose:
Return-manifold coupling
(male)
Supply-hose assembly
(male)
xiv10223
Supply-manifold coupling
(female)
a. Align the male hose coupling with the female supply-manifold coupling.
46 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Note: If the couplings are not correctly aligned, it is difficult to connect the
hose.
b. Move the female collar upward.
c. Insert the male hose coupling. Exert upward pressure until the female collar
moves downward and locks in place with an audible click.
Note: After the couplings are engaged but before the collar has locked into
place, you can let go of the collar and use both hands to push the hose
upward to lock the couplings.
When filling the rear-door heat exchanger with water, use the air purge tool to
purge air from the heat exchanger manifolds.
Attention: Wear safety goggles or other eye protection whenever filling, draining,
or purging air from the rear-door heat exchanger.
Two containers are required for capturing water. The other container must have a
minimum capacity of 2 liters (0.5 gallons) for purging air. Another container must
have a minimum capacity of 6 liters (1.6 gallons) for draining the rear-door heat
exchanger.
Air-purging valve
(supply manifold)
xiv10215
Procedure
Complete the following steps to fill the heat exchanger with water for the first
time:
1. Unscrew and retain the caps from both air-purging valves.
Note: The valves are similar to the valves on bicycle or automobile tires. The
following illustration shows the air-purging tool.
Hose
Handle
Open
Valve Closed
xiv10216
Extension hose
48 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
2. Attach the air-purging tool to the leftmost (supply) air-purging valve. Ensure
that the air-purging tool handle is in the closed position (perpendicular to the
hose).
Note: The 6-inch extension hose for the air-purging tool is not required for
this procedure. You can attach the extension hose to the tool, or you can set
the extension hose aside.
3. Place the other end of the air-purging tool into the 2-liter container to catch
the water and air bubbles that escape during the filling procedure.
4. Turn on the flow of water to the heat exchanger.
Note: Depending on the facility, turn on the pump unit, opening a valve at
the pump unit, or a similar action.
5. Turn the air-purging tool handle to the open position (parallel to the hose).
Water that is mixed with air begins to spit into the container when the
manifold is almost full.
6. When there is a steady stream of water from the air-purging tool, turn the tool
handle to the closed position. Then, disconnect the tool and move it and the
container to the rightmost (return) air-purging valve.
Attention: If water drips from an air-purging valve after you remove the
air-purging tool, reattach the tool and disconnect it again to reseat the seal.
7. Turn the air-purging tool handle to the open position. When there is a steady
stream of water from the air-purging tool, turn the tool handle to the closed
position. Then, disconnect the tool, and set it aside temporarily.
Return-manifold coupling
(male)
Return-hose assembly
(female)
Supply-hose
Supply-manifold
assembly (male)
xiv10220
coupling
(female)
8. Attach the return hose to the male coupling (on the return manifold) on the
heat exchanger. To attach the return hose, complete the following steps.
Note: To make it easier to attach the return hose, turn off the water supply
temporarily to remove water pressure. After attaching the return hose, turn on
the water supply again.
a. Align the female hose coupling with the male return-manifold coupling.
Note: After the couplings are engaged but before the collar has locked into
place, you can let go of the collar and use both hands to push the hose
upward to lock the couplings.
9. Attach the air-purging tool to the leftmost air-purging valve, and purge the air
from the valve again. Then, repeat on the rightmost valve.
Note:
v Water sprays or spits into the container immediately.
v Air in a manifold causes a splashing or gurgling sound. Repeat the
air-purging procedure on both valves if this sound is present.
10. Feel the tops and bottoms of the manifolds (the vertical copper supply and
return pipes on the heat exchanger). If they are cool to the touch, the chilled
water is flowing correctly through the heat exchanger.
11. Screw the valve caps onto the air-purging valves and hand-tighten them to
provide a secondary seal.
Procedure
Complete the following steps to complete the installation of the rear-door heat
exchanger:
1. Reinstall the hose-retention plate by completing the following steps:
a. Slide the middle flange of the hose-retention plate below the matching lip of
the corresponding plate, and wiggle the plate into place.
Middle flange
Hose retention
plate
Captive screw
xiv10218
50 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Raised floor Non-raised floor
xiv10221
Figure 39. Water hoses assembled in a raised and non-raised floor.
2. Install the floor tile (on a raised floor) or route the hoses away from the rack
cabinet (on a non-raised floor).
3. Close and latch the door.
Note: If the rack cabinet is on a non-raised floor, keep the hoses parallel, and
move the hoses back into position as you close the door.
What to do next
After several hours of operation, check the rear-door heat exchanger. If there is a
splashing or gurgling sound, trapped air from the hoses might have migrated to
the heat exchanger. Repeat the air-purging procedure on both valves.
After one month of operation, check the rear-door heat exchanger for air in the
manifolds again to ensure that the heat exchanger is filled correctly.
Note: If the XIV system was delivered with the rear water-cooled door, see
“Installing the rear-door heat exchanger” on page 41 for installation instructions.
Procedure
Complete the following steps to install the standard front and rear door:
1. Position the inside corner of the door frame against the rack hinges, with the
door hinge brackets slightly above the rack hinge pin ends. Lower the door so
the door hinge brackets slide onto the rack hinge pins.
2. (Front door only) Connect the logo LED cable:
Important: If this cable was already disconnected before the door was
removed, do not reconnect the cable.
v If the ruggedized rack is not installed, connect the logo LED cable to the
mUSB port on module 5.
v If the ruggedized rack is installed, connect the logo LED cable to the mUSB
port on module 6.
3. Close the door on the rack.
Verify that the ruggedized latch kit contains the following parts:
v Two round nuts
v Two hex nuts
Procedure
Complete the following steps to install the ruggedized latch kit on the front and
rear door:
1. Remove the end cap, hex nut, and screw from the existing latch (see Figure 40).
The screw and the hex nut are reused, but the end cap can be discarded.
Screw
Hex nut
End cap
xiv10191
2. Reinsert the screw into the latch in reverse orientation, and reattach the hex nut
on the screw (see Figure 41 on page 53).
52 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Round nut Hex nuts
Screw
xiv10193
What to do next
For detailed instructions, see the IBM XIV Storage System Gen3 Model 281x-215 Rack
Installation Guide PDF (clusterdev5.raleigh.ibm.com:8096/help/topic/
com.ibm.help.xivgen3_srv.doc/docs/xiv_model215_rmig.pdf).
To view a PDF file, you need Adobe Reader. You can download it at no charge
from the Adobe website (get.adobe.com/reader/).
What to do next
For detailed instructions, see the MES installation instructions for Rack Installation
and Service Instructions, FC 8102 MES EC: M08559 PDF
(clusterdev5.raleigh.ibm.com:8096/help/topic/com.ibm.help.xivgen3_srv.doc/
xiv_114servicepubs.html).
To view a PDF file, you need Adobe Reader. You can download it at no charge
from the Adobe website (get.adobe.com/reader/).
What to do next
Adhere to national and local electrical codes when wiring the EPO.
Note: National or local building, electrical, fire prevention, safety, and other laws
or regulations might address or control the manner in which information
technology equipment is installed within certain facilities and environments. The
application of those laws or regulations might depend on considerations of factors
beyond the nature or design of the equipment to be installed. It is a customer
responsibility to interpret and identify any laws or regulations applicable to the
installation of information technology in its environment and to inform IBM, IBM
Business Partners, or their designated installers of any actions not identified in this
planning guide that are necessary to install information technology equipment in
the customer facilities in accordance with such applicable laws or regulations.
A room EPO switch can be powered by the XIV system uninterruptible power
supplies for use with non-powered switch circuit breakers. The EPO circuit in the
uninterruptible power supplies is considered a Class 2 circuit (UL, CSA standards)
and a safety extra-low voltage (SELV) circuit (IEC standard). Contact your IBM
service representative for more information about connecting to a room EPO
switch.
Attention: Powering off the XIV system using a room EPO switch results in data
loss and possible loss of configuration. An IBM service representative is required to
recover an XIV system that was turned off using a room EPO switch. If the XIV
system loses ac power but is not powered off using an EPO circuit, data and
configuration are preserved.
54 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
ATS-to-uninterruptible Network management card
power supply power cord
xiv10144
(S1)
Online/bypass switch
Both Class 2 and SELV circuits must be isolated from all primary circuitry. Do not
connect any circuit to the EPO terminal block unless you confirmed that the circuit
is Class 2 or SELV.
Important:
v If using an EPO switch circuit, you must connect the EPO switch for all three
uninterruptible power supplies in the XIV system.
v The EPO circuits must close concurrently.
v Do not connect all three uninterruptible power supply EPO terminals to a
common terminal. Each uninterruptible power supply must be connected to its
own circuit.
You must connect the EPO terminals for each of the three uninterruptible power
supplies to separate EPO switch circuits.
Attention: If the XIV system is powered off using the EPO switch, data and
configuration information is lost. Consider reinstalling and reconfiguring XIV
systems that were powered off using the EPO.
Procedure
Complete the following steps to set up the room EPO switch:
1. From the rear of the rack, verify that the four circuit breakers on the ATS are in
the off (down) position.
Maintenance module
power cord
Maintenance module
circuit breaker
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10149
Figure 43. Power sockets and circuit breakers on the side of the ATS
2. Verify that all three circuit breakers on each uninterruptible power supply are
in the off (down) position.
56 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
ATS ac-sensor port
(N1)
Circuit breakers ATS ac-sensor port
and guard (OUTPUT)
xiv10145
10 Amp power sockets Serial port EPO port
(S1)
3. Disconnect all power cables from the 10-Amp power sockets on the
uninterruptible power supply.
4. Connect a cable from EPO circuit to the EPO port on each uninterruptible
power supply.
You must have the appropriate meter and leads identified in the yearly IBM safety
training for service representatives to run the following checks:
v Resistance checks
v Voltage checks
v High voltage probing
v Ground impedance checks
Ensure that the receptacle face plate is in the normal installed position when you
measure grounding resistance.
DANGER
DANGER
Procedure
Complete the following steps to inspect the receptacles and ac-power source:
1. Have the customer turn off the customer mainline ac-power circuit breaker for
the ac-power outlet to which the XIV system to be plugged in. Attach a “Do
Not Operate” tag and lockout padlock to the circuit breaker.
2. Check the customer-receptacle voltage while the customer circuit breaker is
turned off:
a. Prepare the multimeter to measure 1.0 V ac or less.
b. Measure the voltage at the customer ac-power outlet between the receptacle
case and the building ground.
Note: If the receptacle case or faceplate is painted, ensure that the probe tip
penetrates the paint and contacts the metal.
c. Measure the voltage at the customer ac-power outlet between the ground
pin and the building ground (such as a raised floor metal structure, water
pipe, or building steel).
L3 L2
N L1
If the voltage for either measurement is greater than 1.0 V ac, inform the
customer that even though the circuit breaker is turned off, voltage is present at
the ac-power outlet.
58 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
DANGER
Inform the customer that, even though the circuit breaker is off, a voltage
higher than 1.0 V ac is measured at the failing customer voltage outlet
pins. Do not continue until the voltage is less than 1.0 V ac.
3. Check the customer receptacle ground-pin resistance while the customer circuit
breaker is turned off:
a. Prepare the multimeter to measure 1.0 ohm or less of resistance.
b. Measure the resistance at the customer ac-power outlet between the ground
pin and the building ground (such as a raised floor metal structure, water
pipe, or building steel).
c. Measure the resistance at the customer ac-power outlet between the ground
pin and the receptacle case.
If the resistance is greater than 1.0 ohm, the circuit is not correctly grounded.
DANGER
Inform the customer that, even though the circuit breaker is off, the
resistance is higher than 1.0 ohm indicating that the circuit is not correctly
grounded. Do not continue until the resistance is 1.0 ohm or less.
4. Check the customer receptacle voltage-pins while the customer circuit breaker
is turned off.
a. Prepare the multimeter to measure 1.0 V ac or less.
b. Measure the voltage at the customer ac-power outlet between the voltage
pins and ground pin.
c. Measure the voltage at the customer ac-power outlet between each pair of
voltage pins.
1 2 3 1 2
L3 L2
N L1
5. Remove the “Do Not Operate” tag and lockout padlock from the customer
mainline ac-power circuit breaker to which theXIV system being plugged in.
Have the customer turn on the circuit breaker.
6. Check the customer receptacle voltage-pins while the customer circuit breaker
is turned on.
a. Prepare the multimeter to read line-voltage ac.
DANGER
b. Measure the voltage at the customer ac-power outlet between each pair of
voltage pins (1, 2 and 3) if no neutral pin is present. If a neutral pin
(marked “N”) is present, measure the voltage at the customer ac-power
outlet between each pair of voltage pins (L1, L2, L3) and the neutral pin. A
neutral pin is present on 3W+N+G type power connections as shown on the
agency label.
1 2 3 1 2
L3 L2
N L1
If the voltages are not within 10% of each other, inform the customer that
the voltages are not correct.
60 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Attention: Do not continue until the voltages are correct.
c. Verify that the measurements taken in the previous step match the
input-voltage specification for the rack. The voltage, current, and phase
specifications for the rack are on the agency label, which is adhered to the
bottom of the rack at the rear.
®Registered Trademark of Licensed Machine Code - Property of IBM ©Copyright IBM Corp. 2010 All rights reserved. Machine Type: 2810/2812 Model: 114
International Business Machines US Government Users Restricted Rights. Use, duplication or disclosure restricted by GSA
ADP Schedule Contract with IBM Corp.
Produced in the US of US and non-US components for IBM Corporation (2X) 200-240 (2X) 200-240 (2X) 220-240 V ~
46 30 16 A
Product Certified in
50/60 OR 50/60 OR 50/60 Hz
(Manufacturer) : IBM Corporation San Jose, CA, USA
2W+G 3W+G 3W+N+G
This machine is manufactured from new parts or new and used parts.
Apparaten skall anslutas till jordat uttag
This device complies with part 15 of FCC rules. Operation is subject to the following two
Apparatet må tilkoples jordet stikkontakt
conditions: (1) this device may not cause harmful interference, and (2) this device must
Laite on liitettävä suojamaadoituskoskettimilla
accept any interference received, including interference that may cause undesired operation.
varustettuun pistorasiaan KCC-REM-IBC-
CANADA ICES/NMB - 003 Class/Classe A 2810
xiv10239
PN 99Y1025 EC H26880B
You must have the appropriate analog multimeter and meter leads identified in the
yearly IBM safety training for service representatives to run resistance checks.
Procedure
1 2 3 1 2
L3 L2
N L1
Procedure
v “Powering on the XIV system models 281x-114 281x-214, and 281x-216”
v “Powering on the XIV system model 281x-215” on page 68
Procedure
62 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Hex screws
Top cover
Filler panel
xiv10343
Figure 50. Removing the filler panel
b. Slide the filler panel towards the rear of the rack to remove the panel.
c. Remove two hook-and-loop straps that secure the Ethernet cables that lead
into the cable-management arm at the opposite side of the patch panel to
ensure that the main-power cables fit exactly between the
cable-management arm and the patch panel.
d. Route the main-power cables through the hole in the rack top cover.
Patch panel
xiv10390
Main power cables
f. Secure both main-power cables to the bridge lances above the patch panel,
to the rack side frame by using hook-and-loop straps.
5. If you are routing cables through the bottom of the rack, route the
main-power cables through the hole in the bottom of the rack to the left of the
automatic transfer switch (ATS).
6. Connect both main-power cables to the facility power outlets.
7. Connect both main-power cables to the ATS.
Tip: If both power feeds into the XIV system have voltages within operational
tolerance, the feed that gets energized first becomes the primary feed. (On the
ATS, the selected-source LED identifies the primary feed.) You can use this
characteristic of the XIV system to manually balance the power load among
several XIV systems. If a power-feed failure occurs, the ATS switches the
power load to the remaining feed. When power is resumed, you must repeat
the manual balancing operation.
J2 line cord
J1 line cord
xiv10209
Power cord
retainer
64 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Maintenance module
power cord
Maintenance module
circuit breaker
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10149
Figure 53. Power sockets and circuit breakers on the side of the ATS
10. For a single-phase ATS, verify that both input LEDs (J2 line 2 or J1 line 1) on
the ATS are lit green (see Figure 54). For a three-phase ATS, verify that both
input LEDs (J2 line 2 and J1 line 1) on the ATS are lit green, and one or both
of the selected-source LEDs are lit green (see Figure 55).
SELECTED Input
SOURCE OK
J2 LINE 2
FAULT
J1 LINE 1
11. From the front of the rack, remove the plastic cover from each uninterruptible
power supply.
Note: It might be necessary to remove the power-off cover before you remove
the plastic cover.
Data may
be lost
if button
is pushed
xiv10143
Test button Power-off cover
12. Plug in both battery connectors for each uninterruptible power supply.
The uninterruptible power supplies are shipped with one of the batteries
unplugged to prevent battery drainage. If one or both batteries are unplugged,
firmly push both battery connectors into place. A slight click is heard.
Battery connectors
xiv10211
Battery hand grips
13. Verify that the fan on the front of each uninterruptible power supply is
operating after you plug in the batteries. If the fan is not operating, ensure
that the power cable is securely plugged into the ATS and that the ATS circuit
breaker for the uninterruptible power supply is in the on (up) position.
14. Replace the plastic cover on each uninterruptible power supply.
Note: If you removed the power-off cover, reinstall the cover before you
continue.
15. From the rear of the rack, verify that all three output circuit breakers on each
uninterruptible power supply are set to the on (up) position.
66 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Circuit breakers
and guard
xiv10152
Online/bypass
switch
16. Verify that the online/bypass switch on each uninterruptible power supply is
set to the online (left) position.
If the switch is not set to the online (left) position, move the switch to the
online position and report the condition to your next level of support.
17. From the front of the rack, press the Test button on each uninterruptible
power supply in rapid succession, or simultaneously if possible, to power on
all rack components.
Plastic cover
Data may
be lost
if button
is pushed
xiv10143
Procedure
68 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
PDU1 PDU2
circuit-breaker guards
xiv10510
that the online LED ( ) is lit green on all uninterruptible power supplies,
indicating that the uninterruptible power supplies are operating on ac power.
Note: If no LEDs are lit on the uninterruptible power supplies, the batteries
might be drained. The XIV system delays the initial machine load (IML) until
the batteries are sufficiently charged (see “Uninterruptible power supply does
not power on” on page 345).
If one or more batteries do not charge and one or more online LEDs do not
light, contact your next level of support.
2. Verify that the Power status LED on each data and interface module is lit
green, indicating that the module is powered on.
Fault LED
ID LED
xiv10208
Figure 63. LEDs on the front of the data and interface modules
3. Verify that the power-on LED is lit on the maintenance module, indicating that
the maintenance module is powered on.
If the LED is flashing, the maintenance module is powered off. Press the
power-control button to power on the maintenance module.
If the LED is not lit, the maintenance module is not receiving power. Contact
your next level of support.
4. From the rear of the rack, verify that both power-supply unit (PSU) status
LEDs on each data and interface module are lit green, indicating that the PSUs
are supplying power to the module.
70 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
PSU2 status LED InfiniBand activity LEDs
xiv10160
PSU1 status LED ID D7 D6 D5 D4 D3D2 D1D0 Ethernet LEDs
Figure 65. LEDs on the rear of the data and interface modules
5. Verify that the active-link LED is lit on all the InfiniBand ports on each data
and interface module.
6. Verify that the active-link LED is lit on Ethernet ports 1 and 2 on the
maintenance module.
7. Verify that the active-link LED is lit on all the InfiniBand ports on each
InfiniBand switch.
8. (Model 281x-215 only) From the rear of the rack, verify that all cables are
connected to the correct port and are fully seated.
Procedure
1. Connect the notebook computer to one of the technician ports on the patch
panel by using the blue CAT5 cable that is supplied with the XIV system.
(Model 281x-114 only) The technician port that is labeled "3" is logically routed
to module 3 through module 4. It does not matter which technician port is used
unless module 2 or 4 failed or needs servicing. If module 2 failed or is to be
serviced, use the module 4 port (upper technician port). If module 4 failed or is
to be serviced, use the module 2 port (lower technician port).
(Model 281x-214 and 281x-215 only) It does not matter which technician port is
used unless module 2 or 3 failed or needs servicing. If module 2 failed or is to
be serviced, use the module 3 port (upper technician port). If module 3 failed
or is to be serviced, use the module 2 port (lower technician port).
Note: The technician port for module 4 is not active on XIV system code
V11.0.0. The port is active on XIV system code V11.0.1 or later.
2. Manually set the Ethernet adapter on the notebook computer to use fixed
address 14.10.202.1 and subnet mask 255.255.255.0. Do not use the Dynamic
Host Configuration Protocol (DHCP) server that is implemented over the
technician port.
3. From a command line on the notebook computer, run the ipconfig command,
and verify the following parameters:
v IP address: 14.10.202.1
v Netmask: 255.255.255.0
v Gateway: None
72 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Procedure
Complete the following steps to start the IBM XIV Storage Management GUI and
XCLI on your notebook computer:
1. From the desktop, double-click the IBM XIV Storage System icon.
While the tool is loading, a splash screen is displayed. When loading is
complete, the Login window is displayed.
2. Type the technician user name and password.
3. Select Connect directly, and then click Add.
The main IBM XIV Storage Management GUI window is displayed in the All
Systems view.
4. Right-click the XIV system being serviced, and then click Launch XCLI.
An XCLI session is displayed.
Note: If you are not able to connect to the XIV system, look for a security
window that asks whether to allow or not allow the connection. Select Permit
Always, and launch the XCLI again.
Procedure
Complete the following steps to verify that the hardware components are operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not Full Redundancy, contact your next level of support.
3. If any component is in the Initializing state, wait 10 minutes, and check the
status pod again.
If a component stays in the Initializing state (the component is displayed as
yellow), complete the following steps from the IBM XIV Storage Management
GUI:
a. Right-click the component, and click Phase Out > Failed.
b. Hover the cursor over the component, and verify that Status is Failed.
c. Verify that the system status on the lower-right corner of the window shows
Full Redundancy.
d. Right-click the component, and click Test.
The component goes through a testing procedure. When complete, the
Command executed successfully message is displayed.
e. Hover the cursor over the component, and verify that Status is Ready.
4. If any component is in the Ready state, complete the following steps from the
IBM XIV Storage Management GUI:
a. Right-click the component, and click Phase In.
When you phase in a disk drive module (DDM), data module, or interface
module, the component turns yellow, and the status on the lower right
To run the Technician Assistant tool, the following requirements must be met:
v The IBM XIV Storage Management GUI must be installed on the notebook
computer.
v The notebook computer must be connected to the XIV system, either through the
customer network or directly to the technician port on the patch panel.
Some utilities and scripts in the Technician Assistant tool require the XIV system to
be in a healthy state before the utilities and scripts are run.
Procedure
Complete the following steps to start and initially configure the Technician
Assistant tool:
1. Start the Technician Assistant tool in one of the following ways:
v If you installed the Technician Assistant tool on your notebook computer,
click Start > All Programs > XIV, and then click Technician Assistant Gen-3.
v To run Technician Assistant tool in stand-alone mode:
a. Double-click the Technician Assistant tool executable file (for example,
TechnicianAssistantTool_v.r.m.exe where v.r.m is the version, release,
and modification). The Technician Assistant Setup window is displayed.
b. Click StandAlone.
c. Select Gen-3.
d. Click Run. The Technician Assistant Setup window is closed, and the
Technician Assistant window is displayed.
2. Enter the technician password, and click OK.
If you do not know the Technician Assistant password, contact your next level
of support.
74 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
3. If you are starting Technician Assistant tool for the first time, click Technician
not setup at the bottom of the window, and complete the fields with your
profile information. See the online help for detailed information about each
field.
4. Click Press to Connect. The Connection Details window opens.
5. Select Direct Connect, and then click OK.
The Technician Assistant tool automatically checks the health of the connected
XIV system. The connection buttons at the bottom of the window display
information about the XIV system.
If you receive a warning that the XIV system cannot be reached, contact your
next level of support.
What to do next
Some utilities open a Challenge and Response window, which requires you to
enter a response to a challenge. You can find the response for the XIV system on
the IBM XIV Service Center website (http://servicecenter.xiv.ibm.com).
Note: You must be authorized to obtain a unique response key for the challenge. If
you are not authorized, contact your next level of support.
Procedure
Complete the following steps using the TDA pre-installation checklist and
worksheets to configure XIV system parameters:
1. From the Technician Assistant tool, click Launch > Initial Setup. The Initial
Setup window is displayed with the System params page open.
2. Enter appropriate values for each field.
The fields are divided into the following categories. See the online help for
detailed information about each field.
System
Defines the name of the XIV system.
Management
Defines the IP address of the management modules, netmask, and
gateway.
DNS Defines primary and secondary domain name space (DNS) servers.
Time Defines the time zone, time, and date of the XIV system, and the IP
address of the network time protocol (NTP) server.
Note: Enter the DNS name of the SMTP gateway server in the IP
address field.
3. Click Apply to save the current configuration.
4. From the IBM XIV Storage Management GUI, click the arrow to show the patch
panel. Hover the cursor over each port on the patch panel, and verify that
Status is Ready.
Procedure
Note: For overhead cable installations, do not coil excess cables on top of the
rack.
2. Secure the cables to the bridge lances on the patch panel by hook-and-loop
straps.
3. Connect the customer Ethernet cables to the management port on the patch
panel.
4. Connect the customer Ethernet cables to the virtual private network (VPN)
ports on the patch panel.
5. If the customer uses the modem for remote access, connect a CAT5 phone cable
to the modem port on the patch panel.
Call home connects the XIV system directly to the IBM Trouble Ticketing System.
The call home function sends notifications automatically to the IBM XIV Service
Center when there is a problem with the XIV system. If a problem requires service,
an IBM service representative is sent to the customer site with any necessary
replacement parts.
Call home does not allow access to customer-stored data in the XIV system.
76 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
The Technical Delivery Assessment (TDA) pre-installation checklist and worksheets
document provides several worksheets that the customer must complete for each
XIV system and give to the IBM installation planning representative or IBM service
representative. The recorded information in the worksheets is used to install and
configure the XIV system.
Procedure
Complete the following steps using the TDA pre-installation checklist and
worksheets to configure call home:
1. From the Initial Setup dialog box, click the Call Home tab.
2. Complete the appropriate values for each field. See the online help for detailed
information about each field.
3. Click Apply to save the current configuration.
4. Click Create Event to send a custom_event call-home notification to the IBM
XIV Service Center. An information message box is displayed.
5. Click OK.
6. Optional: Verify that the customer_event notification is displayed in the Event
Center section of the IBM XIV Service Center website (http://
servicecenter.xiv.ibm.com) to ensure that the notification was sent correctly.
If the test succeeds, several events are listed for the XIV system using the serial
number of the system, such as the following example notification:
"Informational", "Test event for event_center"
Note: You can use filters in the IBM XIV Service Center website
(http://servicecenter.xiv.ibm.com) to view events that occur for a specific time,
date, and XIV system.
Note: The XIV Remote Support Center is available for XIV system code V10.1 and
later.
Procedure
Complete the following steps using the TDA pre-installation checklist and
worksheets to define remote-support contact information:
1. From the Initial Setup window, click the Remote Support tab.
2. Select one of the following connection types:
c. Click Apply.
Note: Double-click each cell to edit the existing definition. Select a row and
click the red X icon to delete an existing definition (row).
4. Complete each field in the Remote Connectivity ports configuration on the
XIV system group box. See the online help for detailed information about each
field.
Complete the following steps using the TDA pre-installation checklist and
worksheets to define customer contact information:
1. From the Initial Setup window, click the Contact Info tab.
2. Complete the appropriate values for each field.
Procedure
This procedure is optional. You can use this procedure to set up email notification
for the technical advisor and top guns when major or high-level events occur in
the XIV system.
Procedure
80 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
If an email notification was not sent, click System > All Systems > View
Events to view event log and troubleshoot the problem.
17. Right-click a uninterruptible power supply, and click Test to bring the
uninterruptible power supply online.
Procedure
v “Completing the installation for XIV system models 281x-114 281x-214, and
281x-216”
v “Completing the installation for XIV system model 281x-215” on page 84
Procedure
Data may
be lost
if button
is pushed
xiv10143
Test button Power-off cover
8. From the IBM XIV Storage Management GUI, click Tools > Settings > System,
and verify that all previously configured settings persist.
9. Click View > Monitor > Events, and verify that no problem events were
generated.
If you see an event of severity other than informational, contact call your next
level of support.
10. If you connected the XIV system to a room emergency power-off (EPO)
switch, complete the following steps:
a. Activate the EPO switch for uninterruptible power supply 1.
82 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Maintenance module
power cord
Maintenance module
circuit breaker
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10149
Figure 69. Power sockets and circuit breakers on the side of the ATS
Procedure
Fault LED
ID LED
xiv10208
Figure 71. LEDs on the front of the data and interface modules
g. From the rear of the rack, lift all circuit-breaker guards on both power
distribution units (PDUs). There are six circuit-breaker guards all together.
84 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
There are two circuit breakers under each circuit-breaker guard.
PDU1 PDU2
circuit-breaker guards
xiv10510
h. Push all six circuit-breaker levers on the power distribution units to the off
(down) position.
xiv10431
b. Power on the XIV system by pushing all six circuit-breaker levers on the
power distribution units to the on (up) position.
Fault LED
ID LED
xiv10208
Figure 75. LEDs on the front of the data and interface modules
3. From the IBM XIV Storage Management GUI, click Tools > Settings > System,
and verify that all previously configured settings persist.
4. Click View > Monitor > Events, and verify that no problem events were
generated.
If you see an event of severity other than informational, contact call your next
level of support.
5. Complete the following steps if the customer uses the modem for remote
support:
v Dial in to the modem by using a telephone.
v Verify that the modem answers.
Attention:
Use an approved electrostatic discharge wrist strap to prevent damage. For more
information, see “Electrostatic discharge” on page 117.
Locate the host cables (LC or LC/SC Fibre Channel or Ethernet (iSCSI)).
86 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Ensure that the customer has connected the host systems to a minimum of two
SAN switches.
Ask the customer for a diagram that identifies where each host cable is to be
connected on the XIV patch panel and SAN switches, or for the host-attachment
checklist in the Technical Delivery Assessment (TDA) pre-installation checklist and
worksheets (w3-03.ibm.com/support/assure/assur30i.nsf/WebIndex/SA830)
document that was filled out by the IBM installation-planning representative with
assistance from the customer.
Procedure
Important: For overhead cable installations, do not coil excess cables on top of
the rack.
4. Secure the cables to the bridge lances on the patch panel by using
hook-and-loop straps.
Attention: When routing the Fibre Channel cables, do not cause sharp bends
or crimps in the cable. Sharp bend or crimps in the cable might cause the cable
to fail or degrade the signal.
5. Using the host-attachment diagram or checklist as an aid, connect each host
cable from the appropriate SAN switch to appropriate Fibre Channel or iSCSI
port on the XIV system patch panel. See the following figures for reference.
Important: For Fibre Channel cables, connect the LC end to the patch panel.
Module
1 1
F
I
B
R 2 2
E i
S
C C
H S
A 3 I 3
N
N
E
xiv10087
L 4 4
Figure 76. Host-connections patch panel with Fibre Channel and 1 Gb Ethernet iSCSI ports
1
F
I
B
R 2 1 1
E 0
C G
H b
A 3 E 2
N
N
E
xiv10424
L 4
Figure 77. Host-connections patch panel with Fibre Channel and 10 Gb Ethernet iSCSI ports
6. Optional: Label the host cables from each patch panel port using the
cable-identification plan and the labels provided by the customer.
7. Close rear rack door.
What to do next
The customer can now configure the hosts, install host-attachment software, and
verify connectivity.
Verify the level of code that is running on the XIV system by viewing the
connection icon at the bottom of the Technician Assistant tool window.
The XIV system must be in a healthy state before upgrading the code.
For detailed upgrade instructions and compatibility, see the installation instructions
that are included in the code bundle on the XIV Code Download website
(https://servicecenter.xiv.ibm.com/ta/).
For fixes, limitations, and known problems and workarounds, see the
Release Notes.
88 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
About this task
This procedure is optional. It collects x-ray files, include various logs, files, and
traces, and saves them in a specified directory on the notebook computer. These
files can be stored on your notebook computer, sent to the IBM Support Center
through FTP, or sent to IBM ECuREP.
Procedure
Note: You must be authorized to obtain a unique response key for the
challenge. If you are not authorized, contact your next level of support.
5. Click XSC.
6. Wait for the x-ray files to be collected. This might take several minutes.
7. Select the directory where you want to store the files, and click Save.
8. Wait for the x-ray files to be saved on your local system. This might take
several minutes.
9. Close the Xray Collect window.
Before installing this MES, XIV system code 11.1.0 or later must be installed on the
XIV system. To upgrade the XIV system code, download the code from the XIV
Code Download website (https://servicecenter.xiv.ibm.com/ta/) and use the
instructions that are provided in the appropriate release notes. Note that the
management IP addresses must be defined before upgrading XIV system code.
For information about installing additional data and interface modules, see the
MES installation instructions for the Capacity Expansion: Data Modules and Interface
Modules FFBM II PDF (http://service.atlanta.ibm.com:9090/support/
knowledgecenter/STJTAG_ent/com.ibm.help.xivgen3_srv.doc/
xiv_114servicepubs.dita).
To view a PDF file, you need Adobe Reader. You can download it at no charge
from the Adobe website (get.adobe.com/reader/).
Procedure
The weight of this part or unit is 18 - 32 kg (39.7 - 70.5 lb). It takes two
persons to safely lift this part or unit. (C009)
d. Grasp the door assembly firmly with both hands and lift it upward and
away from the hinges.
8. Carefully wrap and secure the cables in the rack to ensure that they are not
damaged during shipment or transport.
What to do next
Pack the rack for relocation by using the repacking kit 45W5000. For packaging
instructions, see “Packing an XIV system” on page 96.
Procedure
Complete the following steps to disassemble and pack the XIV system:
1. Confirm with the customer that the XIV system is idle and ready to power off.
2. Ask the customer to power off the XIV system. From the IBM XIV Storage
Management GUI, click the XIV system and click File > System Shutdown.
Important: Ensure that the XIV system is powered off before proceeding.
3. Disconnect all ac power cables from the ATS.
4. If installed, remove data modules 12 - 15.
Attention: Ensure that you remove components from the highest to the lowest
to ensure that the rack does not become top heavy and to avoid toppling over.
94 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
CAUTION:
c. Remove all DDMs (see “Removing the disk drive module” on page 125).
d. Remove the module.
e. Reinstall the DDMs in the same locations in the drive bay from which they
were removed.
f. Pack the module for shipment. Ensure that each module create is clearly
labeled with the module number for easier reassembly at the new location.
Modules must be installed in the same location from which they are
removed.
5. If the ruggedized rack is installed, detach the rack from the floor.
6. If the rear-door heat exchanger is installed, complete the following steps to
drain the water and detach the hoses:
a. Drain the water from the heat exchanger (see “Draining the heat exchanger”
on page 293).
The weight of this part or unit is 18 - 32 kg (39.7 - 70.5 lb). It takes two
persons to safely lift this part or unit. (C009)
d. Grasp the door assembly firmly with both hands and lift it upward and
away from the hinges.
7. Carefully wrap and secure the cables in the rack to ensure that they are not
damaged during shipment or transport.
What to do next
Pack the rack for relocation by using the repacking kit 45W5000. For packaging
instructions, see “Packing an XIV system.”
Procedure
96 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
4. Pack the rack by using the physical protection and asset sealing kit (part
number 7334847).
What to do next
The customer is responsible for using professional movers or riggers to move the
XIV system. The professional mover completes the following tasks after the rack is
prepared for shipment by the IBM service representative.
1. Attach one metal mounting bracket to the rear of the pallet (end opposite from
ramps).
2. Attached the ramps to the front of the pallet.
3. Position the rack in front of the ramps so that the swivel casters on the rear of
the rack are facing the ramps.
4. Roll the XIV system up the ramp and onto the pallet until the rear of the rack
rests against the metal mounting brackets.
5. Attach the remaining metal mounting bracket to the front of the pallet.
6. Attach metal mounting brackets to rack.
7. Attach one ramp to each side of the rack by using the IBM logo tape included
with asset sealing kit
Components overview
This information describes the hardware components in IBM XIV Software System.
Attention: All drive bays must be filled. Operating a data or interface module
with one or more missing DDMs disrupts airflow and prevents the DDMs from
cooling sufficiently. All DDMs must be correctly in place before operating the
module. If you are replacing a DDM while the module is operating, the
replacement DDM must be reinserted within 10 minutes. Do not remove the DDM
until you have the replacement DDM.
Note: If the entire module has failed, the state of each DDM reflects the state of
the module.
For XIV systems with call-home support, the IBM Service Center identifies the
correct field replaceable unit (FRU) to use for the defective DDM in the problem
management report (PMR).
Figure 79 shows the front view of the DDM. Figure 80 on page 100 shows the front
view of a module with all 12 DDMs installed.
Latch
Latch depression Green LED
xiv10176
Data modules
The data modules contain the 12 disk drive modules (DDMs), two power-supply
units (PSUs), SAS expander cards, 10 cooling fans, a compact flash card, an
optional solid-state drive (SSD), InfiniBand interfaces, and the system board. The
lower data modules also contain Ethernet interfaces. The data modules do not
contain Fibre Channel interfaces.
The replacement data module is supplied with all components except the DDMs
and the optional SSD. The DDMs that are in the defective data module are
installed in the new module in the same location from which they were removed.
Figure 81 shows the front view of the data modules with 12 DDMs installed.
Figure 82 on page 101 and Figure 83 on page 101 shows the rear view of the upper
and lower data modules.
xiv10173
Grip Grip
Retaining screw Retaining screw
100 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 82. Rear view of upper data modules (10 - 15)
Table 9 describes the weight of the data module with and without DDMs and
PSUs.
Table 9. Data module weight
Weight Kilograms Pounds
Maximum configuration 28 61.7
Without disk drive modules (DDMs) 17.8 39.2
Without DDMs and power supply units 15 33.1
(PSUs)
Feature codes
The following table describes the features codes that are available for data modules
when you order an XIV system.
Capacity on Demand (CoD) modules are modules that are physically installed in
the rack but are not activated for use until more capacity is needed. Additional
capacity is activated by ordering a miscellaneous equipment specification (MES)
with the appropriate CoD activation feature.
For data and interface modules with 1 TB limited-capacity, the modules contain 2
TB DDMs, but the usable capacity is limited to 1 TB by using the short-stroking
method. By short stroking the DDM, only the outer sectors of the disk platters are
used to store data. Head repositioning delays are minimized, which results in
shorter access times and increased I/O performance.
Table 10. Feature codes for data modules
Feature code
Feature description Model 281x-114 Model 281x-214
1 TB limited-capacity data modules 1123 2016
2 TB data modules 1126 2026
2 TB CoD data module 1146 2028
2 TB module CoD activation 1149 4020
2 TB self-encrypting module CoD activation 4021
3 TB data modules 1136 2036
3 TB CoD data module 1148 2038
3 TB module CoD activation 1150 4030
3 TB self-encrypting module CoD activation 4031
102 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 10. Feature codes for data modules (continued)
Feature code
Feature description Model 281x-114 Model 281x-214
4 TB data modules 2042
4 TB CoD data module 2044
4 TB self-encrypting module CoD activation 4041
6 TB data modules 2062
6 TB CoD data module 2064
6 TB self-encrypting module CoD activation 4061
Interface modules
The interface modules contain 12 disk drive modules (DDMs), two power-supply
units (PSUs), SAS expander cards, 10 cooling fans, a compact flash card, an
optional solid-state drive (SSD), InfiniBand interfaces, and the system board. The
interface modules also contain Fibre Channel and 1 Gb or 10 Gb Ethernet interfaces
for host-system connectivity. The Fibre Channel and 10 Gb Ethernet cables use
plug pairs, where each pair is a single connector.
The replacement interface module is supplied with all components except the
DDMs and the optional SSD. The DDMs that are in the defective interface module
are installed in the new module in the same location from which they were
removed.
Figure 84 shows the front view of the interface modules with 12 DDMs installed.
Figure 85 on page 104 and Figure 86 on page 104 show the rear view of the
interface modules.
xiv10173
Grip Grip
Retaining screw Retaining screw
Table 11 describes the weight of the interface module with and without DDMs and
PSUs.
Table 11. Interface module weights
Weight Kilograms Pounds
Maximum configuration 28.3 62.4
Without disk drive modules (DDMs) 18.1 39.9
Without DDMs and power supply units (PSUs) 15.3 33.7
104 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
CAUTION:
Feature codes
The following table describes the features codes that are available for interface
modules when you order an XIV system.
Capacity on Demand (CoD) modules are modules that are physically installed in
the rack but are not activated for use until more capacity is needed. Additional
capacity is activated by ordering a miscellaneous equipment specification (MES)
with the appropriate CoD activation feature.
For data and interface modules with 1 TB limited-capacity, the modules contain 2
TB DDMs, but the usable capacity is limited to 1 TB by using the short-stroking
method. By short stroking the DDM, only the outer sectors of the disk platters are
used to store data. Head repositioning delays are minimized, which results in
shorter access times and increased I/O performance.
Table 12. Feature codes for interface modules
Feature code
Feature description Model 281x-114 Model 281x-214
1 TB limited-capacity interface modules with 1 GbE 1122 2015
cards
1 TB limited capacity interface modules with 10 GbE 2115
cards
2 TB interface modules with 1 GbE cards 1125 2025
2 TB interface modules with 10 GbE cards 2125
2 TB CoD interface module with 1 GbE cards 1145 2027
2 TB CoD interface module with 10 GbE cards 2127
2 TB module CoD activation with 1 GbE cards 1149 2029
The PSUs are at the rear left side of the data and interface modules in a stacked
position. PSU 1 is on the bottom, and PSU 2 is on the top.
106 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Power supply units
Power socket P2
xiv10234
Handles Locking tabs
Power socket P1
InfiniBand switches
The InfiniBand switch provides internal communication between the data and
interface modules. Two independent, but communicating InfiniBand switches are
provided.
Figure 89 and Figure 88 show the front and rear views of the InfiniBand switch.
The cables in the top InfiniBand switch (N2) are red, and the cables in the bottom
InfiniBand switch (N1) are yellow.
xiv10097
Secondary power Fan unit Primary power System status
supply unit (P2) supply unit (P1) LED
IS5030
MGMT CONSOLE
Power
PSU 1
PSU 2
FAN
RST
xiv10093
Tip: Because the InfiniBand switches are located deep within the rack in the front
and contain many cables in the rear, use a flashlight or other moveable light source
to better see your work.
The rear side of the InfiniBand switch has 36 quad small form-factor pluggable
(QSFP) ports in two rows, 18 ports to a row. The ports are labeled as shown in
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18
xiv10096
19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36
xiv10099
Secondary power Primary power
supply unit (P2) supply unit (P1)
With both PSUs installed in the redundant configuration, either PSU can be
removed without bringing down the XIV system.
Maintenance module
The maintenance module is used by IBM service personnel to check system
functions and operations by providing connectivity to all components, switches,
interface modules, data modules, and uninterruptible power supplies. The
maintenance module is also used as an SMTP server that provides remote support
to IBM XIV technicians through the modem.
Figure 92 shows the front view, and Figure 93 on page 109 shows the rear view of
the maintenance module.
108 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 93. Rear view of the maintenance module
Each XIV system rack is supplied with three uninterruptible power supplies. Each
uninterruptible power supply is an independent unit, and all three provide
continuous, redundant, uninterruptible power-supply service to the rack in which
they are installed. The uninterruptible power supplies are all in a charged state
when connected to the electrical power system. While charging, the uninterruptible
power-supply batteries charge to 90% capacity during the first three hours of
normal usage. The batteries do not run at full capacity during this initial charge
period.
Although the uninterruptible power supply is in the Failed state, the components
that are associated with the failed uninterruptible power supply are in the OK state
because the redundant uninterruptible power supply are still supplying power to
those components.
The following figures show the front and rear views of the uninterruptible power
supply and its various components.
Data may
be lost
if button
is pushed
xiv10143
Test button Power-off cover
The following figure shows the location of the batteries on the front of the
uninterruptible power-supply. The batteries are located under the battery cover
and retaining bracket.
110 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Battery connectors
xiv10211
Battery hand grips
The network management card is at the rear of each uninterruptible power supply,
as shown in the following figure.
xiv10154
Retaining screws
Figure 98 on page 112, Figure 99 on page 112, and Figure 100 on page 113 show
examples of the front and side views of a single-phase and three-phase ATS.
Maintenance
module
power cord
P3
Uninterruptible
power supply
power cords P2
P1
xiv10063
Fault LED Power input LEDs
Selected source LEDs
Line cords
Plug-securing ring
ATS retaining bracket
Maintenance
module
power cord
P3
Uninterruptible
power supply
P2
power cords
P1
xiv10050
112 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
J2 line cord J1 line cord
Maintenance
module Maintenance module
power cord F4
circuit breaker
F4
Power output
LED
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10051
ac-sensor cable ac-sensor cable
LS port (X807) COMM port (X801)
The XIV system is set up with a two-main-power-cable configuration that uses two
independent circuits, A and B. Each circuit supplies one main-power cable.
v Circuit A connects to ATS connector J1.
v Circuit B connects to ATS connector J2.
A J1 P3
Uninterruptible
ATS P2 power supply 2
B J2 P1
Uninterruptible
xiv10047
power supply 1
Restriction: This configuration is not supported for environments that have more
than one independent circuit.
Uninterruptible
power supply 3
J1 P3
Uninterruptible
ATS P2 power supply 2
J2 P1
Uninterruptible
xiv10399
power supply 1
114 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Modem
The modem is used by IBM XIV technicians to provide remote support through the
maintenance module.
The modem is at the rear of the rack, below the utility panel and to the right side
of the automatic transfer switch. It is supported on a bracket that is attached to the
rack and is held in place by a hook-and-loop fastener.
Figure 103 illustrates the modem and modem cable port. Figure 104 illustrates
where the modem and modem bracket attach to the rack.
MOD port
xiv10166
116 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
v If it is necessary to power off the XIV system, use only the documented
procedure.
v If more than one component failed and must be replaced, contact your next level
of support for an action plan. The replacement order of components might be
important when there are multiple failures.
v Plug cables in to the correct ports to ensure that the XIV system functions
correctly. All cables are labeled with port-to-port information. All cables must be
plugged in to the correct port that is indicated on the cable label.
Electrostatic discharge
Always wear the electrostatic discharge (ESD) wrist strap when working with or
touching ESD-sensitive parts.
Attention:
When servicing ESD-sensitive parts in an XIV system, always wear an ESD wrist
strap that is correctly connected to the rack frame or enclosure sheet metal. This
strap prevents possible damage to the hardware and decreases any possible impact
to customer operations.
An ESD wrist strap has a high resistance (>1 megohm) resistor in series with the
grounding clip so there is no danger to you. It discharges the static electricity from
your body.
When you wear the ESD wrist strap, ensure that the flexible grounding cable
remains connected to you and to the rack frame or enclosure sheet metal.
For installation requirements and a list of available packages, see the Release Notes
on the IBM Support Portal website (www.ibm.com/storage/support).
Procedure
Complete the following steps to download and install the IBM XIV management
tools on your notebook computer:
1. Download the IBM XIV Management Tools installation package and
Release Notes from the IBM Support Portal website (www.ibm.com/storage/
support).
2. Complete one of the following procedures for your operating system:
118 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
v Windows Mac OS X Double-click the downloaded file, and follow the
instructions to complete the installation.
v Linux HPUX Solaris Run the following command to complete the
installation:
sh file_name
You can run the Technician Assistant tool directly from the downloaded executable
file. If you choose to install the Technician Assistant tool, an agent is installed on
your local system. The agent runs in the background to check for updates, and
then automatically downloads and installs the updates. The installation also adds
shortcuts to the Start menu for starting the Technician Assistant tool.
Procedure
Complete the following steps to download and install the Technician Assistant tool
1. Download the latest version of the Technician Assistant tool to your notebook
computer from the XIV Code Download website (https://
servicecenter.xiv.ibm.com/ta/).
a. Select XIV Utilities, and then click Continue.
b. Read and understand the license agreement. If you agree, select I Agree,
and then click I Confirm.
c. Select Technician Assistant tool under the Software Update Tools section.
d. Click Download now.
2. Optional: Install the Technician Assistant tool by completing the following
steps:
a. Double-click the Technician Assistant tool executable file (for example,
TechnicianAssistantTool_v.r.m.exe where v.r.m is the version, release, and
modification). The Technician Assistant Setup window is displayed.
b. Click the Install radio button.
c. Click the Install button.
d. When the installation is complete, click Close to close the Technician
Assistant Setup window.
XIV system code V11.2.x or later must be installed on the XIV system.
Host profiles are added to the XIV system when the customer installs the
host-attachment kit. The Host Configuration Verification utility retrieves host
profiles that are stored on the XIV system.
Procedure
From the Technician Assistant tool, click Utilities > Host Configuration
Verification. The Host Configuration Verification window is displayed.
When the verification is complete, the following information is displayed:
v The number of hosts that were analyzed
v The number of hosts that were not analyzed because the host profile is missing
v The percentage of compliant of host
v The percentage of non-compliant of host
v A tabular list of non-compliant hosts, their host-profile attributes, and the reason
for non-compliance
v A tabular list of compliant hosts and their host-profile attributes
Getting Started
Use this checklist as a guide when you replace hardware components in an IBM
XIV Storage System.
__ 1. Verify that all components are in place and that all cables are securely
fastened to their sockets. Verify that there are no apparent safety concerns.
__ 2. Verify that all LEDs are lit as expected. If any LED is not lit according to
the expected condition, determine the reason before you start the repair.
__ 3. Connect your notebook computer to the XIV system.
__ 4. Start the Technician Assistant tool.
__ 5. Start the IBM XIV Storage Management GUI and XCLI.
__ 6. From the IBM XIV Storage Management GUI, verify that all components
are operating as expected and that the XIV system shows Full Redundancy
status. If the XIV system does not show Full Redundancy status, determine
the reason before you start the repair. If the XIV system does not return to
Full Redundancy, contact your next level of support before proceeding.
__ 7. Phase out the component, if necessary.
A component that is in the Failed state does not need to be phased out
because the component is already out of service; however, you might need
to phase out a component that needs to be replaced before it failed.
__ 8. Start the appropriate guided repair utility in the Technician Assistant tool,
if appropriate. Most but not all replacement procedures use this tool.
__ 9. Replace the hardware component only after it is in the Failed state.
Attention: Do not attempt to replace a component before it is in the failed
state. Doing might cause the XIV system to malfunction.
__ 10. If the guided repair utility is used, complete the guided repair steps and
close the utility.
__ 11. Phase in the component, if necessary.
When an interface module, data module, or disk drive module (DDM) is
phased in, the XIV system redistributes the data throughout the XIV
system. Depending on the amount of data that needs to be redistributed,
the phase-in process might take several hours. When modules and DDMs
120 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
are in the Redistributing state, the service procedure is considered
complete, and generally there is no need to wait until the component
reaches the OK status (LED is not lit).
__ 12. Run basic diagnostic tests to complete the service call.
Procedure
1. Connect the notebook computer to one of the technician ports on the patch
panel by using the blue CAT5 cable that is supplied with the XIV system.
(Model 281x-114 only) The technician port that is labeled "3" is logically routed
to module 3 through module 4. It does not matter which technician port is used
unless module 2 or 4 failed or needs servicing. If module 2 failed or is to be
serviced, use the module 4 port (upper technician port). If module 4 failed or is
to be serviced, use the module 2 port (lower technician port).
(Model 281x-214 and 281x-215 only) It does not matter which technician port is
used unless module 2 or 3 failed or needs servicing. If module 2 failed or is to
be serviced, use the module 3 port (upper technician port). If module 3 failed
or is to be serviced, use the module 2 port (lower technician port).
Note: The technician port for module 4 is not active on XIV system code
V11.0.0. The port is active on XIV system code V11.0.1 or later.
2. Manually set the Ethernet adapter on the notebook computer to use fixed
address 14.10.202.1 and subnet mask 255.255.255.0. Do not use the Dynamic
Host Configuration Protocol (DHCP) server that is implemented over the
technician port.
3. From a command line on the notebook computer, run the ipconfig command,
and verify the following parameters:
v IP address: 14.10.202.1
v Netmask: 255.255.255.0
v Gateway: None
To run the Technician Assistant tool, the following requirements must be met:
v The IBM XIV Storage Management GUI must be installed on the notebook
computer.
v The notebook computer must be connected to the XIV system, either through the
customer network or directly to the technician port on the patch panel.
Some utilities and scripts in the Technician Assistant tool require the XIV system to
be in a healthy state before the utilities and scripts are run.
Complete the following steps to start and initially configure the Technician
Assistant tool:
1. Start the Technician Assistant tool in one of the following ways:
v If you installed the Technician Assistant tool on your notebook computer,
click Start > All Programs > XIV, and then click Technician Assistant Gen-3.
v To run Technician Assistant tool in stand-alone mode:
a. Double-click the Technician Assistant tool executable file (for example,
TechnicianAssistantTool_v.r.m.exe where v.r.m is the version, release,
and modification). The Technician Assistant Setup window is displayed.
b. Click StandAlone.
c. Select Gen-3.
d. Click Run. The Technician Assistant Setup window is closed, and the
Technician Assistant window is displayed.
2. Enter the technician password, and click OK.
If you do not know the Technician Assistant password, contact your next level
of support.
3. If you are starting Technician Assistant tool for the first time, click Technician
not setup at the bottom of the window, and complete the fields with your
profile information. See the online help for detailed information about each
field.
4. Click Press to Connect. The Connection Details window opens.
5. Select Direct Connect, and then click OK.
The Technician Assistant tool automatically checks the health of the connected
XIV system. The connection buttons at the bottom of the window display
information about the XIV system.
If you receive a warning that the XIV system cannot be reached, contact your
next level of support.
What to do next
Some utilities open a Challenge and Response window, which requires you to
enter a response to a challenge. You can find the response for the XIV system on
the IBM XIV Service Center website (http://servicecenter.xiv.ibm.com).
Note: You must be authorized to obtain a unique response key for the challenge. If
you are not authorized, contact your next level of support.
Procedure
Complete the following steps to start the IBM XIV Storage Management GUI and
XCLI on your notebook computer:
1. From the desktop, double-click the IBM XIV Storage System icon.
While the tool is loading, a splash screen is displayed. When loading is
complete, the Login window is displayed.
122 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
2. Type the technician user name and password.
3. Select Connect directly, and then click Add.
The main IBM XIV Storage Management GUI window is displayed in the All
Systems view.
4. Right-click the XIV system being serviced, and then click Launch XCLI.
An XCLI session is displayed.
Note: If you are not able to connect to the XIV system, look for a security
window that asks whether to allow or not allow the connection. Select Permit
Always, and launch the XCLI again.
Important: Ensure that you have the replacement DDMs ready before starting the
replacement procedure. You must insert the replacement DDM within 10 minutes
after removing the defective DDM.
Attention:
The XIV system does not place a service call until three DDMs fail. When three
DDMs are in a failed state and Call Home is enabled, the XIV system sends a
call-home message and generates a problem management record (PMR). In
addition, if another PMR is opened that requires on-site maintenance and there are
one or two DDMs in a failed state, these failed DDMs are called out for
replacement in the action plan. Any failed DDMs that are encountered during a
maintenance action must be replaced at the same time as the non-DDM
maintenance activity. The procedure for replacing defective DDMs is the same
regardless of how many DDMs need to be replaced.
If you are mixing DDMs of different vendors within the same module or rack,
ensure that the XIV system is running the supported level of code. The following
table identifies the minimum code level that is required to support DDM intermix.
Table 13. Minimum code requirements for DDM intermix
DDM Minimum code level
1 TB capacity V11.1.1 and later
2 TB V11.0.0 and later
3 TB V11.1.0 and later
4 TB V11.3.0 and later
6 TB V11.5.1 and later
Note: On XIV systems running V11.3.0.a and later, the intermix policy is built in
and does not need to be enabled using the TA tool.
Procedure
If a DDM is already in the Failed state, it is not necessary to phase out the DDM.
To determine if a DDM is in the Failed state, hover the cursor over the DDM, and
verify that Status is Failed.
Attention: Do not click Phase Out > Ready unless instructed to do so by your
next level of support.
124 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Procedure
Procedure
Complete the following steps to start the guided repair for DDMs:
1. From the Technician Assistant tool, click Launch > Guided repair > Guided
repair for Disk. The Guided repair for disk window is displayed.
2. Follow the instructions in the guided repair viewer.
The guided-repair utility instructs you to replace the failed DDMs. Continue
with the next procedures to remove the failed DDM and install the DDM FRU.
If you are replacing a single DDM and the state is Rebuilding or Redistributing,
wait until the state changes to Full Redundancy. The XIV system must be in the
Full Redundancy state before removing the DDM. When a DDM fails, the XIV
system changes to the Rebuilding state and rebuilds the lost data on other DDMs
in the XIV system. When a DDM is being phased out, the XIV system changes to
the Redistributing state and redistributes the data to other DDMs in the XIV
system. When the rebuild or redistribution is complete, the XIV system changes to
If you are replacing multiple DDMs, the XIV system can be in the Redistributing
state when you start to replace the next DDM.
If you are removing multiple DDMs that are to be reinserted back into the data or
interface module but not replaced with new ones, you must ensure that the DDMs
are reinserted into the exact same location from which they were removed. Before
removing the DDMs, label each DDM by using the numbering sequence shown in
the following figure.
Procedure
Complete the following steps from the front of the rack to remove each DDM:
1. Release the DDM latch by pinching together the release tab with the orange
stripe and the depression in the latch.
Latch
Latch depression Green LED
xiv10176
What to do next
Insert the replacement DDMs within 10 minutes of removing the defective DDMs.
126 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Installing a disk drive module
Use this procedure to physically install the disk drive module (DDM) into the
drive bay.
If you are inserting DDMs back in to the module but not replacing them with new
ones, you must ensure that the DDMs are reinserted into the exact same location
from which they were removed. Use the numbering sequence shown in the
following figure to ensure that the DDMs are inserted into the correct drive bay.
Procedure
Latch
Latch depression Green LED
xiv10176
Procedure
Procedure
Complete the following steps to verify that the hardware components are operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not Full Redundancy, contact your next level of support.
3. If any component is in the Initializing state, wait 10 minutes, and check the
status pod again.
128 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
If a component stays in the Initializing state (the component is displayed as
yellow), complete the following steps from the IBM XIV Storage Management
GUI:
a. Right-click the component, and click Phase Out > Failed.
b. Hover the cursor over the component, and verify that Status is Failed.
c. Verify that the system status on the lower-right corner of the window shows
Full Redundancy.
d. Right-click the component, and click Test.
The component goes through a testing procedure. When complete, the
Command executed successfully message is displayed.
e. Hover the cursor over the component, and verify that Status is Ready.
4. If any component is in the Ready state, complete the following steps from the
IBM XIV Storage Management GUI:
a. Right-click the component, and click Phase In.
When you phase in a disk drive module (DDM), data module, or interface
module, the component turns yellow, and the status on the lower right
corner of the window shows Redistributing. Depending on the amount of
data to be redistributed, this process might take some time.
b. Hover the cursor over the component, and verify that Status is OK.
5. If any component is in the Failed state (the component is displayed as red),
complete the following steps from the IBM XIV Storage Management GUI:
a. From the All Systems view, right-click the XIV system, and click View
Events. The Events window is displayed.
b. View the event log to determine the cause of the failure.
c. If the reason cannot be determined, disconnect and then reconnect the
power cable to the failed component, and then right-click the component,
and click Test.
d. If the component is still failed, contact your .
6. Click View > Monitor > Events, and verify that there are no events with
severities other than informational.
If there are other events, contact your .
Procedure
1. Package the defective component using the packaging from the replacement
component.
2. Send the defective component package to the appropriate facility according to
the process for your respective country or geography.
Ensure that you have the replacement module before you start the replacement
procedure. You must insert the replacement module as soon as possible after
removing the defective module to prevent a disruption in airflow and cooling.
Use a mobile lift, if possible, to assist in removing and installing the module.
Data and interface modules are replaced as a complete unit. The new module field
replaceable unit (FRU) is supplied with all components except disk drive modules
(DDMs) and the optional solid-state drive (SSD). DDMs and SSD are separate
FRUs.
You can identify a defective data or interface module from the IBM XIV Storage
Management GUI. If the module is defective, the entire module is removed,
packed, and sent to the repair facility. Defective data or interface modules are not
repaired on site.
If multiple modules need to be replaced, replace and install one module at a time.
Do not remove all defective modules at once. Replace the next module only after
the previously replaced module is phased in successfully and after data is
redistributed.
If you must remove multiple modules at the same time, remove the modules
starting with the highest module in the rack and working down to prevent the
rack from becoming top heavy.
Attention:
v Do not replace the module until it is in the Failed state, and the XIV system
itself is in the Full Redundancy state. These states indicate that the data in the
defective module is redistributed to other modules and DDMs.
v When replacing a module, do not leave a bay empty any longer than necessary,
as it affects airflow and cooling.
130 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
CAUTION:
If the data module is already in the Failed state, it is not necessary to phase out the
data module. From the IBM XIV Storage Management GUI, hover the cursor over
the data module, and verify that the Status is Failed.
Attention: Do not select Phase Out > Ready unless you are instructed to do so
by your next level of support.
Procedure
Procedure
Complete the following steps to start the guided repair for data modules:
1. From the Technician Assistant tool, click Launch > Guided repair > Guided
repair for Module. The Guided repair for module window is displayed.
2. Follow the instructions in the guided repair viewer.
The guided-repair utility instructs you to replace the failed module. Continue
with the next procedures to remove the failed module and install the module
FRU.
The data module must be in the Failed state before it can be removed.
The XIV system must be in the Full Redundancy state before removing the data
module. When a data module fails, the XIV system changes to the Rebuilding state
and rebuilds the lost data on other DDMs in the XIV system. When the data
module is being phased out, the XIV system changes to the Redistributing state
and redistributes the data to other DDMs in the XIV system. When the rebuild or
redistribution is complete, the XIV system changes to the Full Redundancy state.
Attention: If you replace a data module while the XIV system is in the
Rebuilding state, customer data might be lost.
If multiple failed modules need to be replaced, replace and install one module at a
time. Do not remove all modules at one time. Replace the next module only after
the previously replaced module is phased successfully in and data is redistributed.
If you must remove multiple modules at the same time, remove the modules
starting with the highest module in the rack and working down to prevent the
rack from becoming top heavy.
132 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Disconnecting the cables from the data module
Use this procedure to disconnect the power cables, data cables, serial cables, and
USB cables.
Figure 110 and Figure 111 shows connection ports on the rear of the upper and
lower data modules.
Procedure
Complete the following steps from the rear of the rack to disconnect the cables
from the module that is being replaced:
1. Remove the retaining clip from both power cables, and disconnect the power
cables from the module power-supply units.
2. Loosen the retaining screws, and disconnect the serial cable from port S1.
3. Disconnect the data cables from data ports A1 and A2.
Procedure
From the rear of the rack, push the release tab to the right, and pull the SSD out of
the carrier assembly using the pull tab.
Procedure
Repeat the following steps from the front of the rack to remove each DDM:
1. Label each DDM with its position in the module using the numbering sequence
in the following figure.
Each DDM must be returned to its original position in the module after the
module is installed in the rack.
134 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 113. Disk-drive-module numbering sequence
2. Release the DDM latch by pinching together the release tab with the orange
stripe and the depression in the latch.
Latch
Latch depression Green LED
Procedure
Repeat the following steps from the rear of the rack to remove each PSU:
1. Push the locking tab to the left.
xiv10234
Handles Locking tabs
Power socket P1
2. While you hold the locking tab, use the handle to slide the PSU out of its bay.
Note: As you start removing the PSU, you can release the locking tab.
Procedure
Complete the following steps from the front of the rack to remove the data
module:
1. Loosen the two retaining screws on either side of the module by using a
Phillips screwdriver (see Figure 116). The retaining screws are not removable
and take only a few turns to loosen.
xiv10173
Grip Grip
Retaining screw Retaining screw
2. If a mobile lift is available, move it slightly beneath the module to catch the
module when it is removed.
3. Use the grips on the front ends of the module to slide the module outward.
About a half of the way out, the module catches in the metal safety latches.
4. Push in the left-rail and right-rail safety latches and hold while extracting the
module from the bay.
5. Place the module on the mobile lift, or manually lift the module away from the
rack.
136 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Procedure
Using the PSU handle, slide the PSU into the bay. An audible click is heard when
the securing pin engages.
CAUTION:
Procedure
xiv10234
Handles Locking tabs
Power socket P1
2. While you hold the locking tab, use the handle to slide the PSU out of its bay.
Note: As you start to remove the PSU, you can release the locking tab.
What to do next
Set the PSUs aside. The PSUs are reinserted in the data module after inserting the
data module in the rack.
All data and interface module FRUs are shipped with an Ethernet network
interface card (NIC) installed; however, data modules that are installed in positions
10 - 15 do not use the Ethernet NIC or connection.
Procedure
Complete the following steps from the front of the rack to install the data module:
1. If a mobile lift is available, place the new module onto a mobile lift.
If a mobile lift is not available, two persons are required to complete this
procedure for modules 7-15 because of the awkward position.
2. Carefully align the new module with the empty slot.
3. Use the grips on the front ends of the module to slide the module into the bay.
The security latches automatically engage when the module is in position.
4. Tighten the two retaining screws on the front panel by using a Phillips
screwdriver (see Figure 118 on page 139).
138 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
xiv10173
Grip Grip
Retaining screw Retaining screw
Procedure
2. Push the release tab to the side, and insert the new SSD into the opening in the
carrier assembly. Release the tab to secure the SSD in place.
Each DDM must be returned to the same drive bay from which it was removed by
using the numbering sequences shown in Figure 120 on page 140.
Procedure
Repeat the following steps from the front of the rack to install each DDMs:
1. Release the DDM latch by pinching together the tab with the orange stripe and
the depression in the release latch.
Latch
Latch depression Green LED
xiv10176
xiv10174
140 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Installing the power-supply units in the replacement data module
If you are replacing data module 1, 2, or 3 by yourself, and you removed the
power-supply units (PSUs) to reduce the weight of the replacement data module,
use this procedure to reinstall both PSUs in the replacement data module.
Procedure
Using the PSU handle, slide the PSU into the mounting cage. An audible click is
heard when the securing pin engages.
Figure 123 and Figure 124 on page 142 illustrates the location of each port on the
rear of the upper and lower data modules.
All cables are labeled at both ends with the component and port location to which
the cable ends connect. The labels at both ends of the cable are identical. For
example, a cable with label “M9S1-M7USB3” connects from serial port S1 on
module 9 to USB3 port on module 7.
Each cable end is color-coded to aid in ensuring that cables are correctly connected.
The cabling is different for each module. For a detailed list of cables and cable-end
colors for each module, see “Upper data-module cable connections” on page 361
and “Lower data-module cable connections” on page 380.
Procedure
Complete the following steps from the front of the rack to connect cables:
1. Connect the InfiniBand cables to their correct data ports G1 and G2.
2. (Modules 1 - 3 only) Connect the Ethernet cables to their correct data ports F1,
F2, F3, and F4.
3. (Module 1 only) Connect the USB cable to port USB1.
4. (Module 3 on model 281x-214 and 281x-215 only) Connect the USB cable from
port USB2.
5. Connect the USB cable to port USB3.
6. Connect the data cables to their correct data ports A1 and A2.
142 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
11. Verify that the PSU green LEDs are steady on.
If the LED is not steady on, see “Troubleshooting data and interface modules”
on page 337.
12. From the front of the rack, verify that the power LED is lit.
If the LED is not lit, power on the module by pressing the power button.
Then, wait 5 minutes for the module to power on.
Power
button
Power status LED
xiv10365
Figure 125. Power button on the front of the data and interface modules
13. (Module 3 only) Verify that the maintenance module can communicate with
module 3.
a. From the Technician Assistant, click SSH tunnel closed. The Challenge
and Response window is displayed, which requires you to enter a
response to a challenge.
b. Enter the response to the challenge, and click OK. The button changes to
SSH tunnel open.
You can find the response for the XIV system on the IBM XIV Service
Center website (http://servicecenter.xiv.ibm.com).
Note: You must be authorized to obtain a unique response key for the
challenge. If you are not authorized, contact your next level of support.
c. From the Technician Assistant tool, click Launch > Open System shell.
The Open system shell window is displayed.
d. Run the ssh root@14.10.202.3 command to connect to data module 3.
e. Verify that the following prompt is displayed, which means that the
notebook computer is connected to data module 3:
chubaka-1310133:~ #
f. Enter exist to log out of the SSH session.
g. Close the Open system shell window.
Procedure
Procedure
Complete the following steps to verify that the hardware components are operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not Full Redundancy, contact your next level of support.
3. If any component is in the Initializing state, wait 10 minutes, and check the
status pod again.
If a component stays in the Initializing state (the component is displayed as
yellow), complete the following steps from the IBM XIV Storage Management
GUI:
a. Right-click the component, and click Phase Out > Failed.
b. Hover the cursor over the component, and verify that Status is Failed.
c. Verify that the system status on the lower-right corner of the window shows
Full Redundancy.
d. Right-click the component, and click Test.
The component goes through a testing procedure. When complete, the
Command executed successfully message is displayed.
e. Hover the cursor over the component, and verify that Status is Ready.
4. If any component is in the Ready state, complete the following steps from the
IBM XIV Storage Management GUI:
a. Right-click the component, and click Phase In.
When you phase in a disk drive module (DDM), data module, or interface
module, the component turns yellow, and the status on the lower right
corner of the window shows Redistributing. Depending on the amount of
data to be redistributed, this process might take some time.
b. Hover the cursor over the component, and verify that Status is OK.
5. If any component is in the Failed state (the component is displayed as red),
complete the following steps from the IBM XIV Storage Management GUI:
a. From the All Systems view, right-click the XIV system, and click View
Events. The Events window is displayed.
b. View the event log to determine the cause of the failure.
c. If the reason cannot be determined, disconnect and then reconnect the
power cable to the failed component, and then right-click the component,
and click Test.
d. If the component is still failed, contact your .
6. Click View > Monitor > Events, and verify that there are no events with
severities other than informational.
If there are other events, contact your .
144 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Returning the defective component
Use this procedure to package and return the defective component.
Procedure
1. Package the defective component using the packaging from the replacement
component.
2. Send the defective component package to the appropriate facility according to
the process for your respective country or geography.
Ensure that you have the replacement module before you start the replacement
procedure. You must insert the replacement module as soon as possible after
removing the defective module to prevent a disruption in airflow and cooling.
Ensure that you have a table or other surface on which to place the module,
power-supply units (PSUs), and disk drive modules (DDMs).
Use a mobile lift, if possible, to assist in removing and installing the module.
Data and interface modules are replaced as a complete unit. The new module field
replaceable unit (FRU) is supplied with all components except disk drive modules
(DDMs) and the optional solid-state drive (SSD). DDMs and SSD are separate
FRUs.
You can identify a defective data or interface module from the IBM XIV Storage
Management GUI. If the module is defective, the entire module is removed,
packed, and sent to the repair facility. Defective data or interface modules are not
repaired on site.
If multiple modules need to be replaced, replace and install one module at a time.
Do not remove all defective modules at once. Replace the next module only after
the previously replaced module is phased in successfully and after data is
redistributed.
If you must remove multiple modules at the same time, remove the modules
starting with the highest module in the rack and working down to prevent the
rack from becoming top heavy.
Attention:
v Do not replace the module until it is in the Failed state, and the XIV system
itself is in the Full Redundancy state. These states indicate that the data in the
defective module is redistributed to other modules and DDMs.
v When replacing a module, do not leave a bay empty any longer than necessary,
as it affects airflow and cooling.
If the interface module is already in the Failed state, it is not necessary to phase
out the interface module. From the IBM XIV Storage Management GUI, hover the
cursor over the interface module, and verify that the Status is Failed.
Attention: Do not select Phase Out > Ready unless you are instructed to do so
by your next level of support.
Procedure
146 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
3. Hover the cursor over the module, and verify that the Status is Failed.
4. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
5. Wait 10 minute before proceeding.
Procedure
Complete the following steps to start the guided repair for data modules:
1. From the Technician Assistant tool, click Launch > Guided repair > Guided
repair for Module. The Guided repair for module window is displayed.
2. Follow the instructions in the guided repair viewer.
The guided-repair utility instructs you to replace the failed module. Continue
with the next procedures to remove the failed module and install the module
FRU.
The interface module must be in the Failed state before it can be removed.
The XIV system must be in the Full Redundancy state before removing the
interface module. When an interface module fails, the XIV system changes to the
Rebuilding state and rebuilds the lost data on other DDMs in the XIV system.
When the interface module is being phased out, the XIV system changes to the
Redistributing state and redistributes the data to other DDMs in the XIV system.
When the rebuild or redistribution is complete, the XIV system changes to the Full
Redundancy state.
Attention: If you replace an interface module while the XIV system is in the
Redistributing state, customer data might be lost.
Important:
v If multiple failed modules need to be replaced, replace and install one module at
a time. Do not remove all modules at one time. Replace the next module only
after the previously replaced module is successfully phased in and data is
redistributed.
v If you must remove multiple modules at the same time, remove the modules
starting with the highest module in the rack and working down to prevent the
rack from becoming top heavy.
Important: When you disconnect optical Ethernet and Fibre Channel cable, take
care to not cause sharp bends or crimp the cables. If the cable is bent or crimped,
system information flow might be compromised.
Figure 126 and Figure 127 on page 149 show the connection ports on the rear of the
interface modules. Figure 128 on page 149 shows the connection port on the front
of the interface module 5.
148 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 127. Rear view of interface modules (4 - 9) with 1 Gb Ethernet ports
mUSB port
Figure 128. Cable connections for data module 5 (front view) xiv10207
Procedure
Complete the following steps to disconnect the cables from the module:
1. (Module 5 or 6 only) From the front of the rack, disconnect the front-door
logo LED cable from the mUSB port. This cable is connected to module 5 if
the ruggedized rack is not installed or to module 6 if the ruggedized rack is
installed.
Note: When you disconnect the Fibre Channel cables, ensure that you plug
the socket with the special socket plugs. Exposed sockets can get small
amounts of dirt or debris lodged in them, which might affect performance or
cause failure.
10. Disconnect the 10 Gb optical Ethernet cables to their correct ports F1 and F2,
or disconnect the 1 Gb Ethernet cables from ports F1, F2, F3, and F4.
11. Disconnect the InfiniBand cables from ports G1 and G2.
Procedure
From the rear of the rack, push the release tab to the right, and pull the SSD out of
the carrier assembly using the pull tab.
Procedure
Repeat the following steps from the front of the rack to remove each DDM:
1. Label each DDM with its position in the module using the numbering sequence
in the following figure.
Each DDM must be returned to its original position in the module after the
module is installed in the rack.
150 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 130. Disk-drive-module numbering sequence
2. Release the DDM latch by pinching together the release tab with the orange
stripe and the depression in the latch.
Latch
Latch depression Green LED
Procedure
Repeat the following steps from the rear of the rack to remove each PSU:
1. Push the locking tab to the left.
xiv10234
Handles Locking tabs
Power socket P1
2. While you hold the locking tab, use the handle to slide the PSU out of its bay.
Note: As you start removing the PSU, you can release the locking tab.
Procedure
Complete the following steps from the front of the rack to remove the interface
module:
1. Loosen the two captive screws on either side of the module by using a Phillips
screwdriver (see Figure 133). The captive screws are not removable and take
only a few turns to loosen.
xiv10173
Grip Grip
Retaining screw Retaining screw
2. If a mobile lift is available, move it slightly beneath the module to catch the
module when it is removed.
3. Use the grips on the front ends of the module to slide the module outward.
About a half of the way out, the module catches in the metal safety latches.
4. Push in the left-rail and right-rail safety latches and hold while extracting the
module from the bay.
5. Place the module on the mobile lift, or manually lift the module away from the
rack.
152 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Procedure
Using the PSU handle, slide the PSU into the bay. An audible click is heard when
the securing pin engages.
CAUTION:
Procedure
xiv10234
Handles Locking tabs
Power socket P1
2. While holding the locking tab, use the handle to slide the PSU out of its bay.
Note: As you start removing the PSU, you can release the locking tab.
What to do next
Set the PSUs aside. The PSUs are reinserted in the interface module after inserting
the interface module in the rack.
Procedure
Complete the following steps from the front of the rack to install the interface
module:
1. If a mobile lift is available, place the new module onto a mobile lift.
If a mobile lift is not available, two persons are required to complete this
procedure for modules 7-15 because of the awkward position.
2. Carefully align the new module with the empty slot.
3. Use the grips on the front ends of the module to slide the module into the bay.
The security latches automatically engage when the module is in position.
4. Tighten the two retaining screws on the front panel by using a Phillips
screwdriver (see Figure 135).
xiv10173
Grip Grip
Retaining screw Retaining screw
154 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Procedure
2. Push the release tab to the side, and insert the new SSD into the opening in the
carrier assembly. Release the tab to secure the SSD in place.
Each DDM must be returned to the same drive bay from which it was removed by
using the numbering sequences shown in Figure 137.
Procedure
Complete the following steps from the front of the rack to install each DDMs:
1. Release the DDM latch by pinching together the tab with the orange stripe and
the depression in the release latch (see Figure 138 on page 156).
xiv10176
Release tab Amber LED
xiv10174
Figure 139. Inserting the disk-drive modules into the bay
Procedure
Using the PSU handle, slide the PSU into the mounting cage. An audible click is
heard when the securing pin engages.
156 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Before you begin
Important: When you disconnect the optical Ethernet and Fibre Channel cables,
take care to not cause sharp bends or crimp the cables. If the cable is bent or
crimped, system information flow might be compromised.
Figure 140 and Figure 141 illustrate the location of each port on the rear of the
interface module. Figure 142 on page 158 shows the connection port on the front of
the interface module 5.
xiv10207
Figure 142. Cable connections for data module 5 (front view)
All cables are labeled at both ends with the component and port location to which
the cable ends connect. The labels at both ends of the cable are identical. For
example, a cable with label “M9S1-M7USB3” connects from serial port S1 on
module 9 to USB3 port on module 7.
Each cable end is color-coded to aid in ensuring that cables are correctly connected.
The cabling is different for each module. For a detailed list of cables and cable-end
colors for each module, see “Interface-module cable connections” on page 368.
Important:
v Always reconnect the power cables last.
v Do not connect the Fibre Channel cables (for ports D1, D2, E1, and E2) until after
the module is powered on. Connecting these cables before you power on the
XIV system might cause host system to lose connectivity to the XIV system.
Connect these cables only after you verify that the worldwide port name
(WWPN) on the Fibre Channel port is correct and that the module is phasing in.
Procedure
Important: If this cable was already disconnected before the door was
removed, do not reconnect the cable.
2. From the rear of the rack, connect both InfiniBand cables to their correct ports
G1 and G2.
3. Connect the 10 Gb optical Ethernet cables to their correct ports F1 and F2, or
connect 1 Gb Ethernet cables to their correct ports F1, F2, F3, and F4.
4. (Module 4, 5, and 6 only) Connect the USB cable to port USB1.
5. (Module 4 on model 281x-214 and 281x-215 only) Connect the USB cable from
port USB2.
6. Connect the serial-to-USB cable to port USB3.
7. (Module 4 and 5 only) Connect the USB cable to port USB4.
8. Connect both data cables to their correct ports A1 and A2.
158 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Important: The cable that is labeled M1A2-MtopA1 must be connected to port
A1 in the highest module. For example, for an XIV system in a 10-module
configuration, the cable that is labeled M1A2-MtopA1 must be connected to
module 10 in port A1. In some XIV systems, this cable is labeled
M1A2-M15A1.
9. Connect the serial to USB cable to port S1, and tighten the retaining screws.
10. Verify that all cables (except Fibre Channel cables) are correctly connected and
fully seated.
11. Connect both power cables into their correct sockets P1 and P2.
12. Secure the power cable by moving the retaining clip over the power cable.
13. Verify that the PSU green LEDs are steady on.
If the LED is not steady on, see “Troubleshooting data and interface modules”
on page 337.
14. From the front of the rack, verify that the power LED is lit.
If the LED is not lit, power on the module by pressing the power button.
Then, wait 5 minutes for the module to power on.
Power
button
Power status LED
xiv10365
Figure 143. Power button on the front of the data and interface modules
15. (Module 4 only) Verify that the maintenance module can communicate with
module 4.
a. From the Technician Assistant, click SSH tunnel closed. The Challenge
and Response window is displayed, which requires you to enter a
response to a challenge.
b. Enter the response to the challenge, and click OK. The button changes to
SSH tunnel open.
You can find the response for the XIV system on the IBM XIV Service
Center website (http://servicecenter.xiv.ibm.com).
Note: You must be authorized to obtain a unique response key for the
challenge. If you are not authorized, contact your next level of support.
c. From the Technician Assistant tool, click Launch > Open System shell.
The Open system shell window is displayed.
d. Run the ssh root@14.10.202.4 command to connect to interface module 4.
e. Verify that the following prompt is displayed, which means that the
notebook computer is connected to interface module 4:
chubaka-1310133:~ #
f. Enter exist to log out of the SSH session.
Procedure
Procedure
Complete the following steps to verify that the hardware components are operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not Full Redundancy, contact your next level of support.
3. If any component is in the Initializing state, wait 10 minutes, and check the
status pod again.
If a component stays in the Initializing state (the component is displayed as
yellow), complete the following steps from the IBM XIV Storage Management
GUI:
a. Right-click the component, and click Phase Out > Failed.
b. Hover the cursor over the component, and verify that Status is Failed.
c. Verify that the system status on the lower-right corner of the window shows
Full Redundancy.
d. Right-click the component, and click Test.
The component goes through a testing procedure. When complete, the
Command executed successfully message is displayed.
e. Hover the cursor over the component, and verify that Status is Ready.
4. If any component is in the Ready state, complete the following steps from the
IBM XIV Storage Management GUI:
a. Right-click the component, and click Phase In.
When you phase in a disk drive module (DDM), data module, or interface
module, the component turns yellow, and the status on the lower right
160 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
corner of the window shows Redistributing. Depending on the amount of
data to be redistributed, this process might take some time.
b. Hover the cursor over the component, and verify that Status is OK.
5. If any component is in the Failed state (the component is displayed as red),
complete the following steps from the IBM XIV Storage Management GUI:
a. From the All Systems view, right-click the XIV system, and click View
Events. The Events window is displayed.
b. View the event log to determine the cause of the failure.
c. If the reason cannot be determined, disconnect and then reconnect the
power cable to the failed component, and then right-click the component,
and click Test.
d. If the component is still failed, contact your .
6. Click View > Monitor > Events, and verify that there are no events with
severities other than informational.
If there are other events, contact your .
Procedure
1. Package the defective component using the packaging from the replacement
component.
2. Send the defective component package to the appropriate facility according to
the process for your respective country or geography.
Ensure that you have the replacement PSU before you start this procedure.
Operating the XIV system with a missing component disrupts airflow and prevents
the DDMs from receiving sufficient cooling; therefore, the PSU must be replaced
within 10 minutes of removing the defective PSU. If you cannot replace the PSU
within this time, do not start the procedure.
Ensure that replacement PSU is the correct type. The PSU must be replaced with a
PSU of the same type. You must not replace a regular PSU with a high-efficiency
PSU, and vice versa.
Attention:
Remove the PSU only when it is in the failed state or when directed to do so by
your next level of support. You can identify a defective PSU from the IBM XIV
Storage Management GUI. If a PSU failed, the module and DDMs are in the OK
state, but the PSU is in the Failed state (red).
You cannot phase out a PSU. If it is not already failed, removing the PSU registers
a Fail status with the system.
DANGER
1. Do not remove covers from the PSU. There is danger of electric shock
inside the PSU. Do not attempt to repair a PSU on site. Always return the
PSU to the service lab. PSUs have potential hazards, including:
v Rotating fans
v Hot surfaces
2. Wear and test a suitable anti-static wrist or ankle strap, and observe all
conventional electrostatic discharge (ESD) precautions when handling
plug-in modules and components.
3. Avoid contact with backplane components, module connectors, and other
potentially dangerous components.
Procedure
Complete the following steps to start the guided repair for module power-supply
units:
1. From the Technician Assistant tool, click Launch > Guided repair > Guided
repair for PSU. The Guided repair for PSU window is displayed.
2. Follow the instructions in the guided repair viewer.
The guided-repair utility instructs you to replace the failed module
power-supply units. Continue with the next procedures to remove the failed
module power-supply units and install the module power-supply units FRU.
162 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Before you begin
Replace the PSU only when it is in the Failed state. From the IBM XIV Storage
Management GUI, hover the cursor over the PSU, and verify that the Status is
Failed.
If the PSU is not already failed, removing the PSU registers a Fail status with the
XIV system.
Procedure
Complete the following steps from the rear of the rack to remove the PSU:
1. Unclip the power-cable retainer from the power cable.
2. Disconnect the power cable.
3. Push the locking tab to the left.
xiv10234
4. While you hold the locking tab, use the handle to slide the PSU out of its bay.
As you start to remove the PSU, you can release the locking tab.
Check the replacement PSU for damage. Do not install the PSU if it is damaged.
Avoid damaging the connector pins on the PSU. Do not install the PSU if any of
the connector pins are bent. Do not force the PSU into the data or interface
module.
DANGER
1. Do not remove covers from the PSU. There is danger of electric shock
inside the PSU. Do not attempt to repair a PSU on site. Always return the
PSU to the service lab. PSUs have potential hazards, including:
v Rotating fans
v Hot surfaces
2. Wear and test a suitable anti-static wrist or ankle strap, and observe all
conventional electrostatic discharge (ESD) precautions when handling
plug-in modules and components.
3. Avoid contact with backplane components, module connectors, and other
potentially dangerous components.
Procedure
Complete the following steps from the rear of the rack to install the PSU:
1. Use the PSU handle to slide the PSU into the bay.
An audible click is heard when the securing pin engages.
164 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Completing the guided repair
Use this procedure to complete the guided repair.
Procedure
Procedure
Complete the following steps to verify that the hardware components are operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not Full Redundancy, contact your next level of support.
3. If any component is in the Initializing state, wait 10 minutes, and check the
status pod again.
If a component stays in the Initializing state (the component is displayed as
yellow), complete the following steps from the IBM XIV Storage Management
GUI:
a. Right-click the component, and click Phase Out > Failed.
b. Hover the cursor over the component, and verify that Status is Failed.
c. Verify that the system status on the lower-right corner of the window shows
Full Redundancy.
d. Right-click the component, and click Test.
The component goes through a testing procedure. When complete, the
Command executed successfully message is displayed.
e. Hover the cursor over the component, and verify that Status is Ready.
4. If any component is in the Ready state, complete the following steps from the
IBM XIV Storage Management GUI:
a. Right-click the component, and click Phase In.
When you phase in a disk drive module (DDM), data module, or interface
module, the component turns yellow, and the status on the lower right
corner of the window shows Redistributing. Depending on the amount of
data to be redistributed, this process might take some time.
b. Hover the cursor over the component, and verify that Status is OK.
5. If any component is in the Failed state (the component is displayed as red),
complete the following steps from the IBM XIV Storage Management GUI:
a. From the All Systems view, right-click the XIV system, and click View
Events. The Events window is displayed.
Procedure
1. Package the defective component using the packaging from the replacement
component.
2. Send the defective component package to the appropriate facility according to
the process for your respective country or geography.
Solid-state drive (SSD) caching is an optional feature (feature code 1155 or 2255).
When this feature is ordered, one SSD is included in every data and interface
module.
Procedure
166 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
left side of the module. The location is the same regardless of the type of data
or interface module in the rack.
4. Orient the replacement SSD so that the arrow on the pull tab points upward.
5. Push the retention tab to the side, and insert the new SSD into the opening in
the carrier assembly. Release the tab to secure the SSD in place.
6. Verify that the status LED below the SSD is lit.
7. From the IBM XIV Storage Management GUI, right-click the SSD in the
expanded module view, and click Test.
8. Hover the cursor over SSD, and verify that Status is Ready. If the state is
Initializing, wait approximately 15 seconds until the state changes to Ready.
If the state does not change to the Ready, contact your next level of support.
9. Right-click the SSD at the rear of the expanded module view, and click Phase
in.
10. Hover the cursor over the SSD, and verify that Status is OK.
Procedure
Complete the following steps to start the guided repair for SSDs:
1. From the Technician Assistant tool, click Launch > Guided repair > Guided
repair for SSD. The Guided repair for SSD window is displayed.
2. Follow the instructions in the guided repair viewer.
The guided-repair utility determines whether any SSDs are in a failed state.
Attention:
Ensure that you have a table or other surface on which to place the InfiniBand
switch.
Ensure that you have a flashlight or other moveable light source to better see your
work.
Removing a single InfiniBand switch does not affect system performance, as the
remaining InfiniBand switch continues to operate.
Procedure
Complete the following steps to start the guided repair for InfiniBand switch:
1. From the Technician Assistant tool, click Launch > Guided repair > Guided
repair for switch. The Guided repair for switch window is displayed.
2. Follow the instructions in the guided repair viewer.
The guided-repair utility instructs you to replace the failed InfiniBand switch.
Continue with the next procedures to remove the failed InfiniBand switch and
install the InfiniBand switch FRU.
168 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
About this task
It is not necessary to phase out the InfiniBand switch if it is already in the Failed
state. From the IBM XIV Storage Management GUI, hover the cursor over the
InfiniBand switch to be replaced, and verify that the Status is Failed.
Attention: Do not select Phase Out > Ready unless you are instructed to do so
by your next level of support.
Procedure
Complete the following steps to phase out the InfiniBand switch to be replaced:
1. From the IBM XIV Storage Management GUI, right-click the InfiniBand switch
to be phased out.
2. Click Phase Out > Failed.
When phasing out, the InfiniBand switch turns orange. When the phase out
process is complete, the InfiniBand switch turns red
3. Hover the cursor over the InfiniBand switch to be replaced, and verify that the
Status is Failed.
Procedure
3. Verify that all LEDs on the InfiniBand switch to be replaced are off.
4. From the rear of the rack, disconnect all of the InfiniBand cables on the
InfiniBand switch to be replaced.
The cables for the upper InfiniBand switch 2 are red. The cables for lower
InfiniBand switch 1 are yellow.
Note: If one of the ports 1 to 17 in the replaced switch had no cable connected
to it but was moved to (spare) port 18 instead, make a note of this and also
attach the cable to port 18 on the replacement switch.
IS5030
MGMT CONSOLE
Power
PSU 1
PSU 2
FAN
RST
xiv10093
Fan status LED Switch-to-switch Switch-to-module
port (MGT) port (console)
5. Disconnect the RJ45-to-USB cable from the CONSOLE port on the InfiniBand
switch to be replaced.
6. Disconnect the Ethernet cable from the MGT port on the InfiniBand switch to
be replaced.
7. From the rear of the rack, use an 8 mm (5/16 in.) hex nut or wrench to remove
the four retaining screws at the ends of the InfiniBand switch to be replaced,
and place the screws in a secure location.
8. Carefully slide the InfiniBand switch to be replaced out of the rack.
All cables are labeled at both ends with the component and port location to which
the cable ends connect. The labels at both ends of the cable are identical. For
example, a cable with label “M9S1-M7USB3” connects from serial port S1 on
module 9 to USB3 port on module 7.
Each cable end is color coded to aid in ensuring that cables are correctly
connected.
The cabling is similar for both InfiniBand switches. For a detailed list of cables and
cable-end colors for each InfiniBand switch, see “Data and interface module cable
connections” on page 361.
Procedure
170 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
3. Replace the four retaining screws by using a 8 mm (5/16 inch) hex nut or
wrench to tighten the screws into position.
4. Connect the InfiniBand cables in numerical order (see Figure 150).
Cables for the upper InfiniBand switch 2 are red. Cables for the lower
InfiniBand switch 1 are yellow.
IS5030
MGMT CONSOLE
Power
PSU 1
PSU 2
FAN
RST
xiv10093
Fan status LED Switch-to-switch Switch-to-module
port (MGT) port (console)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18
xiv10096
19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36
The green status LED for the port is lit when the physical connection is made.
The yellow status LED for the port is lit when a logical connection is made.
When data is being transferred, the yellow status LED flashes.
Important: Carefully read the labels on each InfiniBand cable. You must
replace the cables in the correct positions. For example, on the upper
InfiniBand switch 2 (red cable), the first cable is labeled as N2.1-M1G2. This
means that the cable connects InfiniBand switch N2, port1 to module 1, port
G2.
Procedure
Procedure
Complete the following steps to verify that the hardware components are operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not Full Redundancy, contact your next level of support.
3. If any component is in the Initializing state, wait 10 minutes, and check the
status pod again.
If a component stays in the Initializing state (the component is displayed as
yellow), complete the following steps from the IBM XIV Storage Management
GUI:
a. Right-click the component, and click Phase Out > Failed.
b. Hover the cursor over the component, and verify that Status is Failed.
c. Verify that the system status on the lower-right corner of the window shows
Full Redundancy.
d. Right-click the component, and click Test.
The component goes through a testing procedure. When complete, the
Command executed successfully message is displayed.
e. Hover the cursor over the component, and verify that Status is Ready.
4. If any component is in the Ready state, complete the following steps from the
IBM XIV Storage Management GUI:
a. Right-click the component, and click Phase In.
When you phase in a disk drive module (DDM), data module, or interface
module, the component turns yellow, and the status on the lower right
corner of the window shows Redistributing. Depending on the amount of
data to be redistributed, this process might take some time.
b. Hover the cursor over the component, and verify that Status is OK.
5. If any component is in the Failed state (the component is displayed as red),
complete the following steps from the IBM XIV Storage Management GUI:
172 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
a. From the All Systems view, right-click the XIV system, and click View
Events. The Events window is displayed.
b. View the event log to determine the cause of the failure.
c. If the reason cannot be determined, disconnect and then reconnect the
power cable to the failed component, and then right-click the component,
and click Test.
d. If the component is still failed, contact your .
6. Click View > Monitor > Events, and verify that there are no events with
severities other than informational.
If there are other events, contact your .
Procedure
1. Package the defective component using the packaging from the replacement
component.
2. Send the defective component package to the appropriate facility according to
the process for your respective country or geography.
Ensure that you have the replacement PSU before starting this procedure.
Operating the XIV system with any component missing disrupts airflow and
prevents the DDMs from receiving sufficient cooling; therefore, the PSU must be
replaced within 10 minutes of removing the defective PSU. If you cannot replace
the PSU within this time, do not start the procedure.
Ensure that you have the correct illumination before attempting to work within the
rack.
Attention:
Remove the PSU only when it is in the failed state or when directed to do so by
your next level of support.
If the PSU has failed, the InfiniBand switch appears normal (status OK, green) in
the IBM XIV Storage Management GUI because the other PSU continues providing
power.
DANGER
1. Do not remove covers from the PSU. There is danger of electric shock
inside the PSU. Do not attempt to repair a PSU on site. Always return the
PSU to the service lab. PSUs have potential hazards, including:
v Rotating fans
v Hot surfaces
2. Wear and test a suitable anti-static wrist or ankle strap, and observe all
conventional electrostatic discharge (ESD) precautions when handling
plug-in modules and components.
3. Avoid contact with backplane components, module connectors, and other
potentially dangerous components.
Procedure
174 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Before you begin
Important: Do not attempt to insert a PSU with a power cord connected to it.
Procedure
Procedure
Complete the following steps to verify that the hardware components are operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not Full Redundancy, contact your next level of support.
3. If any component is in the Initializing state, wait 10 minutes, and check the
status pod again.
If a component stays in the Initializing state (the component is displayed as
yellow), complete the following steps from the IBM XIV Storage Management
GUI:
a. Right-click the component, and click Phase Out > Failed.
b. Hover the cursor over the component, and verify that Status is Failed.
c. Verify that the system status on the lower-right corner of the window shows
Full Redundancy.
d. Right-click the component, and click Test.
The component goes through a testing procedure. When complete, the
Command executed successfully message is displayed.
e. Hover the cursor over the component, and verify that Status is Ready.
4. If any component is in the Ready state, complete the following steps from the
IBM XIV Storage Management GUI:
a. Right-click the component, and click Phase In.
When you phase in a disk drive module (DDM), data module, or interface
module, the component turns yellow, and the status on the lower right
corner of the window shows Redistributing. Depending on the amount of
data to be redistributed, this process might take some time.
b. Hover the cursor over the component, and verify that Status is OK.
5. If any component is in the Failed state (the component is displayed as red),
complete the following steps from the IBM XIV Storage Management GUI:
Procedure
1. Package the defective component using the packaging from the replacement
component.
2. Send the defective component package to the appropriate facility according to
the process for your respective country or geography.
Ensure that you have a replacement fan unit before starting this procedure. Install
the replacement fan unit in less than 2 minutes after removing the defective fan
unit. If you cannot replace the fan unit within this time, do not start the procedure.
Ensure that you have an illumination source before attempting to work within the
rack.
If one of the fans in the fan unit is inoperable, the InfiniBand switch can operate as
long as the ambient temperature is less than 45°C (113°F) .
Procedure
Complete the following steps from the front of the rack to remove and install the
fan unit:
1. Remove the cover plate at rack EIA positions 23 and 24 to provide access to the
rear of the InfiniBand switches.
2. Using two hands, push both latch releases toward each other simultaneously
while pulling the fan unit out of the switch (see Figure 152 on page 177). As the
fan unit unseats, the fan status indicator turns off.
176 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Release
latches Fan status LED
xiv10110
Fan unit
3. Ensure that the mating connector of the new fan unit is free of any dirt and
obstacles.
4. Insert the fan unit by sliding it into the opening until slight resistance is felt.
Continue pressing the fan unit until it seats completely.
5. Verify that the fan status LED lights green (see Figure 152).
6. Verify that the airflow labels on the fan unit and the power-supply units (PSUs)
are identical (see Figure 152).
7. Run diagnostic tests to ensure that the IBM XIV Software System is operating
correctly (see “Running basic diagnostic test” on page 323).
8. Package the defective fan unit using the packaging from the replacement fan
unit.
9. Send the defective fan-unit package to the appropriate facility according to the
process for your respective country or geography.
Either a mobile lift or two people are required to hold the maintenance module in
place while the module is being removed.
Determine which maintenance module is installed on your XIV system and follow
the appropriate instructions:
v “Removing the M3 and M4 maintenance modules and guide rails” on page 178
v “Removing the M5 maintenance module and guide rails” on page 179
Procedure
xiv10169
Figure 153. Front view of the M3 and M4 maintenance modules
USB 1
USB 1
Figure 155. Rear view of the M4 maintenance module
6. Disconnect the four Ethernet cables (C1, C2, A1, and A2).
178 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
7. Disconnect the modem cable from port USB1.
8. Pull up on the blue pin on the left guide rail to disconnect the cable
management arm from the guide rail.
9. Push in the left-rail and right-rail safety latches down and hold while sliding
the maintenance module out of the rack. The maintenance module is removed
with the guide rails attached.
10. Remove both the left and right guide rails from the maintenance module by
removing the three mounting screws that hold each rail in place. Use a
Phillips screwdriver to remove the mounting screws.
The guide rails are not part of the maintenance-module field replaceable unit
(FRU). These same guide rails and mounting screws are reused when you
install the replacement maintenance module.
Guide rails
xiv10364
Screws
Figure 156. Guide rails on the maintenance module
Procedure
2. Verify that the power-on LED goes from a lit state to flashing slowly. For more
LED status information, see “Maintenance module LEDs” on page 329.
3. From the rear of the module, disconnect the power cable from the power
socket.
4. Disconnect all Ethernet connection cables (C1, C2, A1, A2, and any other
optional connections).
5. Disconnect the modem cable from port USB1.
6. Disconnect the cable management arm.
7. From the front of the module, pull down on the rack release latches on either
side of the server (see Figure 157 on page 179) and slide the module out, until
the rails are fully extended and click into place.
8. Press on the blue dots, on the outer guide rails (see Figure 160 on page 181),
one on either rail by the front of the unit. This opens the locking tabs and
releases the maintenance module from the guide rails.
180 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 160. Guide rail locking tab
Once the M5 maintenance module has been removed, the guide rails can be
removed from the rack.
Procedure
1. From the back of the rack, remove the mounting screw that holds the rail in
place.
The guide rails are not part of the maintenance-module field replaceable unit
(FRU). These same guide rails and mounting screws are reused when you
install the replacement maintenance module.
3. Guide the rails inward and remove the rails from the rack.
Repeat this process on the second rail.
Either a mobile lift or two people are required to hold the maintenance module in
place while the module is being installed.
Before the maintenance module is installed, the guide rails must be installed in the
rack. To install the guide rails, see “Installing the M5 guide rails.” If the guide rails
are already installed, proceed to “Installing the M5 maintenance module” on page
184.
Procedure
Note: The guide rails are labeled on their outer-sides which are the Right Front
and Left Front, in order to avoid wrong installation.
1. Fully extend the guide rail by opening the locking tab on the outer back side of
the guide rail (see Figure 163 on page 183).
182 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 163. Opening the locking tab
2. Align and place guide rail pins in the back of the rack.
Figure 164. Rear of guide rail: pins and screw inserted in rack
3. From the front of the rack, open the blue locking tab and push the front two
pins into place.
Figure 165. Front of guide rail: locking tab open and pins in place
Procedure
1. From the front of the rack, fully extend the guide rails. (If the guide rails have
not yet been installed, follow the instructions the section “Installing the M5
guide rails” on page 182.
2. Align all three pins and pinholes on each side, back-to-front, one side at a
time. Ensure that all pins are inserted properly in each of the six pinholes
before continuing.
3. Push the two blue locking tabs inwards (left and right) and slide the module
into the rack.
184 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 167. Opening the guide rail locking tabs
6. Connect the Ethernet cables to their correct ports A1, A2, C1, and C2, as well
as any other optional port connections. Verify that each cable is connected to
the correct port.
7. Connect the power cable in the power socket.
8. Connect the cable management arm.
9. Press the power-control button to power on the maintenance module.
Note: You must be authorized to obtain a unique response key for the
challenge. If you are not authorized, contact your next level of support.
c. From the Technician Assistant tool, click Launch > Open System shell. The
Open system shell window is displayed.
d. Run the ssh root@14.10.202.3 command to connect to data module 3.
Note: In order to see the current module version (for both module 3 and
module 4), once connected to the module, run the following command:
cat /etc/version
Example:
chubaka-7812348:~#cat /etc/version
11.1.3-20141113
e. Verify that the following prompt is displayed, which means that the
notebook computer is connected to data module 3:
chubaka-7812348:~ #
Example:
superuser@nextra-7812348-module-1:~# ssh 14.10.202.3
Last login: Thu Feb 26 18:05:32 2015 from module-4
chubaka-7812348:~ # exit
186 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Procedure
Complete the following steps to verify that the maintenance module is operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not in Full Redundancy, contact your next level of support.
3. If the maintenance module is in the Failed state (the component is displayed as
red), complete the following steps from the IBM XIV Storage Management GUI:
a. From the All Systems view, right-click the XIV system, and click View
Events. The Events window is displayed.
b. View the Event log to determine the cause of the failure.
c. If the reason cannot be determined, disconnect and then reconnect the
power and data cables to the failed maintenance module, and then
right-click the XIV system, and hover the cursor over the component, and
verify that Status is OK.
d. Verify that the maintenance module can communicate with data module 3
and interface module 4 by completing step 11 on page 186 of “Installing the
M5 maintenance module” on page 184, using superuser login details.
4. Click View > Monitor > Events, and verify that there are no new events with
severities other than informational.
If there are other events, contact your next level of support.
Procedure
1. Package the defective component using the packaging from the replacement
component.
2. Send the defective component package to the appropriate facility according to
the process for your respective country or geography.
CAUTION:
The weight of this part or unit is 18 - 32 kg (39.7 - 70.5 lb). It takes two persons
to safely lift this part or unit. (C009)
Weight: 55kg
1. It is necessary to use two persons to remove and replace a uninterruptible
power supply. The weight of a uninterruptible power supply with the
batteries removed is 19 kg (41.8 lbs).
Before beginning the procedure, ensure that you have a stable surface
available (appropriate to the weight and size) on which to place the removed
and replacement module, such a wheeled cart or table.
2. You must remove the heavy batteries before extracting the uninterruptible
power supply.
188 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Starting the guided repair
Use the Technician Assistant tool to start the guided repair for a failed
uninterruptible power supply.
Procedure
Complete the following steps to start the guided repair for an uninterruptible
power supply:
1. From the Technician Assistant tool, click Launch > Guided repair > Guided
repair for UPS. The Guided repair for UPS window is displayed.
2. Follow the instructions in the guided repair viewer.
This guided-repair procedure tests each failed uninterruptible power supply. If
the test fails, the guided-repair utility attempts to resolve the problem and run
the guided-repair utility again. If the guided-repair utility cannot resolve the
problem, an error message is displayed in the Guided repair for UPS window.
If one in the following situations occur, an error is displayed:
v If cables are not correctly connected to the XIV system. Check the cable
connections and try to initialize the uninterruptible power supply again.
v If batteries require charging, the UPS_SELF_TEST_IS_POSSIBLY_INACCURATE
error is displayed.
If batteries require charging, the uninterruptible power supply might stay in
the initializing state for up to three hours. It is not necessary for the IBM
service representative to wait for the batteries to charge. If the batteries are
not charged 100% after 3 hours, the customer must issue another service
request. Ask the customer to check the battery-charge status by running the
ups_list command.
3. If the guided-repair utility determines that the uninterruptible power supply is
not functioning correctly, see “Starting the guided replacement.”
Procedure
Procedure
Complete the following steps to disconnect power cable from the ATS:
1. Verify that each uninterruptible power supply is connected to the correct outlet
on the ATS (see Chapter 11, “Cable connections,” on page 361).
2. Unclip the power-cable retainer for the appropriate power cable on the ATS.
Power-cord
retaining bracket
xiv10150
190 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Maintenance module
power cord
Maintenance module
circuit breaker
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10149
Figure 171. Power sockets and circuit breakers on the side of the ATS
Procedure
Complete the following steps to disconnect power cable from the ATS:
1. If you are replacing uninterruptible power supply 2, complete the following
steps:
Power-cord
retaining bracket
xiv10150
Figure 172. Power-cable retainer that is not clipped
Maintenance module
power cord
Maintenance module
circuit breaker
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10149
Figure 173. Power sockets and circuit breakers on the side of the ATS
192 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 174. Main-power cable pigtail retention bracket
The following figure shows the cable connections on the rear of the uninterruptible
power supply.
Complete the following steps to disconnect the power, network, serial, and
ac-sensor cables:
1. Disconnect all 10-Amp. power cables.
2. Loosen the finger screws, and remove the serial plug from serial port S1.
3. Remove the Ethernet cable from port N1.
4. (Uninterruptible power supply 3 only) Remove the ac-sensor cable from port
OUTPUT.
5. If the uninterruptible power supply is connected to an EPO circuit, disconnect
the EPO circuit at the uninterruptible power supply EPO port.
It is not necessary to mark the battery positions because batteries can be replaced
into any battery bay.
CAUTION:
When replacing batteries, there is a certain energy risk hazard. Remove all
jewelry (such as watches, bracelets, and rings) before replacing the batteries.
CAUTION:
The batteries are heavy, approximately 18 kg (40 lbs). Handle them with care.
Procedure
194 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Plastic cover
Data may
be lost
if button
is pushed
xiv10143
Test button Power-off cover
2. Remove the plastic cover from the front of the uninterruptible power supply.
The cover snaps off.
3. Remove the two screws from the battery cover by using a Phillips screwdriver.
Store both screws in a safe place. These screws are reused when replacing the
batteries.
Data may
be lost Test
if button
is pushed
xiv10212
Figure 177. Uninterruptible power-supply battery cover
4. Pull the battery cover to the left by using the hand grip to release the latch, and
swing the battery cover out towards the left to expose both batteries.
5. Unplug both battery connectors from the batteries.
Battery connectors
xiv10211
The uninterruptible power supply batteries must be removed, and all cables must
be disconnected before removing the uninterruptible power supply from the rack.
If possible, use a mobile lift to catch the uninterruptible power supply after it is
removed.
Ensure that you have enough space to entirely pull out the uninterruptible power
supply.
CAUTION:
Procedure
196 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Installing the uninterruptible power supply
Use this procedure to install the uninterruptible power supply in the rack.
If possible, use a mobile lift to bring the uninterruptible power supply as close to
the rack as possible.
The uninterruptible power supply is inserted in the rack without the batteries.
Batteries are inserted after the uninterruptible power supply is in place and
secured.
CAUTION:
Procedure
Complete the following steps to install the uninterruptible power supply in the
rack:
1. Coil the ATS-to-uninterruptible power-supply power cable behind the
uninterruptible power supply.
If the power cable is correctly placed behind the uninterruptible power supply,
you can easily insert the uninterruptible power supply into position.
2. From the front of the rack, insert the uninterruptible power supply in the rack.
Maneuver the uninterruptible power supply until you can slide it into position.
3. Push in the uninterruptible power supply as far as possible, so that the front
panel is flush with the rack and the ATS-to-uninterruptible power-supply
power cable can be seen at the rear of the rack.
4. Fasten the four retaining screws on the left side and two retaining screws on
the upper right of the uninterruptible power supply.
CAUTION:
The batteries are heavy, approximately 18 kg (40 lbs). Handle them with care.
Procedure
The cabling is different for each uninterruptible power supply. For a detailed list of
cables and cable-end colors for each uninterruptible power supply, see
“Uninterruptible power-supply cable connections” on page 389.
Procedure
Complete the following steps to connect the uninterruptible power supply cables:
1. Connect all color-coded 10-Amp. power cables to the appropriate power
sockets.
Use a portable flashlight or other illumination to help you read the labels. The
position is awkward for some cables.
Figure 179 on page 199 shows the location of the output-power sockets for each
uninterruptible power supply.
198 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Each power cable is labeled to indicate the appropriate position on the
uninterruptible power supply See “Uninterruptible power-supply cable
connections” on page 389 for a table of components and ports to which the
power cables are connected.
Power socket
1 2 3 4
xiv10235
5 6 7 8
xiv10145
10 Amp power sockets Serial port EPO port
(S1)
3. Connect the serial cable to the port S1, and finger tighten the fastening screws.
4. (Uninterruptible power supply 3 only) Connect the ac-sensor cable labeled
ATSX807-U3OUTPUT to the port OUTPUT (blue connector) so that the securing
screws face downward.
5. If an EPO circuit is being used, connect the EPO cable to the EPO port.
The following figure illustrates the main-power-cable connections for a XIV system
that is set up in a two-main-power-cable configuration.
A J1 P3
Uninterruptible
ATS P2 power supply 2
B J2 P1
Uninterruptible
xiv10047
power supply 1
Procedure
Maintenance module
power cord
Maintenance module
circuit breaker
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10149
Figure 182. Power sockets and circuit breakers on the side of the ATS
200 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
3. Clip the power-cable retainer over the power-cable pigtail to secure the power
cable to the ATS.
Power-cord
retaining bracket
xiv10151
Figure 183. Power-cable retainer that is clipped
The following figure illustrates the main-power-cable connections for a XIV system
that is set up in a four-main-power-cable configuration. In this configuration, the
power cable for uninterruptible power-supply 2 connects to the ATS. The power
cables for uninterruptible power-supply 1 and 3 connect to main-power cables.
This procedure unplugs the power cable from the ATS or a main-power cable. The
uninterruptible power-supply power cable is hard wired into the back of the
uninterruptible power supply and is removed along with the uninterruptible
power supply.
Uninterruptible
power supply 3
J1 P3
Uninterruptible
ATS P2 power supply 2
J2 P1
Uninterruptible
xiv10399
power supply 1
Procedure
Maintenance module
power cord
Maintenance module
circuit breaker
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10149
Figure 185. Power sockets and circuit breakers on the side of the ATS
b. Clip the power-cable retainer over the power-cable pigtail to secure the
power cable to the ATS.
Power-cord
retaining bracket
xiv10151
202 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
a. Connect the uninterruptible power-supply power cable directly to the
main-power cable from which the defective uninterruptible power supply
was disconnected.
b. Place the power-cable retainer on the connected pigtails.
c. Secure the retainer to the main-power cable and power cable by using the
cable ties, as shown in Figure 187.
Procedure
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10149
Figure 188. Power sockets and circuit breakers on the side of the ATS
2. Ensure that the three output circuit breakers on all three uninterruptible power
supplies are set to the on (up) position.
Circuit breakers
and guard
xiv10152
Online/bypass
switch
204 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
The battery LED briefly turns amber as the XIV system powers on, and then
turns green when power stabilizes.
Plastic cover
Data may
be lost
if button
is pushed
xiv10143
Test button Power-off cover
Procedure
Procedure
Complete the following steps to verify that the hardware components are operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not Full Redundancy, contact your next level of support.
3. If any component is in the Initializing state, wait 10 minutes, and check the
status pod again.
If a component stays in the Initializing state (the component is displayed as
yellow), complete the following steps from the IBM XIV Storage Management
GUI:
a. Right-click the component, and click Phase Out > Failed.
b. Hover the cursor over the component, and verify that Status is Failed.
Procedure
1. Package the defective component using the packaging from the replacement
component.
2. Send the defective component package to the appropriate facility according to
the process for your respective country or geography.
Verify that all module power-supply units (PSUs) are connected and providing
power. Ensure that the LEDs on each PSU are solid green, indicating that the PSU
is supplying power to the module.
206 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
About this task
Procedure
1. Check the battery-born date. If any of the replacement batteries are older than
nine months from the current date, report the battery as defective, and order a
new battery pair.
The battery-born date is on a label on the upper-right corner of each
uninterruptible power-supply battery. This label contains an APC serial number
that includes the date of manufacture. The battery-born date is encoded in
characters 3-6 of the serial number (see the following figure). These characters
indicate the year and the week within the year on which the battery was
manufactured. For example, serial number NS0929011956 indicates that the
battery was manufactured in the year 09 (2009) and week 29.
xiv10292
2. Record both battery serial numbers on a piece of paper for later use in setting
the uninterruptible power-supply battery replacement date.
Complete the following steps to start the guided repair for an uninterruptible
power supply:
1. From the Technician Assistant tool, click Launch > Guided repair > Guided
replace for Batteries. The Guided replace for Batteries window is displayed.
2. Follow the instructions in the guided repair viewer.
3. When the guided-repair utility instructs you to replace the uninterruptible
power-supply batteries, continue with the next procedures to remove the failed
batteries and install the battery FRUs.
Leave the uninterruptible power supply and connected equipment operating while
removing the batteries. The batteries can be replaced into either battery bay.
CAUTION:
When replacing batteries, there is a certain energy risk hazard. Remove all
jewelry (such as watches, bracelets, and rings) before replacing the batteries.
CAUTION:
The batteries are heavy, approximately 18 kg (40 lbs). Handle them with care.
Procedure
208 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Plastic cover
Data may
be lost
if button
is pushed
xiv10143
Test button Power-off cover
2. Remove the plastic cover from the front of the uninterruptible power supply.
The cover snaps off.
3. Remove the two screws from the battery cover by using a Phillips screwdriver.
Store the screws in a safe place.
Data may
be lost Test
if button
is pushed
xiv10212
Figure 193. Uninterruptible power-supply battery cover
4. Pull the battery cover to the left by using the hand grip to release the latch, and
swing the battery cover out towards the left to expose both batteries.
5. Unplug both battery connectors.
Battery connectors
xiv10211
6. Use the battery hand grip to extract each battery from the battery bay.
CAUTION:
The batteries are heavy, approximately 18 kg (40 lbs). Handle them with care.
Procedure
Procedure
210 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Procedure
Complete the following steps to verify that the hardware components are operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not Full Redundancy, contact your next level of support.
3. If any component is in the Initializing state, wait 10 minutes, and check the
status pod again.
If a component stays in the Initializing state (the component is displayed as
yellow), complete the following steps from the IBM XIV Storage Management
GUI:
a. Right-click the component, and click Phase Out > Failed.
b. Hover the cursor over the component, and verify that Status is Failed.
c. Verify that the system status on the lower-right corner of the window shows
Full Redundancy.
d. Right-click the component, and click Test.
The component goes through a testing procedure. When complete, the
Command executed successfully message is displayed.
e. Hover the cursor over the component, and verify that Status is Ready.
4. If any component is in the Ready state, complete the following steps from the
IBM XIV Storage Management GUI:
a. Right-click the component, and click Phase In.
When you phase in a disk drive module (DDM), data module, or interface
module, the component turns yellow, and the status on the lower right
corner of the window shows Redistributing. Depending on the amount of
data to be redistributed, this process might take some time.
b. Hover the cursor over the component, and verify that Status is OK.
5. If any component is in the Failed state (the component is displayed as red),
complete the following steps from the IBM XIV Storage Management GUI:
a. From the All Systems view, right-click the XIV system, and click View
Events. The Events window is displayed.
b. View the event log to determine the cause of the failure.
c. If the reason cannot be determined, disconnect and then reconnect the
power cable to the failed component, and then right-click the component,
and click Test.
d. If the component is still failed, contact your .
6. Click View > Monitor > Events, and verify that there are no events with
severities other than informational.
If there are other events, contact your .
Procedure
1. Package the defective component using the packaging from the replacement
component.
Verify that all module power-supply units (PSUs) are connected and providing
power. Ensure that the LEDs on each PSU are solid green, indicating that the PSU
is supplying power to the module.
Attention:
CAUTION:
On the automatic transfer switch (ATS), turn off the circuit breaker for the
uninterruptible power supply being removed to ensure that exposed electrical
sockets are not receiving current.
Procedure
Complete the following steps to power off the uninterruptible power supply:
1. From the rear of the rack, turn the three circuit breakers on the uninterruptible
power supply to the off (down) position.
212 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Circuit breakers
and guard
xiv10152
Online/bypass
switch
2. On the automatic transfer switch (ATS), turn the appropriate circuit breaker for
the uninterruptible power supply being removed to the off (down) position.
Maintenance module
power cord
Maintenance module
circuit breaker
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10149
Figure 196. Power sockets and circuit breakers on the side of the ATS
xiv10144
(S1)
Online/bypass switch
Procedure
214 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Procedure
Plastic cover
Data may
be lost
if button
is pushed
xiv10143
Test button Power-off cover
Procedure
Complete the following steps to verify that the hardware components are operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not Full Redundancy, contact your next level of support.
3. If any component is in the Initializing state, wait 10 minutes, and check the
status pod again.
If a component stays in the Initializing state (the component is displayed as
yellow), complete the following steps from the IBM XIV Storage Management
GUI:
a. Right-click the component, and click Phase Out > Failed.
b. Hover the cursor over the component, and verify that Status is Failed.
Procedure
1. Package the defective component using the packaging from the replacement
component.
2. Send the defective component package to the appropriate facility according to
the process for your respective country or geography.
CAUTION:
Take care when replacing the ATS. Considerable voltage is powering the ATS.
Ensure that all grounding precautions are taken before proceeding with the
replacement procedure.
216 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Note: If the ATS is defective, the entire unit must be packed and sent to the
approved repair facility.
CAUTION:
Take care when you replace the ATS. Considerable voltage is powering in and
out of the ATS. Ensure that all grounding precautions are taken before you
proceed to the replacement procedure.
To replace the ATS while the XIV system is powered on, see “Replacing the
automatic transfer switch (concurrent)” on page 226.
Procedure
Maintenance module
power cord
Maintenance module
circuit breaker
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10149
Figure 199. Power sockets and circuit breakers on the side of the ATS
3. Press the maintenance module circuit breaker to the off (down) position.
Procedure
218 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
J2 line cord
J1 line cord
xiv10209
Power cord
retainer
CAUTION:
Maintenance
module Maintenance module
power cord F4
circuit breaker
F4
Power output
LED
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10051
ac-sensor cable ac-sensor cable
LS port (X807) COMM port (X801)
Procedure
Note: Do not remove the grounding wire from the ATS. The yellow-and-green
grounding wire comes already attached to the ATS by using a lock washer, disk
with grounding wires, flat washer, and screw.
220 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
2. Remove the retaining screw that secures the ATS to the support bracket at the
upper left side by using a Phillips screwdriver.
Store the screw in a secure place. It is reused when installing the replacement
ATS.
3. Lift the ATS, and then slide the ATS out of the rack.
The ATS is secured to the rack by several downward facing flanges that fit into
upward facing flanges in the bracket located behind the ATS.
Procedure
Procedure
Maintenance
module Maintenance module
power cord F4
circuit breaker
F4
Power output
LED
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10051
ac-sensor cable ac-sensor cable
LS port (X807) COMM port (X801)
2. Rotate the power-cable retainer to secure the power-cable plug to the ATS.
3. Connect the maintenance module cable to the power socket P4 on the ATS.
4. Connect the ac-sensor cable that is labeled ATSX801-M1USB1 to port X801 (blue
connector) on the ATS.
5. Connect the ac-sensor cable that is labeled ATSX807-U3OUTPUT to port X807
(green connector) on the ATS, and tighten the two retaining screws by using a
small flat screwdriver.
6. Connect both main-power cables to the top of the ATS, adjusting the plug to
match the pin arrangement on the ATS input sockets.
J2 line cord
J1 line cord
xiv10209
Power cord
retainer
222 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
a. Plug the J1 main-power cable into the ATS J1 receptacle, and lock by
turning the securing ring in a clockwise direction.
b. Plug the J2 main-power cable into the ATS J2 receptacle, and lock by
turning the securing ring in a clockwise direction.
Procedure
Maintenance
module Maintenance module
power cord F4
circuit breaker
F4
Power output
LED
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10051
Important: All three buttons must be pressed within 10 seconds of each other.
xiv10142
Power-off button
Power-on (Test) button
Figure 205. Front view of the uninterruptible power supply with the power-off cover removed
Pressing the Test buttons powers on all components that are connected to each
uninterruptible power supply.
Procedure
224 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
g. Verify that the J1 LINE 1 LED is lit on the ATS to ensure that power is
supplied by main-power cable J1.
h. Turn off the customer circuit breaker for main-power cable J2.
i. Verify that the J1 LINE 1 LED on the ATS is lit to ensure that power is
supplied by main-power cable J1.
j. From the IBM XIV Storage Management GUI, hover the cursor over each
uninterruptible power supply, and verify that Charge Level is 100%, Input
Power is yes, and Status is OK.
k. Turn on the customer circuit breaker for main-power cable J2.
l. Verify that the J2 LINE 2 LED on the ATS is lit to ensure that power is
supplied by J2.
Procedure
Complete the following steps to verify that the hardware components are operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not Full Redundancy, contact your next level of support.
3. If any component is in the Initializing state, wait 10 minutes, and check the
status pod again.
If a component stays in the Initializing state (the component is displayed as
yellow), complete the following steps from the IBM XIV Storage Management
GUI:
a. Right-click the component, and click Phase Out > Failed.
b. Hover the cursor over the component, and verify that Status is Failed.
c. Verify that the system status on the lower-right corner of the window shows
Full Redundancy.
d. Right-click the component, and click Test.
The component goes through a testing procedure. When complete, the
Command executed successfully message is displayed.
e. Hover the cursor over the component, and verify that Status is Ready.
4. If any component is in the Ready state, complete the following steps from the
IBM XIV Storage Management GUI:
a. Right-click the component, and click Phase In.
When you phase in a disk drive module (DDM), data module, or interface
module, the component turns yellow, and the status on the lower right
corner of the window shows Redistributing. Depending on the amount of
data to be redistributed, this process might take some time.
b. Hover the cursor over the component, and verify that Status is OK.
5. If any component is in the Failed state (the component is displayed as red),
complete the following steps from the IBM XIV Storage Management GUI:
a. From the All Systems view, right-click the XIV system, and click View
Events. The Events window is displayed.
Procedure
Procedure
1. Package the defective component using the packaging from the replacement
component.
2. Send the defective component package to the appropriate facility according to
the process for your respective country or geography.
Important: Read and understand this procedure before you start the replacement.
A mistake in this procedure might result in data loss.
Read and understand the safety instructions, especially those dealing with danger
notices (see “Safety and environmental notices” on page xiii).
Ensure that you have the ATS concurrent cabling kit (part number 45W5009) and
grounding fastener hardware kit (part number 98Y1926). ATS concurrent cabling
kit provides temporary extension power cords to externally connect the new ATS
to the XIV system. The grounding fastener hardware kit includes screws and
226 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
external tooth washers for attaching the grounding cable from the ATS to the XIV
system rack.
Replacement time: Approximately 4 hours, but might vary depending on the time
that is needed to recharge the uninterruptible power supply batteries.
Important: For XIV system code V11.1.0 and later, each uninterruptible power
supply is calibrated after the component test is completed. This calibration might
significantly increase the time of the replacement procedure.
To replace the ATS while the XIV system is powered off, see “Replacing the
automatic transfer switch (non-concurrent)” on page 217.
During concurrent ATS replacement, the new ATS is initially connected external to
the XIV system rack. After the new ATS is fully operational, the old ATS is
removed from the rack, and the new ATS is moved into the XIV system rack.
Replace the ATS concurrently only with consultation of your next level of support.
CAUTION:
Take care when you replace the ATS. Considerable voltage is powering in and
out of the ATS. Ensure that all grounding precautions are taken before you
proceed with the replacement procedure.
SELECTED Input
SOURCE OK
J2 LINE 2
FAULT
J1 LINE 1
v If both LEDs are lit green, power is present at both inputs to the ATS.
v If only one LED is lit green, verify that power is coming from the customer
building distribution panel. If building power is present, the power input
path to the ATS that is associated with the unlit LED is defective. When you
transfer the inactive power cable to the new ATS in Stage C of this
replacement procedure, ensure that you transfer the defective, inactive
power cable that is associated with the unlit LED the first.
3. Connect the technician notebook computer to the technician port in the patch
panel.
4. From the IBM XIV Storage Management GUI, click the user ID in the
upper-right corner, and log in using the xiv_maintenance user ID and
password.
If you do not know the password, contact your next level of support.
5. Ensure that the pod on the lower right says Full Redundancy.
6. Hover the cursor over each uninterruptible power supply, and verify that
Charge Level is 100%, Input Power is yes, and Status is OK.
7. From the rear of the rack, verify that all circuit breakers on each
uninterruptible power supply are in the on (up) position.
8. Verify that all module power supply units (PSUs) are connected and
providing power. Ensure that the LEDs on each PSU are solid green,
indicating that the PSU is supplying power to the module.
228 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
9. From the front of the rack, verify that the online LED ( ) on each
uninterruptible power supply is green. A green LED indicate that the
uninterruptible power supply is operating on ac power.
xiv10043
Figure 208. Front panel of the uninterruptible power supply
10. From the rear of the rack, check the power connections to the ATS,
maintenance module, and uninterruptible power supplies.
a. On the ATS, verify that each uninterruptible power-supply connection to
the ATS is firmly secured in place. Twist the connectors P3, P2, and P1
clockwise to verify that they are firmly seated.
b. On the maintenance module, verify that the maintenance-module power
cable is firmly seated. Firmly press each plug into its socket.
c. On the uninterruptible power supplies, verify that all power output
connections to the modules are firmly seated in their sockets. Firmly press
each plug into its socket.
d. On the uninterruptible power supplies, verify that all power input
connections are firmly seated. Twist the connectors clockwise to verify that
they are firmly seated.
11. Disable the automatic Uninterruptible power supply calibration. To complete
this task, XIV development user credentials are required.
To run this command, log in to the XCLI, using the xiv_development user ID
and password. If you do not know the password, contact your next level of
support.
conf_set path=cluster_hw_config.ups_automatic_calibration_disable value=yes
What to do next
If the XIV system has two main-power cables, continue with “Installing the
automatic transfer switch for a two-main-power-cable configuration” on page 230.
If the XIV system has four main-power cables, continue with “Installing the
automatic transfer switch for a four-main-power-cable configuration” on page 247.
To replace the ATS in an XIV system with four main-power cables, see “Installing
the automatic transfer switch for a four-main-power-cable configuration” on page
247.
Important: This procedure is broken down into a number of logical stages. Follow
the procedure exactly as presented, stage by stage. Failure to do so might lead to
injury, loss of access, or loss of data.
To shut down the XIV system, you must be logged in to the IBM XIV Storage
Management GUI as user ID xiv_maintenance. To change the user ID, click the
user ID in the upper-right corner. If you do not know the password, contact your
next level of support.
Note: In this procedure, ATS-OLD refers to the ATS that is being replaced, and
ATS-NEW refers to the replacement ATS that is being installed.
CAUTION:
Take care when replacing the ATS. Considerable voltage is powering the ATS.
Ensure that all grounding precautions are taken before proceeding with the
replacement procedure.
Procedure
230 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Stage A
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible ATS
new power supply 2 old
J2
inactive
Uninterruptible
xiv10344
power supply 1
In this stage, ATS-NEW is placed near the rear of the rack, and the ground wire
is connected to the rack frame.
1. Place the ATS-NEW near the rear of the XIV system.
2. Switch off circuit breakers F1, F2, F3, and F4 on ATS-NEW.
3. Insert the bolt in the ATS-NEW grounding wire, and fasten the bolt to the
rack by using an 8-mm socket wrench. Use the hole that is next to the
grounding-wire attachment point for ATS-OLD.
Stage B
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible ATS
new power supply 2 old
J2
Uninterruptible
xiv10345
power supply 1
Attention: After you turn off the customer circuit breaker, you must be able to
quickly verify that the XIV system is not running on battery power. If the XIV
system is running on battery, you must be able to turn the customer circuit
breaker back on within 30 seconds.
Complete the following steps to transfer the inactive main-power cable to
ATS-NEW:
1. Determine which input line (J1 or J2) is active from the IBM XIV Storage
Management GUI by hovering the cursor over uninterruptible power-supply
3. The ATS parameter identifies the active input line as either J1 or J2.
232 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Attention: If the XIV system is running on battery power, immediately
turn on the customer circuit breaker to the J2 main-power cable within 30
seconds. Confirm that the XIV system resumed normal operation and that
the uninterruptible power supplies are receiving primary power and not
battery power.
– If the XIV system is still running on battery power:
1) Immediately run the shutdown command, from the GUI or XCLI,
to power off the XIV system.
2) Stop all operations.
3) Consult your next level of support.
– If the XIV system is now running on ac power, determine why the J2
main-power cable was not supplying ac power to the XIV system.
Before you continue, correct the condition.
d. If the XIV system is running on ac power from the J1 main-power cable,
unplug the J2 main-power cable from ATS-OLD.
e. Plug the J2 main-power cable in to ATS-NEW, and turn the locking ring
clockwise to secure the connector.
f. Turn on the customer circuit breaker for the J2 main-power cable.
g. Confirm that power is provided to ATS-NEW by verifying that the J2
LED on ATS-NEW is lit.
h. Continue with stage C.
v Stage C. Connect uninterruptible power supply 3 to ATS-NEW.
In this stage, uninterruptible power supply 3 power cable is disconnected from
ATS-OLD and connected to ATS-NEW by using an extension cord. Then,
uninterruptible power supply 3 receives input power from ATS-NEW.
Stage C
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible ATS
new power supply 2 old
J2
Uninterruptible
power supply 1
xiv10346
Note: The power might fail for some module power supply units (PSUs) or
switches when the uninterruptible power supply is phased out.
Power-cord
retaining bracket
xiv10150
6. Plug the uninterruptible power supply 3 power cable in to one of the ATS
extension cords that are supplied with the ATS concurrent replacement kit,
and turn the connector clockwise to secure.
This cord is called ATS extension cord 3. Ensure that the uninterruptible
power supply power cable is firmly connected.
234 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Note: As an extra safeguard, secure the extension cord to the ATS by using
adhesive tape.
Power-cord
retaining bracket
xiv10151
Figure 213. Power-cable retainer that is clipped
Stage D
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible ATS
new power supply 2 old
J2
Uninterruptible
power supply 1
xiv10347
Note: The power might fail for some module power supply units (PSUs) or
switches when the uninterruptible power supply is phased out.
3. Wait until uninterruptible power supply 2 changes to the Failed state. From
the IBM XIV Storage Management GUI, verify that uninterruptible power
supply 2 turns orange and then turns red a few minutes later. Hover the
cursor over uninterruptible power supply 2, and verify that Status is Failed.
The uninterruptible power supply might power off as a result of the
phase-out process.
Attention: To avoid an emergency shutdown of the XIV system, you must
wait for uninterruptible power supply 2 to complete the phase-out process
before proceeding.
Attention: If the phase-out process fails:
– Hover the cursor over the remaining uninterruptible power supplies, and
verify that Charge Level is 100%. If the charge level is not 100%, wait a
few minutes and attempt to phase out the uninterruptible power supply
again.
– If any modules have PSUs that are in the Failed state (that are red in the
IBM XIV Storage Management GUI), click the module to show the
expanded view, right-click the failed PSU, and click Test. When all
module PSUs are corrected, attempt to phase out the uninterruptible
power supply again.
4. Turn off the circuit breaker F2 (for uninterruptible power supply 2) on
ATS-OLD.
5. Unclip the power-cable retainer, and unplug uninterruptible power supply 2
power cable from ATS-OLD
6. Plug the uninterruptible power supply 2 power cable in to one of the ATS
extension cords that are supplied with the ATS concurrent replacement kit,
and turn the connector clockwise to secure.
This cord is called ATS extension cord 2. Ensure that the uninterruptible
power supply power cable is firmly connected.
Note: As an extra safeguard, secure the extension cord to the ATS by using
adhesive tape.
9. On ATS-NEW, turn on circuit breaker F2 (for uninterruptible power supply
2).
10. From the IBM XIV Storage Management GUI, right-click uninterruptible
power supply 2, and click Test.
11. Wait until uninterruptible power supply 2 changes to the OK state and the
batteries become fully charged.
236 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
12. From the IBM XIV Storage Management GUI, verify uninterruptible power
supply 2 turns yellow and then turns black a few minutes later. Hover the
cursor over uninterruptible power supply 2, and verify Charge Level is
100%, Input Power is yes, and Status is OK.
13. Verify that all module PSUs are functioning correctly. From the IBM XIV
Storage Management GUI, verify that the modules are black and do not
have an error icon.
If any modules have PSUs that are in the Failed state (that are red in the
IBM XIV Storage Management GUI), click the module to show the
expanded view, right-click the failed PSU, and click Test.
v Stage E. Connect uninterruptible power supply 1 to ATS-NEW.
In this stage, uninterruptible power supply 1 power cable is disconnected from
ATS-OLD and connected to ATS-NEW by using an extension cord. Then,
uninterruptible power supply 1 receives input power from ATS-NEW.
Stage E
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible ATS
new power supply 2 old
J2
Uninterruptible
power supply 1
xiv10348
ATS extension cord 1
Note: The power might fail for some module power supply units (PSUs) or
switches when the uninterruptible power supply is phased out.
3. Wait until uninterruptible power supply 1 changes to the Failed state. From
the IBM XIV Storage Management GUI, verify that uninterruptible power
supply 1 turns orange and then turns red a few minutes later. Hover the
cursor over uninterruptible power supply 1, and verify that Status is Failed.
The uninterruptible power supply might power off as a result of the
phase-out process.
Attention: To avoid an emergency shutdown of the XIV system, you must
wait for uninterruptible power supply 1 to complete the phase-out process
before proceeding.
Note: As an extra safeguard, secure the extension cord to the ATS by using
adhesive tape.
9. On ATS-NEW, turn on circuit breaker F1 (for uninterruptible power supply
1).
10. From the IBM XIV Storage Management GUI, right-click uninterruptible
power supply 1, and click Test.
11. Wait until uninterruptible power supply 1 changes to the OK state and the
batteries become fully charged.
12. From the IBM XIV Storage Management GUI, verify uninterruptible power
supply 1 turns yellow and then turns black a few minutes later. Hover the
cursor over uninterruptible power supply 1, and verify Charge Level is
100%, Input Power is yes, and Status is OK.
13. Verify that all module PSUs are functioning correctly. From the IBM XIV
Storage Management GUI, verify that the modules are black and do not
have an error icon.
If any modules have PSUs in the Failed state (that are red in the IBM XIV
Storage Management GUI), click the module to show the expanded view,
right-click the failed PSU, and click Test.
v Stage F. Transfer the remaining main-power cable to ATS-NEW.
In this stage, the remaining main-power cable is transferred to ATS-NEW.
238 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Stage F
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible ATS
new power supply 2 old
J2
Uninterruptible
power supply 1
xiv10349
Figure 216. ATS installation stage F
1. Turn off the customer circuit breaker to the remaining main-power cable (J1
or J2) connected to ATS-OLD.
2. Verify that power to ATS-OLD is off by verifying that the J1 and J2 LEDs on
ATS-OLD are not lit.
SELECTED Input
SOURCE OK
J2 LINE 2
FAULT
J1 LINE 1
Uninterruptible
power supply 3
J1
ATS Uninterruptible ATS
new power supply 2 old
J2
Uninterruptible
power supply 1
xiv10350
Figure 219. ATS installation stage G
Maintenance
module Maintenance module
power cord F4
circuit breaker
F4
Power output
LED
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10051
240 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
v Stage H. Remove ATS-OLD from the rack.
In this stage, ATS-OLD is removed from the rack.
Stage H
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible
new power supply 2
J2
Uninterruptible
xiv10351
power supply 1
1. Remove the bolt that connects the ATS-OLD grounding wire to the rack by
using an 8-mm socket wrench.
Note: Do not remove the grounding wire from the ATS-OLD. The
yellow-and-green grounding wire comes already attached to the ATS-NEW
by using a lock washer, disk with grounding wires, flat washer, and screw.
2. Remove the retaining screw that secures the ATS to the support bracket at
the upper left side by using a Phillips screwdriver.
3. Lift the ATS-OLD, and then move it out of the rack.
The ATS is secured to the rack by several downward facing flanges that fit
into upward facing flanges in the bracket that is located behind the ATS.
v Stage I. Install ATS-NEW in the rack.
In this stage, ATS-NEW is placed in the rack.
Stage I
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible
new power supply 2
J2
Uninterruptible
xiv10352
power supply 1
Important: Take care when you move ATS-NEW so that the power cables
between each of the three uninterruptible power supplies and ATS-NEW are
not disconnected. As a safeguard, ensure that the connectors are secured with
a piece of adhesive tape before you move the ATS.
Stage J
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible
new power supply 2
J2
Uninterruptible
xiv10353
power supply 1
Note: The power might fail for some module power supply units (PSUs)
or switches when the uninterruptible power supply is phased out.
c. Wait until uninterruptible power supply 3 changes to the Failed state.
From the IBM XIV Storage Management GUI, verify that uninterruptible
power supply 3 turns orange and then turns red a few minutes later.
Hover the cursor over uninterruptible power supply 3, and verify that
Status is Failed.
The uninterruptible power supply might power off as a result of the
phase-out process.
Attention: To avoid an emergency shutdown of the XIV system, you
must wait for uninterruptible power supply 3 to complete the phase-out
process before proceeding.
242 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Attention: If the phase-out process fails:
– Hover the cursor over the remaining uninterruptible power supplies,
and verify that Charge Level is 100%. If the charge level is not 100%,
wait a few minutes and attempt to phase out the uninterruptible
power supply again.
– If any modules have PSUs in the Failed state (that are red in the IBM
XIV Storage Management GUI), click the module to show the
expanded view, right-click the failed PSU, and click Test. When all
module PSUs are corrected, attempt to phase out the uninterruptible
power supply again.
d. Turn off circuit breaker F3 (for uninterruptible power supply 3) on
ATS-NEW.
e. Unplug the uninterruptible power supply 3 power cables from extension
cord 3, and unplug ATS extension cord 3 from ATS-NEW connector P3.
f. Plug the uninterruptible power supply 3 power cables into ATS-NEW
connector P3, and turn the locking ring clockwise to secure the connector.
g. Clip the power-cable retainer over the uninterruptible power-supply
pigtail to secure the power cable to the ATS.
h. Turn on the circuit breaker F3 (for uninterruptible power supply 3) on
ATS-NEW.
i. From the IBM XIV Storage Management GUI, right-click uninterruptible
power supply 3, and click Test.
j. Wait until uninterruptible power supply 3 changes to the OK state and the
batteries become fully charged. From the IBM XIV Storage Management
GUI, verify uninterruptible power supply 3 turns yellow and then turns
black a few minutes later. Hover the cursor over uninterruptible power
supply 3, and verify Charge Level is 100%, Input Power is yes, and
Status is OK
k. Verify that all module power supply units (PSUs) are functioning
correctly. From the IBM XIV Storage Management GUI, verify that the
modules are black and do not have an error icon.
If any modules have PSUs in the Failed state, click the module to display
the expanded view, right-click the failed PSU, and click Test.
2. Remove the temporary extension cord to uninterruptible power supply 2.
a. Verify that all uninterruptible power supplies are connected to ac power.
From the IBM XIV Storage Management GUI, hover the cursor over each
uninterruptible power supply, and verify that Charge Level is 100%,
Input Power is yes, and Status is OK.
b. Right-click uninterruptible power supply 2, and click Phase out > Failed.
Note: The power might fail for some module power supply units (PSUs)
or switches when the uninterruptible power supply is phased out.
c. Wait until uninterruptible power supply 2 changes to the Failed state.
From the IBM XIV Storage Management GUI, verify that uninterruptible
power supply 2 turns orange and then turns red a few minutes later.
Hover the cursor over uninterruptible power supply 2, and verify that
Status is Failed.
The uninterruptible power supply might power off as a result of the
phase-out process.
Attention: To avoid an emergency shutdown of the XIV system, you
must wait for uninterruptible power supply 2 to complete the phase-out
process before proceeding.
Note: The power might fail for some module power supply units (PSUs)
or switches when the uninterruptible power supply is phased out.
c. Wait until uninterruptible power supply 1 changes to the Failed state.
From the IBM XIV Storage Management GUI, verify that uninterruptible
power supply 1 turns orange and then turns red a few minutes later.
Hover the cursor over uninterruptible power supply 1, and verify that
Status is Failed.
The uninterruptible power supply might power off as a result of the
phase-out process.
244 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Attention: To avoid an emergency shutdown of the XIV system, you
must wait for uninterruptible power supply 1 to complete the phase-out
process before proceeding.
Attention: If the phase-out process fails:
– Hover the cursor over the remaining uninterruptible power supplies,
and verify that Charge Level is 100%. If the charge level is not 100%,
wait a few minutes and attempt to phase out the uninterruptible
power supply again.
– If any modules have PSUs in the Failed state (that are red in the IBM
XIV Storage Management GUI), click the module to display the
expanded view, right-click the failed PSU, and click Test. When all
module PSUs are corrected, attempt to phase out the uninterruptible
power supply again.
d. Turn off circuit breaker F1 (for uninterruptible power supply 1) on
ATS-NEW.
e. Unplug the uninterruptible power supply 1 power cable from ATS
extension cord 1, and unplug extension cord 1 from ATS-NEW connector
P1.
f. Plug the uninterruptible power supply 1 power cable into ATS-NEW
connector P1, and turn the locking ring clockwise to secure the connector.
g. If present, clip the power-cable retainer over the uninterruptible
power-supply pigtail to secure the power cable to the ATS.
h. Turn on the circuit breaker F1 (for uninterruptible power supply 1) on
ATS-NEW.
i. From the IBM XIV Storage Management GUI, right-click uninterruptible
power supply 1, and click Test.
j. Wait until uninterruptible power supply 1 changes to the OK state and the
batteries become fully charged. From the IBM XIV Storage Management
GUI, verify uninterruptible power supply 1 turns yellow and then turns
black a few minutes later. Hover the cursor over uninterruptible power
supply 1, and verify Charge Level is 100%, Input Power is yes, and
Status is OK
k. Verify that all module power supply units (PSUs) are functioning
correctly. From the IBM XIV Storage Management GUI, verify that the
modules are black and do not have an error icon.
If any modules have PSUs in the Failed state, click the module to display
the expanded view, right-click the failed PSU, and click Test.
v Stage K. Reconnect the remaining cables.
In this stage, the remaining cables, including the maintenance module power
cable, serial-to-USB cable, and ac-sensor cable, are connected to ATS-NEW.
Uninterruptible
power supply 3
J1
ATS Uninterruptible
new power supply 2
J2
Uninterruptible
xiv10354
power supply 1
Maintenance
module Maintenance module
power cord F4
circuit breaker
F4
Power output
LED
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10051
246 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 226. Front view of the maintenance module information and connection panel
To replace the ATS in an XIV system with two main-power cables, see “Installing
the automatic transfer switch for a two-main-power-cable configuration” on page
230.
Important: This procedure is broken down into a number of logical stages. Follow
the procedure exactly as presented, stage by stage. Failure to do so might lead to
injury, loss of access, or loss of data.
To shut down the XIV system, you must be logged in to the IBM XIV Storage
Management GUI by using user ID xiv_maintenance. To change the user ID, click
the user ID in the upper-right corner. If you do not know the password, contact
your next level of support.
Note: In this procedure, ATS-OLD refers to the ATS that is being replaced, and
ATS-NEW refers to the replacement ATS that is being installed.
CAUTION:
Take care when replacing the ATS. Considerable voltage is powering the ATS.
Ensure that all grounding precautions are taken before proceeding with the
replacement procedure.
Stage A
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible ATS
new power supply 2 old
J2
inactive
Uninterruptible
xiv10356
power supply 1
In this stage, ATS-NEW is placed near the rear of the rack, and the ground wire
is connected to the rack frame.
1. Place the ATS-NEW near the rear of the XIV system.
2. Switch off circuit breakers F1, F2, F3, and F4 on ATS-NEW.
3. Insert the bolt in the ATS-NEW grounding wire, and fasten the bolt to the
rack by using an 8-mm socket wrench. Use the hole that is next to the
grounding-wire attachment point for ATS-OLD.
Stage B
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible ATS
new power supply 2 old
J2
Uninterruptible
xiv10357
power supply 1
248 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Attention: After you turn off the customer circuit breaker, you must be able to
quickly verify that the XIV system is not running on battery power. If the XIV
system is running on battery, you must be able to turn the customer circuit
breaker back on within 30 seconds.
Complete the following steps to transfer the inactive main-power cable to
ATS-NEW:
1. Determine which input line (J1 or J2) is active from the IBM XIV Storage
Management GUI by hovering the cursor over uninterruptible power-supply
3. The ATS parameter identifies the active input line as either J1 or J2.
2. If input line 2 (J2) is active, and input line 1 (J1) is inactive, complete the
following steps; otherwise, go to step 3.
a. Turn off the customer circuit breaker to the J1 main-power cable.
b. Verify that power to the J1 main-power cable is off by checking that the
J1 LED on ATS-OLD is not lit.
c. From the front of the rack, verify that all uninterruptible power supplies
Stage C
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible ATS
new power supply 2 old
J2
Uninterruptible
power supply 1
xiv10358
Note: The power might fail for some module power supply units (PSUs) or
switches when the uninterruptible power supply is phased out.
250 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
3. Wait until uninterruptible power supply 2 changes to the Failed state. From
the IBM XIV Storage Management GUI, verify that uninterruptible power
supply 2 turns orange and then turns red a few minutes later. Hover the
cursor over uninterruptible power supply 2, and verify that Status is Failed.
The uninterruptible power supply might power off as a result of the
phase-out process.
Attention: To avoid an emergency shutdown of the XIV system, you must
wait for uninterruptible power supply 2 to complete the phase-out process
before proceeding.
Attention: If the phase-out process fails:
– Hover the cursor over the remaining uninterruptible power supplies, and
verify that Charge Level is 100%. If the charge level is not 100%, wait a
few minutes and attempt to phase out the uninterruptible power supply
again.
– If any modules have PSUs that are in the Failed state (that are red in the
IBM XIV Storage Management GUI), click the module to show the
expanded view, right-click the failed PSU, and click Test. When all
module PSUs are corrected, attempt to phase out the uninterruptible
power supply again.
4. Turn off the circuit breaker F2 (for uninterruptible power supply 2) on
ATS-OLD.
5. Unclip the power-cable retainer, and unplug uninterruptible power supply 2
power cable from ATS-OLD
6. Connect the uninterruptible power supply 2 power cable to one of the ATS
extension cords that are supplied with the ATS concurrent replacement kit.
Turn the connector clockwise to secure.
This cord is called ATS extension cord 2. Ensure that the uninterruptible
power supply power cable is firmly connected.
Stage D
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible ATS
new power supply 2 old
J2
Uninterruptible
power supply 1
xiv10359
Figure 230. ATS installation stage D
1. Turn off the customer circuit breaker to the remaining main-power cable (J1
or J2) connected to ATS-OLD.
2. Verify that power to ATS-OLD is off by verifying that the J1 and J2 LEDs on
ATS-OLD are not lit.
SELECTED Input
SOURCE OK
J2 LINE 2
FAULT
J1 LINE 1
252 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Stage E
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible ATS
new power supply 2 old
J2
Uninterruptible
power supply 1
xiv10360
Figure 233. ATS installation stage E
Maintenance
module Maintenance module
power cord F4
circuit breaker
F4
Power output
LED
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10051
Stage F
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible
new power supply 2
J2
Uninterruptible
xiv10355
power supply 1
1. Remove the bolt that connects the ATS-OLD grounding wire to the rack by
using an 8-mm socket wrench.
Note: Do not remove the grounding wire from the ATS-OLD. The
yellow-and-green grounding wire comes already attached to the ATS-NEW
by using a lock washer, disk with grounding wires, flat washer, and screw.
2. Remove the retaining screw that secures the ATS to the support bracket at
the upper left side by using a Phillips screwdriver.
3. Lift the ATS-OLD, and then move it out of the rack.
The ATS is secured to the rack by several downward facing flanges that fit
into upward facing flanges in the bracket that is located behind the ATS.
v Stage G. Install ATS-NEW in the rack.
In this stage, ATS-NEW is placed in the rack.
Stage G
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible
new power supply 2
J2
Uninterruptible
xiv10361
power supply 1
Important: Take care when you move ATS-NEW so that the power cables
between each of the three uninterruptible power supplies and ATS-NEW are
not disconnected. As a safeguard, ensure that the connectors are secured with
a piece of adhesive tape before you move the ATS.
254 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
2. Position ATS-NEW to the rightmost side of the rack so that the screw hole in
the support bracket aligns with the hole on the upper left side of the ATS.
3. Fasten the retaining screw to the support bracket at the upper left side by
using a Phillips screwdriver.
v Stage H. Remove temporary extension cords to the uninterruptible power
supplies.
In this stage, the extension cords are removed in a specific sequence, starting
with uninterruptible power supply 3. The sequence must be strictly followed.
Stage H
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible
new power supply 2
J2
Uninterruptible
xiv10362
power supply 1
Note: The power might fail for some module power supply units (PSUs) or
switches when the uninterruptible power supply is phased out.
3. Wait until uninterruptible power supply 2 changes to the Failed state. From
the IBM XIV Storage Management GUI, verify that uninterruptible power
supply 2 turns orange and then turns red a few minutes later. Hover the
cursor over uninterruptible power supply 2, and verify that Status is Failed.
The uninterruptible power supply might power off as a result of the
phase-out process.
Attention: To avoid an emergency shutdown of the XIV system, you must
wait for uninterruptible power supply 2 to complete the phase-out process
before proceeding.
Attention: If the phase-out process fails:
– Hover the cursor over the remaining uninterruptible power supplies, and
verify that Charge Level is 100%. If the charge level is not 100%, wait a
few minutes and attempt to phase out the uninterruptible power supply
again.
– If any modules have PSUs in the Failed state (that are red in the IBM
XIV Storage Management GUI), click the module to display the
expanded view, right-click the failed PSU, and click Test. When all
module PSUs are corrected, attempt to phase out the uninterruptible
power supply again.
4. Turn off circuit breaker F2 (for uninterruptible power supply 2) power cable
on ATS-NEW.
Stage I
Maint. mod
Uninterruptible
power supply 3
J1
ATS Uninterruptible
new power supply 2
J2
Uninterruptible
xiv10363
power supply 1
256 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
J2 line cord J1 line cord
Maintenance
module Maintenance module
power cord F4
circuit breaker
F4
Power output
LED
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10051
ac-sensor cable ac-sensor cable
LS port (X807) COMM port (X801)
Figure 240. Front view of the maintenance module information and connection panel
258 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Procedure
Complete the following steps to verify that the hardware components are operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not Full Redundancy, contact your next level of support.
3. If any component is in the Initializing state, wait 10 minutes, and check the
status pod again.
If a component stays in the Initializing state (the component is displayed as
yellow), complete the following steps from the IBM XIV Storage Management
GUI:
a. Right-click the component, and click Phase Out > Failed.
b. Hover the cursor over the component, and verify that Status is Failed.
c. Verify that the system status on the lower-right corner of the window shows
Full Redundancy.
d. Right-click the component, and click Test.
The component goes through a testing procedure. When complete, the
Command executed successfully message is displayed.
e. Hover the cursor over the component, and verify that Status is Ready.
4. If any component is in the Ready state, complete the following steps from the
IBM XIV Storage Management GUI:
a. Right-click the component, and click Phase In.
When you phase in a disk drive module (DDM), data module, or interface
module, the component turns yellow, and the status on the lower right
corner of the window shows Redistributing. Depending on the amount of
data to be redistributed, this process might take some time.
b. Hover the cursor over the component, and verify that Status is OK.
5. If any component is in the Failed state (the component is displayed as red),
complete the following steps from the IBM XIV Storage Management GUI:
a. From the All Systems view, right-click the XIV system, and click View
Events. The Events window is displayed.
b. View the event log to determine the cause of the failure.
c. If the reason cannot be determined, disconnect and then reconnect the
power cable to the failed component, and then right-click the component,
and click Test.
d. If the component is still failed, contact your .
6. Click View > Monitor > Events, and verify that there are no events with
severities other than informational.
If there are other events, contact your .
7. Enable the automatic Uninterruptible power supply calibration by running the
following command:
conf_set path=cluster_hw_config.ups_automatic_calibration_disable value=no
Procedure
1. Package the defective component using the packaging from the replacement
component.
2. Send the defective component package to the appropriate facility according to
the process for your respective country or geography.
Replacing an SFP
Use this procedure to replace an 8 Gb Fibre Channel or 10 Gb Ethernet adapter
small form-factor pluggable (SFP) transceiver.
The SFP is designed to be hot-plugged. You do not need to power off the XIV
system.
Ensure that you have an illumination source before attempting to work within the
rack.
CAUTION:
Do not remove the last path from a host. If replacing this SFP concurrently,
verify that the host path through the SFP is not active and that the customer has
an active alternate path to the XIV system.
Procedure
Complete the following steps from the front of the rack to remove and install the
SFP:
1. Carefully determine the failing physical port connection.
2. Remove the Fibre Channel or Ethernet cable by pressing the release tab and
pulling the cable out. Ensure that you exert pressure only on the connector, and
do not pull the cables.
260 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
3. To remove the SFP, locate the release handle that is incorporated into the SFP,
unclip the handle, and then use the handle to pull out the SFP.
Note: If the SFP has a plastic tag instead of a release handle, pull the tag to
remove the SFP.
4. Push the new SFP into the aperture, and ensure it is securely locked with the
release handle flush to the SFP.
Note: To determine the correct SFP adapter, see “Components FRUs” on page
351.
5. Reconnect the Fibre Channel or Ethernet cable.
6. Confirm that the error is now fixed. Check the port status using the front-panel
display. If possible, check the status given by the XIV monitoring tools of the
customer. Either mark the error as fixed or restart the node depending on the
failure indication that you originally noted.
7. Package the defective SFP using the packaging from the replacement SFP.
8. Send the defective SFP package to the appropriate facility according to the
process for your respective country or geography.
Procedure
Complete the following steps to start the guided repair for SFPs:
1. From the Technician Assistant tool, click Launch > Guided repair > Guided
repair for SFP. The Guided repair for SFP window is displayed.
2. Follow the instructions in the guided repair viewer.
The guided-repair utility determines whether any SFPs are in a failed state.
Important: Read and understand this procedure before you start the replacement.
A mistake in this procedure might result in data loss.
Read and understand the safety instructions, especially those dealing with danger
notices (see “Safety and environmental notices” on page xiii).
Replacement time: Approximately 4 hours, but might vary depending on the time
that is needed to recharge the uninterruptible power supply batteries.
Replace the main-power cables concurrently only with consultation of your next
level of support.
CAUTION:
Take care when you replace the main-power cables. Considerable voltage is
powering in and out of the ATS. Ensure that all grounding precautions are taken
before you proceed with the replacement procedure.
Complete the following procedures to replace the main power cables concurrently:
1. “Preparing to replace the main-power cables”
2. “Swapping the main-power cables” on page 264
3. “Verifying the main-power cable replacement” on page 268
4. “Completing the service call” on page 269
Procedure
262 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 241. LEDs on the single-phase ATS
SELECTED Input
SOURCE OK
J2 LINE 2
FAULT
J1 LINE 1
v If both LEDs are lit green, power is present at both inputs to the ATS.
v If only one LED is lit green, verify that power is coming from the customer
building distribution panel. If building power is present, the power input
path to the ATS that is associated with the unlit LED is defective. When you
transfer the inactive power cable to the new ATS in Stage C of this
replacement procedure, ensure that you transfer the defective, inactive
power cable that is associated with the unlit LED the first.
3. Connect the technician notebook computer to the technician port in the patch
panel.
4. From the IBM XIV Storage Management GUI, click the user ID in the
upper-right corner, and log in using the xiv_maintenance user ID and
password.
If you do not know the password, contact your next level of support.
5. Ensure that the pod on the lower right says Full Redundancy.
6. Hover the cursor over each uninterruptible power supply, and verify that
Charge Level is 100%, Input Power is yes, and Status is OK.
7. From the rear of the rack, verify that all circuit breakers on each
uninterruptible power supply are in the on (up) position.
8. Verify that all module power supply units (PSUs) are connected and
providing power. Ensure that the LEDs on each PSU are solid green,
indicating that the PSU is supplying power to the module.
9. From the front of the rack, verify that the online LED ( ) on each
uninterruptible power supply is green. A green LED indicate that the
uninterruptible power supply is operating on ac power.
xiv10043
Figure 243. Front panel of the uninterruptible power supply
10. From the rear of the rack, check the power connections to the ATS,
maintenance module, and uninterruptible power supplies.
a. On the ATS, verify that each uninterruptible power-supply connection to
the ATS is firmly secured in place. Twist the connectors P3, P2, and P1
clockwise to verify that they are firmly seated.
b. On the maintenance module, verify that the maintenance-module power
cable is firmly seated. Firmly press each plug into its socket.
c. On the uninterruptible power supplies, verify that all power output
connections to the modules are firmly seated in their sockets. Firmly press
each plug into its socket.
d. On the uninterruptible power supplies, verify that all power input
connections are firmly seated. Twist the connectors clockwise to verify that
they are firmly seated.
11. Disable the automatic Uninterruptible power supply calibration by running
the following command. (xiv development user credentials required)
To run this command, you must be log in using the xiv_development user ID
and password. If you do not know the password, contact your next level of
support.
conf_set path=cluster_hw_config.ups_automatic_calibration_disable value=yes
264 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Before you begin
To shut down the XIV system, you must be logged in to the IBM XIV Storage
Management GUI as user ID xiv_maintenance. To change the user ID, click the
user ID in the upper-right corner. If you do not know the password, contact your
next level of support.
Attention: After you turn off the customer circuit breaker, you must be able to
quickly verify that the XIV system is not running on battery power. If the XIV
system is running on battery, you must be able to turn the customer circuit breaker
back on within 30 seconds.
CAUTION:
Procedure
Maintenance
module Maintenance module
power cord F4
circuit breaker
F4
Power output
LED
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10051
ac-sensor cable ac-sensor cable
LS port (X807) COMM port (X801)
2. If input line 2 (J2) is active, and input line 1 (J1) is inactive, complete the
following steps; otherwise, go to step 3.
a. Turn off the customer circuit breaker to the J1 main-power cable.
b. Verify that power to the J1 main-power cable is off by checking that the
J1 LED on the ATS is not lit.
SELECTED Input
SOURCE OK
J2 LINE 2
FAULT
J1 LINE 1
c. From the front of the rack, verify that all uninterruptible power supplies
266 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Attention: If the XIV system is running on battery power, immediately
turn on the customer circuit breaker to the J1 main-power cable within 30
seconds. Confirm that the XIV system resumed normal operation and that
the uninterruptible power supplies are receiving primary power and not
battery power.
– If the XIV system is still running on battery power:
1) Immediately run the shutdown command, from the GUI or XCLI,
to power off the XIV system.
2) Stop all operations.
3) Consult your next level of support.
– If the XIV system is now running on ac power, determine why the J2
main-power cable was not supplying ac power to the XIV system.
Before you continue, correct the condition.
d. If the XIV system is running on ac power from the J2 main-power cable,
unplug the old J1 main-power cable from ATS
e. Plug the new J1 main-power cable in to ATS, and turn the locking ring
clockwise to secure the connector.
f. Turn on the customer circuit breaker for the J1 main-power cable.
g. Confirm that power is provided to ATS by verifying that the J1 LED on
ATS-NEW is lit.
h. Continue with stage B.
3. If input line 1 (J1) is active, and input line 2 (J2) is inactive, complete the
following steps:
a. Turn off the customer circuit breaker to the J2 main-power cable.
b. Verify that power to the J2 main-power cable is off by checking that the
J2 Line 2 LED on the ATS is not lit.
c. From the front of the rack, verify that all uninterruptible power supplies
SELECTED Input
SOURCE OK
J2 LINE 2
FAULT
J1 LINE 1
Procedure
268 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
4. Optional: Test power switching between the J1 and J2 main-power cables on
the new ATS.
a. From the rear of the rack, verify that the J1 LINE 1 and J2 LINE 2 LEDs are
lit to ensure that both main-power cables are supplying input power.
b. From the IBM XIV Storage Management GUI, hover the cursor over each
uninterruptible power supply, and verify that Charge Level is 100%, Input
Power is yes, and Status is OK.
c. Turn off the customer circuit breaker for main-power cable J1.
d. Verify that the J2 LINE 2 LED is lit on the ATS to ensure that power is
supplied by main-power cable J2.
e. From the IBM XIV Storage Management GUI, hover the cursor over each
uninterruptible power supply, and verify that Charge Level is 100%, Input
Power is yes, and Status is OK.
f. Turn on the customer circuit breaker for main-power cable J1.
g. Verify that the J1 LINE 1 LED is lit on the ATS to ensure that power is
supplied by main-power cable J1.
h. Turn off the customer circuit breaker for main-power cable J2.
i. Verify that the J1 LINE 1 LED on the ATS is lit to ensure that power is
supplied by main-power cable J1.
j. From the IBM XIV Storage Management GUI, hover the cursor over each
uninterruptible power supply, and verify that Charge Level is 100%, Input
Power is yes, and Status is OK.
k. Turn on the customer circuit breaker for main-power cable J2.
l. Verify that the J2 LINE 2 LED on the ATS is lit to ensure that power is
supplied by J2.
Procedure
Complete the following steps to verify that the hardware components are operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not Full Redundancy, contact your next level of support.
3. If any component is in the Initializing state, wait 10 minutes, and check the
status pod again.
If a component stays in the Initializing state (the component is displayed as
yellow), complete the following steps from the IBM XIV Storage Management
GUI:
a. Right-click the component, and click Phase Out > Failed.
b. Hover the cursor over the component, and verify that Status is Failed.
c. Verify that the system status on the lower-right corner of the window shows
Full Redundancy.
d. Right-click the component, and click Test.
The status of the modem is not displayed in the IBM XIV Storage Management
GUI or IBM XIV command-line interface (XCLI). No action is required to
physically removing and installing a replacement modem.
Procedure
270 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
4. Package and ship the modem to your approved repair facility.
Procedure
Procedure
Complete the following steps to verify that the hardware components are operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not Full Redundancy, contact your next level of support.
3. If any component is in the Initializing state, wait 10 minutes, and check the
status pod again.
If a component stays in the Initializing state (the component is displayed as
yellow), complete the following steps from the IBM XIV Storage Management
GUI:
a. Right-click the component, and click Phase Out > Failed.
b. Hover the cursor over the component, and verify that Status is Failed.
c. Verify that the system status on the lower-right corner of the window shows
Full Redundancy.
d. Right-click the component, and click Test.
The component goes through a testing procedure. When complete, the
Command executed successfully message is displayed.
e. Hover the cursor over the component, and verify that Status is Ready.
4. If any component is in the Ready state, complete the following steps from the
IBM XIV Storage Management GUI:
a. Right-click the component, and click Phase In.
When you phase in a disk drive module (DDM), data module, or interface
module, the component turns yellow, and the status on the lower right
corner of the window shows Redistributing. Depending on the amount of
data to be redistributed, this process might take some time.
b. Hover the cursor over the component, and verify that Status is OK.
Procedure
1. Package the defective component using the packaging from the replacement
component.
2. Send the defective component package to the appropriate facility according to
the process for your respective country or geography.
Replacing cables
Use these procedures replace defective cables.
If more than one cable is defective, replace one cable one at a time. Removing
multiple cables at one time might result in mixing up replacement cable order.
No IBM XIV Storage Management GUI or XCLI actions are needed to replace
cables. Cable failures are not directly displayed in the IBM XIV Storage
Management GUI; however, the IBM XIV Storage Management GUI might show a
failure in the associated components or show odd behavior in components on both
ends of the cable.
272 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Replacing module-to-module (Ethernet and serial-to-USB)
cables
Use this procedure to replace a defective Ethernet or serial-to-USB cable that
connects a data or interface module to other data or interface module.
Before replacing a cable, verify that the cable connections are not the cause of the
problem. Verify that each end of the cable is plugged into the correct component
and port and is fully seated. Cable-port information is provided on a label at both
ends of the cable. If the cable connections are good and the malfunction persists,
unplug and plug cable into both ports. If the malfunction still persists, use this
procedure to replace the cable.
This procedure does not pertain to cables that connect to the patch panel. To
replace a defective Ethernet and Fibre Channel) cables from the patch panel to a
data or interface module, see “Replacing patch-panel (Ethernet and Fibre Channel)
cables” on page 279.
Procedure
Before replacing a cable, verify that the cable connections are not the cause of the
problem. Verify that each end of the cable is plugged into the correct component
and port and is fully seated. Cable-port information is provided on a label at both
ends of the cable. If the cable connections are good and the malfunction persists,
unplug and plug cable into both ports. If the malfunction still persists, use this
procedure to replace the cable.
Procedure
Note: Ensure that the replacement cable does not interfere with access to other
cables or components for any future replacements that might be necessary.
7. Cut off both connector ends of the defective cable.
274 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Do not remove the defective cable from the cable bundle in the rack.
8. Run diagnostic tests to ensure that the XIV system is operating correctly (see
“Running basic diagnostic test” on page 323).
Procedure
Note: Ensure that the replacement cable does not interfere with access to other
cables or components for any future replacements that might be necessary.
7. Verify that cable connections are working correctly and recognized by the XIV
system. Using the IBM XIV Storage Management GUI or IBM XIV
command-line interface (XCLI), verify that data is correctly distributed.
Attention: Proceed to the next step only after confirming that the replacement
cable resolved the problem. If the problem is not resolved, contact your next
level of support.
8. Cut off both connector ends of the defective cable.
Note: Ensure that you place the cut-off cable plugs in a designated disposal
area.
The ac-sensor cable from the ATS to uninterruptible power supply 3 provides
information about ac power through the network management card on
uninterruptible power supply 3. This cable is labeled ATSX807-U3OUTPUT.
Procedure
b. Loosen the two retaining screws by using a small flat screwdriver, and
disconnect the ac-sensor cable from port X807 (green connector) on the ATS.
276 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
J2 line cord J1 line cord
Maintenance
module Maintenance module
power cord F4
circuit breaker
F4
Power output
LED
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10051
ac-sensor cable ac-sensor cable
LS port (X807) COMM port (X801)
Note: The cable is not easily removed from the rack. Leave the defective cable
in place.
5. Run diagnostic tests to ensure that the XIV system is operating correctly (see
“Running basic diagnostic test” on page 323).
The ac-sensor cable from the ATS to data module 1 provides information about ac
power through the USB1 port on data module 1. This cable is labeled
ATSX801-M1USB1.
Procedure
b. Disconnect the ac-sensor cable from port X801 (blue connector) on the ATS.
278 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
J2 line cord J1 line cord
Maintenance
module Maintenance module
power cord F4
circuit breaker
F4
Power output
LED
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10051
ac-sensor cable ac-sensor cable
LS port (X807) COMM port (X801)
Note: The cable is not easily removed from the rack. Leave the defective cable
in place. Defective cables are non-returnable items.
5. Run diagnostic tests to ensure that the XIV system is operating correctly (see
“Running basic diagnostic test” on page 323).
Before you replace a cable, verify that the cable connections are not the cause of
the problem:
v Verify that the Ethernet or Fibre Channel cable is plugged in to the correct
module port and that the cable is fully seated. Cable-port information is
provided on a label at both ends of the cable.
v Verify that the customer cable is plugged into the front of the patch panel and is
fully seated.
If the cable connections are good and the malfunction persists, unplug and replug
the cable in to both ports. If the malfunction still persists, use this procedure to
replace the cable.
Important: When you replace an optical Ethernet cable or Fibre Channel cable,
take care to not cause sharp bends or crimp the cables. If the cable is bent or
crimped, system information flow might be compromised.
Procedure
280 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Note: Take care that the replacement cable does not interfere with access to
other cables or components for any future replacements that might be
necessary.
8. Remove the customer cable from the port at the front of the patch panel.
9. Attach the customer cable to the open end of the female-to-female cable
connector.
10. From the IBM XIV Storage Management GUI, hover the cursor over the rack
until the patch panel is displayed to the right of the rack image, and verify
that the connection is white, indicating that the cable connection is working
correctly and recognized by theXIV system.
You can also verify the cable connection from the XCLI by running the
fc_port_list module=1:module:x command, where x is the module number.
Attention: Proceed to the next step only after you confirm that the
replacement cable solved the problem. If the problem is not solved, contact
your next level of support.
11. Cut off and dispose of the connector end from the defective cable that was
previously plugged in to the data or interface module.
The cable is not easily removed from the rack. Leave the defective cable in
place. Defective cables are non-returnable items.
12. Run diagnostic tests to ensure that the XIV system is operating correctly (see
“Running basic diagnostic test” on page 323).
Procedure
Perform one of the following procedures to replace the power cables, depending
on the model type:
1. “Replacing power cables for model 281x-114281x-214, and 281x-216”
2. “Replacing power cables for model 281x-215” on page 284
Before replacing the power cable, verify that the cable connections are not the
cause of the problem. Verify that each end of the power cable is plugged into the
correct component and port and is fully seated. Cable-port information is provided
on a label at both ends of the power cable. If the cable connections are good and
the malfunction persists, unplug and plug each end of the power cable. If the
malfunction still persists, use this procedure to replace the power cable.
xiv10145
10 Amp power sockets Serial port EPO port
(S1)
6. Turn the three circuit breakers on the uninterruptible power supply to the off
(down) position.
7. On the automatic transfer switch (ATS), turn the appropriate circuit breaker
for the uninterruptible power supply being removed to the off (down)
position.
282 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Maintenance module
power cord
Maintenance module
circuit breaker
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10149
Figure 253. Power sockets and circuit breakers on the side of the ATS
8. Unplug the defective power cable from the uninterruptible power supply and
the two components (modules or switches).
9. Plug the replacement power cable into the same sockets in uninterruptible
power supply and both components (modules or switches).
10. Verify that the label on each end of the replacement power cable matches the
component and port to which it is connected.
11. Run the replacement cable along the existing cable bundle as close as possible
to the defective cable, and secure using hook-and-loop fasteners included in
the cable-replacement kit to create a neat cable organization.
Do not undo the cable bundle, but try to recreate the cable path as close as
possible.
Note: Ensure that the replacement cable does not interfere with access to
other cables or components for any future replacements that might be
necessary.
12. Mark each end of the defective cable to identify that they are no longer in use.
Do not remove the defective cable from the cable bundle in the rack.
CAUTION:
Do not cut off the defective power cable ends. Exposed cable ends might
lead to an electrical hazard. Instead, mark the defective cables to identify
that they are no longer in use.
Plastic cover
Data may
be lost
if button
is pushed
xiv10143
Test button Power-off cover
17. Ensure that the Online LED ( ) on all three uninterruptible power
supplies are lit.
If one or more online LEDs are not lit, contact to your next level of support.
18. Run diagnostic tests to ensure that the XIV system is operating correctly (see
“Running basic diagnostic test” on page 323).
Before you replace the power cable, verify that the cable connections are not the
cause of the problem. Verify that each end of the power cable is plugged into the
correct component and port and is fully seated. Cable-port information is provided
on a label at both ends of the power cable. If the cable connections are good and
the malfunction persists, unplug and plug each end of the power cable. If the
malfunction still persists, use this procedure to replace the power cable.
284 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
v One 305 (10 ft) power cable with blue connectors
v Hook-and-loop fasteners
v Preprinted, peel-off labels for each port-connection in the XIV system. Only the
labels for the defect cable are used.
Procedure
Note: Ensure that the replacement cable does not interfere with access to
other cables or components for any future replacements that might be
necessary.
10. Mark each end of the defective cable to identify that they are no longer in use.
Do not remove the defective cable from the cable bundle in the rack.
CAUTION:
Do not cut off the defective power cable ends. Exposed cable ends might
lead to an electrical hazard. Instead, mark the defective cables to identify
that they are no longer in use.
Required tools:
v 10 mm box socket with an extension bar
Procedure
Complete the following steps to removing the rack top cover. When removing data
modules 13 - 15, complete steps 1 - 4 for each data module before proceeding to
the next module.
1. Remove the front door (see “Removing the standard front and rear rack doors”
on page 288).
2. Remove the side panels. (see “Removing rack side panels” on page 298).
3. Remove data modules 13- 15, if installed (see “Removing the data module” on
page 132).
4. Remove the four bolts on the left side of the top cover by using an 8-mm
socket wrench, and then remove the top-cover side panel. Repeat on the right
side.
5. Remove the eight bolts that connect the top hat to the rack on the left and right
sides by using a 10-mm socket wrench.
Top cover
Top-cover side
panel
286 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Installing the rack top cover
If the weight-and-height-reduced shipping (feature code 0200) was ordered, use
this procedure to install the top cover on the rack.
Procedure
Top cover
Top-cover side
panel
3. Install the four bolts on the left side of the top cover by using an 8 mm socket
wrench, and then remove the top-cover side panel. Repeat on the right side.
4. Install data modules 13- 15, if installed (see “Installing the data module” on
page 137).
5. Install the side panels. (see “Installing rack side panels” on page 300).
6. Install the front door (see “Installing the standard front and rear rack doors” on
page 289).
Required tools:
v 7-mm wrench
v 8-mm wrench
Note: If the XIV system was delivered with the rear water-cooled door, see the
Rear Door Heat eXchanger Installation and Maintenance Guide for instructions for
removing the rear door.
Hinge pin
Door hinge
retaining screws
Door hinge
Rack chassis
Procedure
Complete the following steps to remove the front and standard rear door.
1. Open the door of the rack.
2. (Front door only) Disconnect the logo LED cable from the mUSB port on
module 5 (or on module 6 if the ruggedized rack is installed).
288 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Installing the standard front and rear rack doors
Use this procedure to install the front and standard rear doors.
Hinge pin
Door hinge
retaining screws
Door hinge
Rack chassis
xiv10073
Figure 258. Rack doors
Note: If the XIV system was delivered with the rear water-cooled door, see
“Installing the rear-door heat exchanger” on page 41 for installation instructions.
Procedure
Complete the following steps to install the front and standard rear door:
1. Carefully lift the door, and position the inside corner of the door frame against
the rack hinges, with the door hinge brackets slightly above the rack hinge pin
ends. Lower the door so the door hinge brackets slide onto the rack hinge pins.
2. (Front door only) Connect the logo LED cable:
Important: If this cable was already disconnected before the door was
removed, do not reconnect the cable.
v If the ruggedized rack is not installed, connect the logo LED cable to the
mUSB port on module 5.
v If the ruggedized rack is installed, connect the logo LED cable to the mUSB
port on module 6.
3. Close the door on the rack.
Although a leak in the heat exchanger is unlikely, if it does occur, you must replace
the door assembly.
The following illustration shows the locations of components on the rear-door heat
exchanger.
Supply manifold
Air-purging valve
(return manifold)
Return manifold
Air-purging valve
(supply manifold)
Fins
(behind protective
barrier)
Male coupling
(return manifold)
Female coupling
(supply manifold)
Drain port
Hose retention plate
xiv10224
Note: Although the likelihood of water exposure is small, you might prefer to
place some water-absorbent material beneath the door assembly as a general
practice when servicing the rear-door heat exchanger.
Note: For specific repair information regarding the rear-door heat exchanger, see
Chapter 9, “Troubleshooting,” on page 323.
290 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Replacing the rear-door heat exchanger
Although a leak in the heat exchanger is unlikely, if it does occur, you must replace
the door assembly.
Procedure
Complete the following steps to replace the door assembly from the rack cabinet:
1. Drain the water from the heat exchanger (see “Draining the heat exchanger”
on page 293).
2. Detach the supply and return hoses (see “Attaching and detaching the supply
hose” on page 294 and “Attaching and detaching the return hose” on page
295).
3. Open the door assembly 90°.
CAUTION:
The weight of this part or unit is 18 - 32 kg (39.7 - 70.5 lb). It takes two
persons to safely lift this part or unit. (C009)
4. Grasp the door assembly firmly with both hands and lift it upward and away
from the hinges.
5. Position the replacement door assembly at a 90° angle to the rack cabinet as
shown in the following illustration.
xiv10217
Bottom hinge
(long pin)
Attention: Ensure that you engage the bottom hinge pin first when you
install a rear door on the rack cabinet.
6. Place the door so that the bottom hinge pin on the rack cabinet goes into the
locator hole in the bottom hinge area of the door. While keeping the door on
the bottom hinge pin, lift the door slightly and place the top hinge area of the
door on the top hinge pin on the rack cabinet; then, lower the door onto the
hinge pins.
7. Close and adjust the latch mechanism so that all the door gaskets touch the
rack members and compress to a gap of approximately 7 mm (0.25 in.) on all
four sides of the door.
8. Connect the secondary-loop water supply to the heat exchanger (see
“Connecting the water supply” on page 46).
9. Fill the heat exchanger with water and purge any remaining air (see “Filling
the rear-door heat exchanger with water” on page 47).
10. Reinstall the hose-retention late and floor tile, and then close and latch the
door (see “Securing the hoses and the door” on page 50).
292 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
What to do next
Check the heat exchanger after several hours of operation. If there is a splashing or
gurgling sound, repeat the air-purging procedure on both valves (trapped air from
the hoses might have migrated to the heat exchanger).
Attention: Wear safety goggles or other eye protection whenever filling, draining,
or purging air from the rear-door heat exchanger.
Note: Although the likelihood of water exposure is small, you might prefer to
place some water-absorbent material beneath the door assembly as a general
practice when draining the heat exchanger.
Procedure
Complete the following steps to drain water from the heat exchanger:
1. Shut off the flow of water at the source.
Note: Depending on your facility, you might need to turn off the pump unit,
closing a valve at the pump unit, or a similar action.
2. Open the door assembly to 90°.
3. Unscrew the captive screw on the hose-retention plate.
4. Lift the plate out of the door assembly.
5. Disconnect the return hose and the supply hose from the heat exchanger and
move them out of the way.
6. Remove the valve caps from the air-purging valves and from the drain port.
7. Remove the extension hose from the air-purging tool, if it is connected. Make
sure that the air-purging tool handle is in the closed position.
8. Attach the hose and valve portion of the tool to the drain port, and place the
hose end into a container capable of holding at least 5.7 liters (1.5 gallons) of
water.
9. Open the handle on the air-purging tool.
10. Attach the extension hose to one of the air-purging valves at the top of the
heat exchanger to allow air to enter the manifolds.
Note: Instead of using the extension hose, if filtered and oil-free compressed
air is available, you can attach the compressed-air hose to the air-purging
valve to force water out of the exchanger. Keep the air pressure at 50
pounds-per-square-inch gauge (psig) or less to avoid excessive spray at the
drain port.
11. When the water flow at the drain port stops, move the extension hose or
compressed-air hose to the other air-purging valve and repeat the process.
12. When the water has drained completely from the manifolds, complete the
following steps:
The following figures show the components and location of the supply hose.
Return-manifold coupling
(male)
Supply-hose assembly
(male)
xiv10223
Supply-manifold coupling
(female)
Note: It is easier to attach and detach the hose assemblies when there is no water
pressure in the hoses.
Procedure
v To attach the water-supply hose to the female coupling (on the supply manifold)
on the heat exchanger, complete the following steps:
1. Align the male hose coupling with the female supply-manifold coupling.
Note: After the couplings are engaged but before the collar has locked into
place, you can let go of the collar and use both hands to push the hose
upward to lock the couplings.
4. Install the hose-retention plate (see “Removing and installing the
hose-retention plate” on page 296).
v To detach the supply hose, complete the following steps:
294 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
1. Remove the hose-retention plate (see “Removing and installing the
hose-retention plate” on page 296).
2. Move the female supply-manifold coupling collar upward and pull the male
hose coupling from the female coupling.
The following figures show the components and location of the return hose.
Return-manifold coupling
(male)
Return-hose assembly
(female)
Supply-hose
Supply-manifold
assembly (male)
xiv10220
coupling
(female)
Note: It is easier to attach and detach the hose assemblies when there is no water
pressure in the hoses.
Procedure
v To attach the water-supply hose to the female coupling (on the supply manifold)
on the heat exchanger, complete the following steps:
Note: To make it easier to attach the return hose, turn off the water supply
temporarily to remove water pressure. After attaching the return hose, turn on
the water supply again.
1. Align the female hose coupling with the male return-manifold coupling.
Note:
4. Install the hose-retention plate (see “Removing and installing the
hose-retention plate” on page 296).
The following illustration shows the location of the captive screw on the
hose-retention plate.
Middle flange
Hose retention
plate
Captive screw
xiv10218
Procedure
v Complete the following steps to remove the hose-retention plate:
1. Open the door assembly to 90°.
2. Unscrew the captive screw on the hose-retention plate.
3. Lift the plate out of the door assembly.
v Complete the following steps to replace the hose-retention plate:
1. Slide the middle flange of the hose-retention plate below the matching lip of
the corresponding plate and wiggle the plate into place.
2. Fasten the captive screw.
Attention: Wear safety goggles or other eye protection whenever filling, draining,
or purging air from the rear-door heat exchanger.
296 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Procedure
Complete the following steps to purge air from the heat exchanger:
1. Unscrew and retain the caps from both air-purging valves.
Note: The valves are similar to the valves on bicycle or automobile tires. The
following illustration shows the air-purging tool.
Hose
Handle
Open
Valve Closed
xiv10216
Extension hose
2. Attach the air-purging tool to the leftmost (supply) air-purging valve. Ensure
that the air-purging tool handle is in the closed position (perpendicular to the
hose).
Note: The 6-inch extension hose for the air-purging tool is not required for this
procedure. You can attach the extension hose to the tool, or you can set the
extension hose aside.
3. Place the other end of the air-purging tool in the 2-liter container to catch the
water and air bubbles that escape during the purging procedure.
4. Turn the air-purging tool handle to the open position (parallel to the hose).
Water that is mixed with air begins to spit into the container.
5. When there is a steady stream of water from the air-purging tool into the
container, turn the tool handle to the closed position; then, disconnect the tool
and move it and the container to the rightmost (return) air-purging valve.
Attention: If water drips from an air-purging valve after you remove the
air-purging tool, reattach the tool and disconnect it again to exercise and reseat
the seal.
6. Turn the air-purging tool handle to the open position. When there is a steady
stream of water from the air-purging tool, turn the handle to the closed
position; then, disconnect the tool and set it aside.
Hose
Handle
Open
Valve Closed
xiv10216
Extension hose
When the air-purging tool handle is parallel to the tool hose, the tool is open, and
air flows through the tool. When the tool handle is perpendicular to the tool hose,
the tool is closed, and air does not flow.
Procedure
v Complete the following steps to open an air-purging valve:
1. Unscrew the valve cap.
2. Screw the valve of the air-purging tool onto the air-purging valve. The tool
presses the valve pin inside the valve stem and allows air to flow.
3. Open the air-purging tool (turn the handle parallel to the tool hose).
v Complete the following steps to close an air-purging valve:
1. Close the air-purging tool (turn the handle perpendicular to the tool hose).
2. Unscrew the valve of the air-purging tool from the air-purging valve.
3. When you have completed the maintenance task, such as draining the heat
exchanger or purging air from it, screw the valve cap onto the air-purging
valve. The valve cap provides a secondary seal.
298 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Procedure
Side panel
Nut clip
Washer
Screw
xiv10194
Figure 266. Side-panel retention kit
Door
xiv10076
Figure 267. Installing the side panel
Procedure
300 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Locking latches
Door
xiv10076
Figure 268. Installing the side panel
3. Push the top of the side panel towards the rack until the latches lock in place.
4. If the rack has the ruggedized rack installed, install the security screws that
secure the side panels to the rack by completing the following steps.
Side panel
Nut clip
Washer
Screw
xiv10194
The ruggedized brace is part of the ruggedized rack, feature code 0080.
Complete the following procedures to replace the ruggedized brace and latch:
The ruggedized brace is part of the ruggedized rack (feature code 0080).
Procedure
To remove the ruggedized, remove the 10 securing screws, and remove the x-brace
(see Figure 270).
X-brace
Hex screws
xiv10198
302 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
About this task
The ruggedized brace is part of the ruggedized rack (feature code 0080).
Procedure
To install the ruggedized brace, place the x-brace on the mounting brackets, and
secure by using 10 securing screws (see Figure 271).
X-brace
Hex screws
xiv10198
The RFID tag is an optional feature (feature code 0203) for the IBM XIV Storage
System. It is attached to the inside of the front door just above the latch by using
an adhesive, as shown in the following figure.
Front door
xiv10092
Figure 272. Radio frequency identification device tag on the rack front cover
The following figure describes the information about the RFID label.
EPC code
Bar code
of the EPC
code X X
Procedure
304 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
About this task
Attention: These procedures are not carried out under normal service operations
by an IBM service representative. These procedures must be completed only by
personnel who are authorized to recycle or dismantle components.
Attention:
Attention: These procedures are not carried out under normal service operations
by an IBM service representative. These procedures must be completed only by
personnel who are authorized to recycle or dismantle components.
The system board is fitted with a 3-V lithium CR2032 coin battery.
Procedure
Complete the following procedures to remove the coin battery in the maintenance
module:
1. Power off and remove the maintenance module (see “Removing the M3 and
M4 maintenance modules and guide rails” on page 178).
2. Remove the maintenance-module cover:
a. Press down firmly on the blue tabs on the right and left sides of the top
and slide the cover toward the rear of the maintenance module until the
cover is disengaged from the chassis, approximately (0.75 in)
b. Lift the cover off the maintenance module and set it aside.
3. Remove the riser-card assembly:
xiv10225
Figure 274. Riser-card assembly in the maintenance module
a. Grasp the riser-card assembly at the front and rear edges and lift to remove
it from the maintenance module.
b. Disconnect any cables from the adapters in the riser-card assembly.
c. Place the riser-card assembly on a flat, static-protective surface.
4. Remove the battery
a. Locate the button battery on the system board.
Battery
Orientation
Heatsink
DIMMs
DIMMs
Microprocessor
xiv10202
306 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
b. Use a fingernail to press the top of the battery clip away from the battery.
The battery pops up when released.
c. Use your thumb and index finger to lift the battery from the socket.
5. Dispose of the battery as required by local ordinances or regulations. For more
information, see IBM Systems Environmental Notices (http://ibm.co/1fBgWFI).
The following notes describe information that you must consider when replacing
the battery.
v IBM has designed this product with your safety in mind. The lithium battery
must be handled correctly to avoid possible danger. If you replace the battery,
you must adhere to the following instructions.
Note: In the U. S., call 1-800-IBM-4333 for information about battery disposal.
v If you replace the original lithium battery with a heavy-metal battery or a
battery with heavy-metal components, be aware of the following environmental
consideration. Batteries and accumulators that contain heavy metals must not be
disposed of with normal domestic waste. They will be taken back free of charge
by the manufacturer, distributor, or representative, to be recycled or disposed of
in a proper manner.
v To order replacement batteries, call 1-800-IBM-SERV within the United States,
and 1-800-465-7999 or 1-800-465-6666 within Canada. Outside the U.S. and
Canada, call your support center or business partner.
Note: After you replace the battery, you must reconfigure the server and reset
the system date and time.
CAUTION:
When replacing the lithium battery, use only IBM Part Number 33F8354 or an
equivalent type battery recommended by the manufacturer. If your system has
a module containing a lithium battery, replace it only with the same module
type made by the same manufacturer. The battery contains lithium and can
explode if not properly used, handled, or disposed of.
Do not:
– Throw or immerse into water
– Heat to more than 100°C (212°F)
– Repair or disassemble
Attention: These procedures are not carried out under normal service operations
by an IBM service representative. These procedures must be completed only by
personnel who are authorized to recycle or dismantle components.
Procedure
Complete the following procedures to remove the coin battery in the maintenance
module:
1. Power off and remove the maintenance module (see “Removing the M5
maintenance module and guide rails” on page 179).
2. Remove the maintenance-module cover:
a. If the server has been installed in a rack, slide the server out from the rack
enclosure. Refer to the “Replacing the maintenance module” on page 177
for more information on installing or removing the server from the rack.
b. Put your thumbs on the blue tabs (cover-release buttons). Press on the blue
tab or button on the left and slide the cover toward the rear of the server
until the cover has disengaged from the chassis.
c. Lift the server cover off the server and set it aside.
Attention: For proper cooling and airflow, replace the server cover before
you turn on the server.
3. If necessary, lift the air baffle out of the way
a. Place your fingers under the front and back of the top of the air baffle; then,
lift the air baffle out of the server.
308 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 277. Air baffle removal
4. Remove the battery. Figure Figure 278 on page 310 shows the location of the
coin battery.
a. If there is a rubber cover on the battery holder, use your fingers to lift the
battery cover from the battery connector.
b. Use one finger to tilt the battery horizontally out of its socket, pushing it
away from the socket.
Attention: Neither tilt nor push the battery by using excessive force.
c. Use your thumb and index finger to lift the battery from the socket.
310 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
5. Dispose of the battery as required by local ordinances or regulations. For more
information, see IBM Systems Environmental Notices (http://ibm.co/1fBgWFI).
Attention:
Attention: These procedures are not carried out under normal service operations
by an IBM service representative. These procedures must be completed only by
personnel who are authorized to recycle or dismantle components.
The system board is fitted with a 3-V lithium CR2032 coin battery.
Procedure
Complete the following procedures to replace the coin battery in a data or interface
module:
1. Phase out the data or interface module (see “Phasing out the data module” on
page 131 or “Phasing out the interface module” on page 146).
2. Remove the data or interface module from the rack (see “Removing the data
module” on page 132 or “Removing the interface module” on page 147, as
relevant.
3. Release the enclosure top cover by turning the lock mechanism to the “unlock”
position.
4. Press down firmly on the metal tab in the middle of the cover and slide the
cover towards the rear of the module until the cover disengages from the
chassis.
5. Lift the cover off the module and set it aside.
6. Locate the button battery on the system board.
7. Remove the battery by pressing down on one side to tilt the battery, and then
lift out the battery.
8. Dispose of the battery as required by local ordinances or regulations. For more
information, see IBM Systems Environmental Notices (http://ibm.co/1fBgWFI).
If an external power loss occurs, the XIV system will go into emergency shutdown.
When the external power returns, the XIV system will automatically power up.
This will occur if the emergency shutdown was completed successfully (no
interrupts of any kind). The system has a 6-minute timeout between the time the
power resumed and the power-on. Should the system exhibit issues during the
power-on operation (partial power on, boot to maintenance state, etc.), avoid all
manual intervention and contact the next level of support.
Procedure
Tip: If both power feeds into the XIV system have voltages within operational
tolerance, the feed that gets energized first becomes the primary feed. You can
use this characteristic to manually balance the power load among several XIV
systems. If a power feed fails, the ATS switches the power load to the
remaining power feed. When power is resumed, you must repeat the manual
balancing operation.
2. From the rear of the rack, verify that the circuit breakers on the ATS are in the
on (up) position.
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10149
Figure 280. Power sockets and circuit breakers on the side of the ATS
3. Verify that the three circuit breakers on each uninterruptible power supply are
set to the on (up) position.
Circuit breakers
and guard
xiv10152
Online/bypass
switch
4. From the front of the rack, press the Test button on each uninterruptible power
supply in rapid succession, or simultaneously if possible, to power on the XIV
system.
314 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Plastic cover
Data may
be lost
if button
is pushed
xiv10143
Test button Power-off cover
5. Verify the system state (see “Verifying the system state” on page 73).
Procedure
circuit-breaker guards
xiv10510
3. Power on the XIV system by pushing all 12 circuit-breaker levers on the PDUs
to the on (up) position.
316 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Power status LED
Fault LED
ID LED
xiv10208
Figure 285. LEDs on the front of the data and interface modules
6. From the IBM XIV Storage Management GUI, verify the system state (see
“Verifying the system state” on page 73).
Attention: Power off the XIV system only when necessary. When powered off,
the XIV system is taken out of use and can no longer store data from host systems.
Taking the XIV system out of use might put extra burden on all other XIV systems
and might affect storage performance for the site.
(Models 281x-114 and 281x-214 only) The XIV system automatically performs an
emergency shutdown when there is a power failure or when more than two
uninterruptible power supplies fail. An emergency shutdown is not performed by
personnel. The XIV system determines when to carry out an emergency shutdown.
When you power off the XIV system in a controlled fashion, the XIV system
completes the following actions:
v Stops serving hosts
v Flushes all data from the cache, and places all the data onto the disks (also
called destaging data)
v Turns itself off
Procedure
Attention: Power off the XIV system only when necessary. When powered off,
the XIV system is taken out of use and can no longer store data from host systems.
Taking the XIV system out of use might put extra burden on all other XIV systems
and might affect storage performance for the site.
When you power off the XIV system in a controlled fashion, the XIV system
performs the following actions:
v Stops serving hosts
v Flushes all data from the cache, and places all the data onto the disks (also
called destaging data)
v Powers off all hardware components
Procedure
Fault LED
ID LED
xiv10208
Figure 286. LEDs on the front of the data and interface modules
7. From the rear of the rack, lift up the circuit-breaker guard for each circuit
breaker on the power distribution units. There are six circuit-breaker guards all
together.
There are two circuit breakers under each circuit-breaker guard.
318 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
PDU1 PDU2
circuit-breaker guards
xiv10510
8. Push all 12 circuit-breaker handles on the power distribution units to the off
(down) position.
xiv10431
Note:
v These event notifications indicate to the administrators if the system temperature
is: normal, high, too high, and critically high; above which shutdown will be
applied immediately. Table 14 depicts the temperature thresholds and events
received.
v After a manual or automatic thermal shutdown due to thermal conditions, IBM
support must be immediately contacted. Do not attempt to power up the system
before contacting IBM support.
Table 14. IBM Storage System temperature thresholds and events
Temperature
threshold Event Description
27°C (80°F) SYSTEM_TEMPERATURE_IS_OK_NOW No action required.
28°C (82.4°F) SYSTEM_TEMPERATURE_IS_ABOVE_NORMAL System should be closely monitored
and, if possible, take action to cool
down.
Procedure
Procedure
Complete the following steps to verify that the hardware components are operating
correctly:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system icon to display the system view.
2. Verify that the status pod on the lower-right corner of the window shows Full
Redundancy.
If the state is not Full Redundancy, contact your next level of support.
3. If any component is in the Initializing state, wait 10 minutes, and check the
status pod again.
If a component stays in the Initializing state (the component is displayed as
yellow), complete the following steps from the IBM XIV Storage Management
GUI:
IBM service representatives can collect system logs using the Technician Assistant
tool. Customers can also collect system logs and send them to the IBM Support
Center using the IBM XIV Storage Management GUI. Customers can find
instructions on the One-Click X-Ray webpage on the IBM Support Portal website
(http://g01zciwas003.ahe.pok.ibm.com/support/dcf/
preview.wss?host=g01zcidbs003.ahe.pok.ibm.com&db=support/ssg/ssgtech.nsf
&unid=FE1A8994A26344A885257A0D002D8990&taxOC=STJTAG&MD=2012/05/29
%2011:05:29&sid=).
Procedure
324 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
4. Enter the response to the challenge by using the challenge key that is displayed
in the window.
You can find the response for the XIV system on the IBM XIV Service Center
website (http://servicecenter.xiv.ibm.com).
Note: You must be authorized to obtain a unique response key for the
challenge. If you are not authorized, contact your next level of support.
5. Click XSC.
6. Wait for the x-ray files to be collected. This might take several minutes.
7. Select the directory where you want to store the files, and click Save.
8. Wait for the x-ray files to be saved on your local system. This might take
several minutes.
9. Close the Xray Collect window.
Procedure
To view the events from the IBM XIV Storage Management GUI from the All
Systems view, right-click the XIV system, and click View Events. The Events
window is displayed.
To view events from the XCLI command line, run the events_list command.
If the events are listed that are not associated with the failed component, analyze
the reasons for these events before replacing the failed component. If you are not
sure, contact your next level of support.
By inspecting LEDs, you can narrow down problems with specific components.
This information describes the status LEDs on XIV system components.
The following figure shows the location of the LEDs on the DDM. The LED states
are describes in the following table.
Green LED
xiv10175
Amber LED
Front view
Figure 290 shows the location of the LEDs on the front of the module. The LED
states are described in Table 16 on page 327.
Fault LED
ID LED
xiv10208
Figure 290. LEDs on the front of the data and interface modules
326 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 16. Status LEDs on the front of data and interface modules
LED Status Description
®
Power Green The module is receiving power and
operating normally.
Off The module is not receiving power.
Fault Amber A fault was detected.
Off Normal operation
ID Off Currently not in use.
Rear view
Figure 291 shows the location of the LEDs on the rear of the data and interface
modules with 1 Gb Ethernet ports. Figure 292 shows the location of the LEDs on
the rear of the data and interface modules with 10 Gb Ethernet ports. The LED
states are described in Table 17 on page 328.
Note: When using system code V11.2.0 or higher, the LEDs are not lit upon
module boot completion.
xiv10160
PSU1 status LED ID D7 D6 D5 D4 D3D2 D1D0 Ethernet LEDs
Figure 291. LEDs on the rear of the data and interface modules with 1 Gb Ethernet ports
only
328 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 17. Status LEDs on the rear of data and interface modules (continued)
LED Status Description
10 Gb Ethernet iSCSI Off The logical link connection has not been
Activity LEDs right established.
(ports 1 and 2)
Yellow Indicates a valid data activity link with no
281x-214 model only. data transfer.
See Figure 292 on Flashing yellow Indicates a valid data activity link with data
page 327. transfer.
Front view
Figure 293 illustrates the location of the LEDs on the front of the maintenance
module. The LED states are described in Table 18.
Figure 293. Front view of the maintenance module information and connection panel
Rear view
Figure 294 on page 330 illustrates the location of the LEDs on the rear of the
maintenance module. The LED states are described in Table 19 on page 330.
Figure 295 on page 331 and Figure 296 on page 331 show the location of the LEDs
on the front and rear of the InfiniBand switch. The LED states are describes in
Table 20 on page 331.
330 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 295. LEDs on the rear of the InfiniBand switch
xiv10098
System status
LED
The following table shows the location of the LEDs on the front of the
uninterruptible power-supply. The LED states are describes in the following table.
xiv10043
332 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 21. Uninterruptible power-supply LEDs (continued)
LED Icon LED status Description
Bypass Off Normal operating condition.
Green The uninterruptible power supply is in
bypass mode. Utility power is sent directly
to the connected equipment during bypass
mode operation. Bypass mode is a result of
an internal uninterruptible power-supply
fault, an overload condition, or a
user-initiated command, either through an
accessory or the manual bypass switch.
Battery operation is not available while the
uninterruptible power supply is in bypass
mode.
Overload Off Normal operating condition.
Green An overload condition exists.
Fault Off Normal operating condition.
Green The uninterruptible power supply detected
an internal fault.
Replace Off Normal operating condition.
battery
Green The battery is disconnected or must be
replaced.
Battery charge Green The five LEDs indicate the battery charge
state, from 0% percent (no charge) to 96%,
almost charged. A fully charged
uninterruptible power supply shows all
Battery charge LEDs lit.
The following figures show the location of the LEDs on the lower-right corner on
the front of the single-phase and three-phase ATSs, and LEDs that are on the side
of the ATS.. The LED states are describes in the following table.
Output power
LEDs
xiv10153
334 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 22. ATS LEDs (continued)
LED LED status Description
Selected source Green The ATS has two output-power LEDs labeled
(three-phase SELECTED SOURCE J2 LINE 2 and SELECTED
ATSs only) SOURCE J1 LINE 1, that are on the lower-right
corner of the ATS just below the side cooling vents).
The lit LED indicates the main-power cable that is
the primary feed.
Off
Fault Green When lit, this LED indicates that an ATS power fault
(three-phase occurred. If this LED is lit, contact your next level of
ATSs only) support.
Off The ATS is operational.
Output power Green The ATS has three output-power LEDs (labeled P3,
P2, and P1) that are on the side of the ATS next to
each uninterruptible power-supply power socket.
When lit, each LED indicates that the power from
the ATS to each uninterruptible power supply is
active.
XIV system code V11.2.x or later must be installed on the XIV system.
Host profiles are added to the XIV system when the customer installs the
host-attachment kit. The Host Configuration Verification utility retrieves host
profiles that are stored on the XIV system.
Procedure
From the Technician Assistant tool, click Utilities > Host Configuration
Verification. The Host Configuration Verification window is displayed.
When the verification is complete, the following information is displayed:
v The number of hosts that were analyzed
v The number of hosts that were not analyzed because the host profile is missing
v The percentage of compliant of host
v The percentage of non-compliant of host
v A tabular list of non-compliant hosts, their host-profile attributes, and the reason
for non-compliance
v A tabular list of compliant hosts and their host-profile attributes
The IBM XIV Storage Management GUI and the Technician Assistant tool on your
notebook computer communicate with the XIV system over the technician ports by
using XIV system IP address 14.10.202.250 and port 7777. The XIV system sets the
notebook computer IP address to 14.10.202.1. You can also manually set the IP
address, which is recommended when upgrading the XIV system code.
Note: The technician port for module 4 is active only on XIV system code
V11.0.1 or later.
v From a command prompt, run the ipconfig command to verify that the IP
address for the notebook computer is set to 14.10.202.1.
If IP address is not set correctly, manually set the IP address to 14.10.202.1. For
example, from a notebook computer running Windows:
1. From the Control Panel window, double-click Network Connections. The
Network Connections window is displayed.
2. Right-click Local Area Connection, and click Properties.
3. Click Internet Protocol (TCP/IP) in the This connection uses the following
items list.
4. Click Properties. The Internet Protocol (TCP/IP) Properties window is
displayed.
5. Select Use the following IP address.
6. Enter 14.10.202.1 in the IP address text field.
7. Enter 255.255.255.0 in the Subnet mask text field.
8. Leave the gateway and DNS server fields blank.
9. Click OK.
10. Click OK.
v From a command prompt, run the following command to verify that the
notebook computer can communicate with the XIV system.
ping 14.10.202.250
v Restart the notebook computer, disable the firewall, and disconnect and
reconnect the Ethernet cable to technician port on the patch panel.
336 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
v Bypass the patch panel by connecting the Ethernet cable to directly to the F2
port on data module 2 or the F4 port on interface module 4.
Ethernet ports
F4, F2
xiv10342
Figure 301. Ethernet ports for connecting to the notebook computer
Symptoms
In IBM XIV Storage Management GUI, the XIV system icon shows blank panels for
modules that are physically installed in the rack.
Cause
In partially populated racks with less than 13 modules, the interface services that
are used to provide Fibre Channel and iSCSI capability is disabled on module 6. In
partially populated racks with less than 11 modules, the interface services are also
disabled on module 9. Disabling interface services on these modules is done to
maintain redundancy in partially populated racks.
When you add data modules 11 and 13, interface services are automatically
activated during the phase-in process according to the following list. When the
phase-in process for these modules is complete, the interface services show the OK
status.
v Module 11 activates interface services on module 9.
v Module 13 activates interface services on module 6.
Do not start this procedure if any of the following conditions are true:
v You are installing a rack with 15 modules.
v You are installing a rack with six modules.
v You are installing a rack with 9 - 14 modules, and all the physically installed
modules are displayed in the IBM XIV Storage Management GUI.
Complete the following steps from the IBM XIV Storage Management GUI to add
the missing data or interface modules.
Important: Add each module, one at a time, in sequential order starting with
lowest missing data or interface module and progressing to highest missing
module in the rack.
1. Right-click the missing module, and click Equip.
The module begins initializing. When complete, the module changes to the
ready state. This takes several minutes.
If the module does not enter the Ready state after several minutes, see “Module
not receiving power.”
If the procedure still returns a fail notice
a. Recheck all cabling.
b. Right-click the missing module to be added, and click Equip.
c. If the module still does not change to the Ready state, the module is faulty.
Replace the module before continuing.
2. If you are adding more than one interface module, repeat the previous step for
the next higher interface modules until all interface modules are initialized
before continuing.
3. Right-click the missing module to be added, and click Phase in.
The module begins phasing in. After the module changes to the OK state, the
disk drive modules (DDMs) begin phasing in one at a time.
Note: Phasing in the module might take some time depending upon the
amount of data that the XIV system contains. It is not necessary to wait for the
phase-in process to finish before continuing.
Adding module 11 or module 13 might activate the Fibre Channel ports on
module 9 or module 6.
4. If you are adding more than one interface module, repeat the previous step for
the next higher interface modules until all interface modules are phased in
before continuing.
5. Verify that all ports on patch panel are either yellow or gray.
6. Repeat this procedure for the next higher module.
After you install a module, wait approximately 2 minutes for power to be applied
to the module and for the module to go into Ready state. If the module does not
go into the Ready state after this short waiting period, complete the following
steps to resolve the problem.
338 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
loaded with new firmware during the component_test, or component_equip
process. When this event occurs, the module must be powered off and then
back on.
POWER_TO_MODULE_SHOULD_BE_DISCONNECTED_AND_RECONNECTED
__ 2. Look at the label on each cable (including the power cables), and verify that
all cables are connected to the correct port and are fully seated (see “Data
and interface module cable connections” on page 361.
__ 3. Disconnect and then reconnect the power cables from both module
power-supply units(PSUs):
a. Unclip the power-cable retainers.
b. Disconnect the power cables.
c. Wait 60 seconds.
d. Reconnect the power cables to the PSU.
Ensure that you reconnect power cable 1 (marked P1) to PSU1 and
power cable 2 (marked P2) to PSU2.
When power is available to the PSU, the PSU LED flashes green. When
the PSU is supplying power to the module, the LED changes to solid
(continuous) green.
xiv10160
PSU1 status LED ID D7 D6 D5 D4 D3D2 D1D0 Ethernet LEDs
Figure 302. LEDs on the rear of the data and interface modules
e. Secure the power-cable retaining clip on the power cable by pushing the
clip to the right.
f. From the IBM XIV Storage Management GUI, right-click on the modules,
and click Test.
The modules go through a testing procedure. When complete, the
Command executed successfully message is displayed.
g. Click OK.
__ 4. If the module still does not enter the Ready, the module might be defective.
Contact your next level of support before proceeding.
If two data modules report input-power loss at the same time, a power cable failed
or became disconnected at the uninterruptible power supply.
There are direct communication connections between data modules 1, 2, and 3 and
the uninterruptible power supplies, as shown in Table 23.
Table 23. Module to uninterruptible power supply connectivity
Module Uninterruptible power supply
Module 1 Uninterruptible power supply 1
Module 2 Uninterruptible power supply 2
Module 3 Uninterruptible power supply 3
When one of these data modules fails, the corresponding uninterruptible power
supply also shows as failed, because the primary communication path to that
uninterruptible power supply failed. The uninterruptible power supply continues
to provide power, and the XIV system has a redundant path to communicate with
the uninterruptible power supply through a serial connection.
340 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Diagnosing the problem
If there are multiple failing PSUs, and all failing PSUs are associated with the same
uninterruptible power supply, replace only the uninterruptible power supply.
If the module PSUs are not automatically powering on the data or interface
module, the module might have defective components.
Figure 303. LEDs on the rear of the data and interface modules
e. Secure the power-cable retaining clip on the power cable by pushing the
clip to the right.
342 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
f. From the IBM XIV Storage Management GUI, right-click on the modules,
and click Test.
The modules go through a testing procedure. When complete, the Command
executed successfully message is displayed.
g. Click OK.
4. If problem persists, contact your next level of support.
Symptoms
When the solid-state drive is initialized. the component test fails, and the following
error is reported:
COMPONENT_TEST_OF_SSD_HAS_FAILED Test of 1:SSD:n:n has failed with error
DISK_SELF_TEST_TIMEOUT.
3. Reinsert the SSD by pushing the retention tab to the right, and inserting the
new SSD into the opening in the carrier assembly. Release the tab to secure the
SSD in place.
4. From the IBM XIV Storage Management GUI, right-click the SSD in the
expanded module view, and click Test.
5. Hover the cursor over SSD, and verify that Status is Ready. If the state is
Initializing, wait approximately 15 seconds until the state changes to Ready.
344 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
d. If the switch does not come on, check the power supplies.
e. Check the temperature.
f. Check the Fan status.
Cause
v The uninterruptible power supply batteries might both be drained.
v One or more uninterruptible power supply batteries might be defective.
v The uninterruptible power supply might be defective.
Cause
The Bypass LED indicates that the uninterruptible power supply is bypassing the
automatic transfer switch (ATS) and is running on battery power. Running on
battery power indicates a serious operating condition.
Cause
If the Fault LED on the uninterruptible power supply is lit, contact your next level
of support.
Symptoms
If the Overload and Fault LEDs are lit on more than one uninterruptible power
supply, contact your next level of support.
Symptoms
If the Overload and Bypass LEDs are lit on more than one uninterruptible power
supply, contact your next level of support.
Symptoms
The uninterruptible power supply might also sound an intermittent alarm tone for
up to 1 minute.
Cause
One of the following conditions might cause the Replace Battery LED to be lit:
v The battery is not connected.
v The battery is not fully charged.
346 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
2. Recharge the battery for 24 hours. If the problem persists after recharging,
contact your next level of support.
3. If the battery self test fails, contact your next level of support.
Cause
If the uninterruptible power supply does not restart within 10 minutes, contact
your next level of support.
Complete these steps to recover Fibre Channel ports that are marked failed:
1. From the All Systems view in the IBM XIV Storage Management GUI, click the
XIV system that is being serviced, and then click Launch XCLI.
2. Run the fc_port_list command to display the status of all Fibre Channel
ports, and determine which ports are in the Failed state
The following example output shows that FC_Port:8:2 and FC_Port:8:4 are in
the Failed state.
3. Repeat the following steps for each Fibre Channel port that is in the Failed
state:
a. Run the component_test command for the failed Fibre Channel port (for
example, component_test component=1:FC_port:8:2).
b. Run the fc_port_list command to display the status of all Fibre Channel
ports, and verify that the component-tested port is in the OK state.
c. If the port is still in the Failed state, wait 60 seconds, and run the
component_test command again for the failed port.
d. If the port is still in the Failed state, contact your next level of support.
XIV system code V11.4.x or later must be installed on the XIV system. The system
must be healthy for the tool to run.
348 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
About this task
IBM service representatives can verify custom rack machine assembly at the
customer site using the Technician Assistant tool. This test is mandatory for custom
racks, and optional for other types of racks.
Procedure
Complete the following steps to run the rack cabling verification test:
1. From the Technician Assistant tool, click Launch > Rack Cabling Verification.
The Rack Cabling Verification window is displayed.
2. Follow the instructions in the rack cabling verification utility.
Tips:
v Ensure that the cables are properly inserted into the patch panel. If part of
the test fails due to an improperly inserted cable, you will have to start the
rack cabling verification test from the very beginning.
v After the Fibre Channel connectivity test has completed, you can remove
those cables for easier access to the patch panel to set up for the iSCSI
connectivity test.
v Your connection will be dropped during some of the test phases, and the
utility will display a message alerting you. Wait for the connection to be
restored. Do not click Cancel on the message box unless you want to exit the
utility.
Symptoms
Note: After the couplings are engaged but before the collar has locked into
place, you can let go of the collar and use both hands to push the hose
upward to lock the couplings.
3. Reconnect the return hose, if it is disconnected.
Note: After the couplings are engaged but before the collar has locked into
place, you can let go of the collar and use both hands to push the hose
upward to lock the couplings.
4. Turn on the flow of water from the pump unit to the heat exchanger.
5. Remove any air that entered the heat exchanger through the hoses (see
“Purging air from the heat exchanger” on page 296).
350 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Chapter 10. Parts listing
All replaceable parts for the IBM XIV Storage System are to be replaced by trained
IBM personnel in response to customer problem reports or the addition of optional
parts that the customer orders from IBM as field upgrades.
Components FRUs
This information lists replaceable hardware components in the IBM XIV Storage
System.
Attention: The regional designations are general. The ATS assigned to the
regional designation might not be accurate for your country. If the input voltage
for the country uses a wye circuit, use the appropriate ATS and main-power cables
for EMEA (Europe, Middle East, and Africa) and Asia/Pacific. If input voltage for
the country uses a delta circuit, use the appropriate ATS and main-power cables
for United States, Canada, Latin America. For more information about electric
currents for various countries, see the International Trade Administration website
(http://www.trade.gov/mas/ian/ecw/all.html).
Part numbers for IBM field-replaceable units (FRUs) are subject to change without
notice. The following table contains a listing of the FRU part numbers that are
available as of the date of this printing.
Table 25. XIV system component FRUs
Component FRU part number Comments
ATS, 60A, 1Ø 45W8824 (Models 281x-114 281x-214, and 281x-216
only)
352 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 25. XIV system component FRUs (continued)
Component FRU part number Comments
Interface module – 98Y3319 (Models 281x-214 and 281x-215 only)
10 Gbe Includes one Intel Xeon E5645 processor, 48
GB cache, 10 GbE Fibre Channel ports, and
two power supply units.
All Countries.
InfiniBand switch fan 45W7268 (Models 281x-114, 281x-116, 281x-214,
unit 281x-215, and 281x-216)
All Countries.
Maintenance module 98Y3218 98Y3218 replaces 99Y0917.
4 TB Seagate Megalodon
Self Encrypting 98Y6214 6 TB SAS HDD
Drive (SED)
8 Gb Fibre Channel 42D0492 (Model 281x-114, 281x-214, 281x-215, and
Host Adapter small 281x-216 only)
form-factor
pluggable (SFP) SFP that provides an auto-negotiating
transceiver short-wave optical connection on the 8 Gb
Fibre Channel adapter
354 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 25. XIV system component FRUs (continued)
Component FRU part number Comments
10 GbE 850 Nm Host 98Y6024 (Model 281x-214, 281x-215, and 281x-216
Adapter SFP only)
transceiver
SFP that provides an auto-negotiating
short-wave optical connection on the 10 Gb
Ethernet adapter
Cable FRUs
This information lists the part numbers for ordering all cable field replaceable units
(FRUs).
These cables are for models 281x-114 281x-214, and 281x-216 only.
Table 30. ATS ac-sensor cable FRUs
Cable Part number Description
ATS to 45W6629 ATSX807-U3OUTPUT
uninterruptible power
supply 3
ATS to module 1 45W9993 ATSX801-M1USB1
356 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Front-door logo-LED cable FRU
This information lists the field replaceable unit (FRU) for the logo LED cable on
the front door.
The XIV models 281x-114 281x-214, and 281x-216 are available in multiple
main-power cable configurations. The automatic transfer switch (ATS) is chosen
based on the required main-power cables.
Attention: The regional designations are general. The ATS assigned to the
regional designation might not be accurate for your country. If the input voltage
for the country uses a wye circuit, use the appropriate ATS and main-power cables
for EMEA (Europe, Middle East, and Africa) and Asia/Pacific. If input voltage for
the country uses a delta circuit, use the appropriate ATS and main-power cables
for United States, Canada, Latin America. For more information about electric
currents for various countries, see the International Trade Administration website
(http://www.trade.gov/mas/ian/ecw/all.html).
Table 34. Main-power cable FRUs
Main-power Main-power ATS
cable feature cable part ATS feature ATS FRU part manufacturer
code number code number part number Description
9811 45W0892 9890 45W5160 45W5159 United States, Canada, Latin
America, and Japan
xiv10138
Ground
The following table lists power cords are used to connect the components to the
power distribution units for models 281x-215.
358 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Cable Part number Description
Power cable kit 98Y42274 Kit includes 152 cm (5 ft),
244 (8 ft), and 305 (10 ft)
power cables with blue
connectors, 152 cm (5 ft) and
244 (8 ft) power cables with
red connectors, hook and
loop straps, and labels
The following table lists power cords are used to connect the components to the
uninterruptible power supplies for models 281x-114 281x-214, and 281x-216.
360 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Chapter 11. Cable connections
This information provides a list of the cables that connect components in the XIV
system.
All cables are labeled at both ends with the component and port location to which
the cable ends connect. The labels at both ends of the cable are identical. For
example, a cable with label “M9S1-M7USB3” connects from serial port S1 on
module 9 to USB3 port on module 7.
Each cable end is color-coded to aid with connecting cables correctly. In the
following figures, the cable connectors are color-coded to match the color of the
cable end that plugs in to the connector.
Module 15 (M15)
The following figure shows the rear view of data module 15. Each cable connector
and power socket is color-coded to match the color of the cable end. The color of
the power sockets is different for each module.
InfiniBand ports
G2, G1
Data ports
Power socket P2 Serial port S1 A2, A1
xiv10182
Module 14 (M14)
The following figure shows the rear view of data module 14. Each cable connector
and power socket is color-coded to match the color of the cable end. The color of
the power sockets is different for each module.
InfiniBand ports
G2, G1
Data ports
Power socket P2 Serial port S1 A2, A1
xiv10161
362 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 37. Module 14 cable connections
From To
Supported
Cable type models Label Component Port Color Component Port Color
Power 281x-114, U3.5-M14P2 Module 14 P2 Red Uninterruptible 5 Red
281x-214, power supply 3
281x-216
Power 281x-114, U1.5-M14P1 Module 14 P1 Green Uninterruptible 5 Green
281x-214, power supply 1
281x-216
Power 281x-215 U2.21-M14P2 Module 14 P2 Red Power- 21 Red
distribution unit
2
Power 281x-215 U1.21-M14P1 Module 14 P1 Blue Power- 21 Blue
distribution unit
1
Ethernet All M14A2- Module 14 A2 Yellow Module 13 A1 Red
M13A1
Ethernet All M15A2- Module 14 A1 Red Module 15 A2 Yellow
M14A1 (see
note)
Serial (DB9 All M14S1- Module 14 S1 Black Module 15 USB3 Black
to USB) M15USB3
Unused All Module 14 USB1
Unused All Module 14 USB2
Serial (DB9 All M13S1- Module 14 USB3 Black Module 13 S1 Black
to USB) M14USB3
Unused All Module 14 USB4
InfiniBand All N2.14-M14G2 Module 14 G2 Red InfiniBand 14 Red
switch 2
InfiniBand All N1.14-M14G1 Module 14 G1 Yellow InfiniBand 14 Yellow
switch 1
Note: For XIV systems with a 14-module configuration, the cable that is labeled M15A2-M14A1 is not used. Instead,
the cable that is labeled M1A2-MtopA1 connects to port A1 in module 14 (the highest module in the rack).
Module 13 (M13)
The following figure shows the rear view of data module 13. Each cable connector
and power socket is color-coded to match the color of the cable end. The color of
the power sockets is different for each module.
xiv10181
Power socket P1 USB3 port
364 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Module 12 (M12)
The following figure shows the rear view of data module 12. Each cable connector
and power socket is color-coded to match the color of the cable end. The color of
the power sockets is different for each module.
InfiniBand ports
G2, G1
Data ports
Power socket P2 Serial port S1 A2, A1
xiv10182
Power socket P1 USB3 port
Module 11 (M11)
The following figure shows the rear view of data module 11. Each cable connector
and power socket is color-coded to match the color of the cable end. The color of
the power sockets is different for each module.
InfiniBand ports
G2, G1
Data ports
Power socket P2 Serial port S1 A2, A1
xiv10161
Power socket P1 USB3 port
366 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 40. Module 11 cable connections (continued)
From To
Supported
Cable type models Label Component Port Color Component Port Color
Serial (DB9 All M10S1- Module 11 USB3 Black Module 10 S1 Black
to USB) M11USB3
Unused All Module 11 USB4
InfiniBand All N2.11-M11G2 Module 11 G2 Red InfiniBand 11 Red
switch 2
InfiniBand All N1.11-M11G1 Module 11 G1 Yellow InfiniBand 11 Yellow
switch 1
Note: For XIV systems with an 11-module configuration, the cable that is labeled M12A2-M11A1 is not used.
Instead, the cable that is labeled M1A2-MtopA1 connects to port A1 in module 11 (the highest module in the rack).
Module 10 (M10)
The following figure shows the rear view of data module 10. Each cable connector
and power socket is color-coded to match the color of the cable end. The color of
the power sockets is different for each module.
InfiniBand ports
G2, G1
Data ports
Power socket P2 Serial port S1 A2, A1
xiv10181
Power socket P1 USB3 port
The following tables list cable connections for the interface modules 4 - 9
Module 9 (M9)
The following figure shows the rear view of data module 9. Each cable connector
and power socket is color-coded to match the color of the cable end. The color of
the power sockets is different for each module.
Figure 311. Cable connections for data module 9 with 1 Gb Ethernet ports
368 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
10Gb optical Ethernet ports
F2, F1
Fibre Channel ports
D2, D1, E2, E1
Serial port S1
Data ports InfiniBand ports
Power socket P2 A2, A1 G2, G1
xiv10419
Power socket P1 USB3 port
Figure 312. Cable connections for data module 9 with 10 Gb Ethernet ports
Module 8 (M8)
The following figure shows the rear view of data module 8. Each cable connector
and power socket is color-coded to match the color of the cable end. The color of
the power sockets is different for each module.
Figure 313. Cable connections for data module 8 with 1 Gb Ethernet ports
370 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 314. Cable connections for data module 8 with 10 Gb Ethernet ports
Module 7 (M7)
The following figure shows the rear view of data module 7. Each cable connector
and power socket is color-coded to match the color of the cable end. The color of
the power sockets is different for each module.
Figure 315. Cable connections for data module 7 with 1 Gb Ethernet ports
372 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 316. Cable connections for data module 7 with 10 Gb Ethernet ports
Module 6 (M6)
The following figure shows the rear view of data module 6. Each cable connector
and power socket is color-coded to match the color of the cable end. The color of
the power sockets is different for each module.
Figure 317. Cable connections for data module 6 with 1 Gb Ethernet ports
374 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
10Gb optical Ethernet ports
F2, F1
Fibre Channel ports
D2, D1, E2, E1
Serial port S1
Data ports InfiniBand ports
Power socket P2 A2, A1 G2, G1
xiv10419
Power socket P1 USB3 port
Figure 318. Cable connections for data module 6 with 10 Gb Ethernet ports
Module 5 (M5)
The following figures show the front and rear views of data module 5. Each cable
connector and power socket is color-coded to match the color of the cable end. The
color of the power sockets is different for each module.
mUSB port
xiv10207
376 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
1Gb Ethernet ports
Fibre Channel ports F4, F3, F2, F1
D2, D1, E2, E1
Serial port S1
Data ports InfiniBand ports
Power socket P2 A2, A1 G2, G1
xiv10184
Power socket P1 USB1 port
USB3 port
Figure 320. Cable connections for data module 5 with 1 Gb Ethernet ports (rear view)
Figure 321. Cable connections for data module 5 with 10 Gb Ethernet ports (rear view)
Module 4 (M4)
The following figure shows the rear view of data module 4. Each cable connector
and power socket is color-coded to match the color of the cable end. The color of
the power sockets is different for each module.
378 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Figure 322. Cable connections for data module 4 with 10 Gb Ethernet ports
Module 3 (M3)
The following figure shows the rear view of data module 3. Each cable connector
and power socket is color-coded to match the color of the cable end. The color of
the power sockets is different for each module.
380 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
InfiniBand ports
G2, G1
Data ports 1Gb Ethernet ports
Power socket P2 Serial port S1 A2, A1 F4, F3, F2, F1
xiv10158
USB2 port (model 281x-214 only)
Power socket P1 USB3 port
Figure 323. Cable connections for data module 3 with 1 Gb Ethernet ports
Module 2 (M2)
The following figure shows the rear view of data module 2. Each cable connector
and power socket is color-coded to match the color of the cable end. The color of
the power sockets is different for each module.
InfiniBand ports
G2, G1
Data ports 1Gb Ethernet ports
Power socket P2 Serial port S1 A2, A1 F4, F3, F2, F1
xiv10180
Power socket P1 USB3 port
382 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 49. Module 2 cable connections (continued)
From To
Supported
Cable type models Label Component Port Color Component Port Color
Unused All Module 2 USB1
Unused All Module 2 USB2
Serial (DB9 All M1S1- Module 2 USB3 Black Module 1 S1 Black
to USB) M2USB3
Unused All Module 2 USB4
Ethernet All UM2-M2F1 Module 2 F1 Purple Utility panel M2 Purple
Ethernet All UT2-M2F2 Module 2 F2 Purple Utility panel T2 Purple
Ethernet All M2F3- Module 2 F3 Red InfiniBand MGT Red
N2MGT switch 2
Ethernet 281x-114, U2N1-M2F4 Module 2 F4 Yellow Uninterruptible N1 Yellow
281x-214 power supply 2
InfiniBand All N2.2-M2G2 Module 2 G2 Red InfiniBand 2 Red
switch 2
InfiniBand All N1.2-M2G1 Module 2 G1 Yellow InfiniBand 2 Yellow
switch 1
Module 1 (M1)
The following figure shows the rear view of data module 1. Each cable connector
and power socket is color-coded to match the color of the cable end. The color of
the power sockets is different for each module.
InfiniBand ports
G2, G1
Data ports 1Gb Ethernet ports
Power socket P2 Serial port S1 A2, A1 F4, F3, F2, F1
xiv10179
384 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
sequence of the InfiniBand ports at the rear of the switch.
xiv10164
Secondary power Primary power
supply unit (P2) supply unit (P1)
IS5030
MGMT CONSOLE
Power
PSU 1
PSU 2
FAN
RST
xiv10165
InfiniBand ports 19-36 RJ45-to-serial Ethernet
port (MGT) port (console)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18
xiv10096
19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36
The following table lists cable connections for InfiniBand switch 2. Ports 18 - 36 are
not used.
Table 51. InfiniBand switch 2 cable connections
From To
Supported
Cable type models Label Component Port Color Component Port Color
Power 281x-114, U3.6-N2P2 Switch 2 P2 Red Uninterruptible 6 Red
281x-214, power supply 3
281x-216
Power 281x-114, U2.6-N2P1 Switch 2 P1 Yellow Uninterruptible 6 Yellow
281x-214, power supply 2
281x-216
Power 281x-215 U2.27-N2P2 Switch 2 P2 Red Power- 27 Red
distribution unit
2
Power 281x-215 U1.27-N2P1 Switch 2 P1 Blue Power- 27 Blue
distribution unit
1
InfiniBand All N2.1-M1G2 Switch 2 1 Red Module 1 G2 Red
InfiniBand All N2.2-M2G2 Switch 2 2 Red Module 2 G2 Red
InfiniBand All N2.3-M3G2 Switch 2 3 Red Module 3 G2 Red
InfiniBand All N2.4-M4G2 Switch 2 4 Red Module 4 G2 Red
386 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
InfiniBand ports 1-18
IS5030
MGMT CONSOLE
Power
PSU 1
PSU 2
FAN
RST
xiv10163
InfiniBand ports 19-36 RJ45-to-serial Ethernet
port (MGT) port (console)
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18
xiv10096
19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36
The following table lists cable connections for InfiniBand switch 1. Ports 18 - 36 are
not used.
Table 52. InfiniBand switch 1 cable connections
From To
Supported
Cable type models Label Component Port Color Component Port Color
Power 281x-114, U3.7-N1P2 Switch 1 P2 Red Uninterruptible 7 Red
281x-214, power supply 3
281x-216
Power 281x-114, U1.6-N1P1 Switch 1 P1 Green Uninterruptible 6 Green
281x-214, power supply 1
281x-216
Power 281x-215 U2.15-N1P2 Switch 1 P2 Red Power- 15 Red
distribution unit
2
Power 281x-215 U1.15-N1P1 Switch 1 P1 Blue Power- 15 Blue
distribution unit
1
InfiniBand All N1.1-M1G1 Switch 1 1 Yellow Module 1 G1 Yellow
InfiniBand All N1.2-M2G1 Switch 1 2 Yellow Module 2 G1 Yellow
InfiniBand All N1.3-M3G1 Switch 1 3 Yellow Module 3 G1 Yellow
InfiniBand All N1.4-M4G1 Switch 1 4 Yellow Module 4 G1 Yellow
InfiniBand All N1.5-M5G1 Switch 1 5 Yellow Module 5 G1 Yellow
InfiniBand All N1.6-M6G1 Switch 1 6 Yellow Module 6 G1 Yellow
InfiniBand All N1.7-M7G1 Switch 1 7 Yellow Module 7 G1 Yellow
InfiniBand All N1.8-M8G1 Switch 1 8 Yellow Module 8 G1 Yellow
InfiniBand All N1.9-M9G1 Switch 1 9 Yellow Module 9 G1 Yellow
InfiniBand All N1.10-M10G1 Switch 1 10 Yellow Module 10 G1 Yellow
InfiniBand All N1.11-M11G1 Switch 1 11 Yellow Module 11 G1 Yellow
InfiniBand All N1.12-M12G1 Switch 1 12 Yellow Module 12 G1 Yellow
InfiniBand All N1.13-M13G1 Switch 1 13 Yellow Module 13 G1 Yellow
The following figure shows the rear view of the maintenance module.
388 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 53. Maintenance module cable connections for 1 Gb Ethernet configuration systems (continued)
From To
Supported
Cable type models Label Component Port Component Port Color
Power 281x-215 U1.3-CPWR Maintenance PWR Power-distribution 3 Blue
module unit 1
Ethernet All CA1-M4F3 Maintenance A1 Module 4 F3 Yellow
module
Ethernet All CA2-M3F3 Maintenance A2 Module 3 F3 Red
module
Ethernet All CC1-UMA1 Maintenance C1 Utility panel MA1 Purple
module
Ethernet All CC2-UMA2 Maintenance C2 Utility panel MA2 Purple
module
USB All C.USB1- Maintenance USB1 Modem USBR Black
M.USBR module
Table 54. Maintenance module cable connections for 10 Gb Ethernet configuration systems
From To
Supported
Cable type models Label Component Port Component Port Color
Power 281x-114, ATSP4-CPWR Maintenance PWR Automatic transfer P4 Black
281x-214, module switch
281x-216
Power 281x-215 U1.3-CPWR Maintenance PWR Power-distribution 3 Blue
module unit 1
RJ45 to USB 281x-214, CA1-M4USB2 Maintenance A1 Module 4 USB2 Black
281x-215 module
RJ45 to USB 281x-214, CA2-M3USB2 Maintenance A2 Module 3 USB2 Black
281x-215 module
Ethernet All CA1-M4F3 Maintenance A1 Module 4 F3 Yellow
module
Ethernet All CA2-M3F3 Maintenance A2 Module 3 F3 Red
module
Ethernet All CC1-UMA1 Maintenance C1 Utility panel MA1 Purple
module
Ethernet All CC2-UMA2 Maintenance C2 Utility panel MA2 Purple
module
USB All C.USB1- Maintenance USB1 Modem USBR Black
M.USBR module
xiv10148
10 Amp power sockets Serial port
(S1)
Power socket
1 2 3 4
xiv10235
5 6 7 8
The following table lists cable connections for uninterruptible power supply 3.
Table 55. Uninterruptible power supply 3 cable connections
From To
Connector Connector
Cable type Label Component Port color Component Port color
Power n/a Uninterruptible hard Black Automatic P3 Black
power supply 3 wired transfer switch
Power U3.1-M2P2/ Uninterruptible 1 Red Module 2 P2 Red
M1P2 power supply 3
Module 1 P2 Red
Power U3.2-M5P2/ Uninterruptible 2 Red Module 5 P2 Red
M4P2 power supply 3
Module 4 P2 Red
Power U3.3-M8P2/ Uninterruptible 3 Red Module 8 P2 Red
M7P2 power supply 3
Module 7 P2 Red
Power U3.4-M11P2/ Uninterruptible 4 Red Module 11 P2 Red
M10P2 power supply 3
Module 10 P2 Red
Power U3.5-M14P2/ Uninterruptible 5 Red Module 14 P2 Red
M13P2 power supply 3
Module 13 P2 Red
390 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 55. Uninterruptible power supply 3 cable connections (continued)
From To
Connector Connector
Cable type Label Component Port color Component Port color
Power U3.6-N2P2 Uninterruptible 6 Red InfiniBand P2 Red
power supply 3 switch 2
Power U3.7-N1P2 Uninterruptible 7 Red InfiniBand P2 Red
power supply 3 switch 1
Unused Uninterruptible 8
power supply 3
Serial (DB9 U3S1-M6USB1 Uninterruptible S1 Black Module 6 USB1 Black
to USB power supply 3
Sensor ATSX807- Uninterruptible Output Blue Automatic X807 Green
U3OUTPUT power supply 3 transfer switch
Ethernet U3N1-M3F4 Uninterruptible N1 Red Module 3 F4 Red
power supply 3
xiv10235
5 6 7 8
The following table lists cable connections for uninterruptible power supply 2.
Table 56. Uninterruptible power supply 2 cable connections
From To
Connector Connector
Cable type Label Component Port color Component Port color
Power n/a Uninterruptible hard Black Automatic P2 Black
power supply 2 wired transfer switch
Power U2.1-M3P2/ Uninterruptible 1 Yellow Module 3 P2 Yellow
M1P1 power supply 2
Module 1 P1 Yellow
Power U2.2-M6P2/ Uninterruptible 2 Yellow Module 6 P2 Yellow
M4P1 power supply 2
Module 4 P1 Yellow
Power U2.3-M9P2/ Uninterruptible 3 Yellow Module 9 P2 Yellow
M7P1 power supply 2
Module 7 P1 Yellow
Power U2.4-M12P2/ Uninterruptible 4 Yellow Module 12 P2 Yellow
U2.4- M10P1 power supply 2
Module 10 P1 Yellow
Power U2.5-M15P2/ Uninterruptible 5 Yellow Module 15 P2 Yellow
M13P1 power supply 2
Module 13 P1 Yellow
Power U2.6-N2P1 Uninterruptible 6 Yellow InfiniBand P1 Yellow
power supply 2 switch 2
Unused Uninterruptible 7
power supply 2
Unused Uninterruptible 8
power supply 2
Serial (DB9 U2S1-M5USB1 Uninterruptible S1 Black Module 5 USB1 Black
to USB power supply 2
Unused Uninterruptible Output
power supply 2
Ethernet U2N1-M2F4 Uninterruptible N1 Yellow Module 2 F4 Yellow
power supply 2
392 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
power sockets.
xiv10146
10 Amp power sockets Serial port
(S1)
Power socket
1 2 3 4
xiv10235
5 6 7 8
The following table lists cable connections for uninterruptible power supply 1.
Table 57. Uninterruptible power supply 1 cable connections
From To
Connector Connector
Cable type Label Component Port color Component Port color
Power n/a Uninterruptible hard Black Automatic P1 Black
power supply 1 wired transfer switch
Power U1.1-M3P1/ Uninterruptible 1 Green Module 3 P1 Green
M2P1 power supply 1
Module 2 P1 Green
Power U1.2-M6P1/ Uninterruptible 2 Green Module 6 P1 Green
M5P1 power supply 1
Module 5 P1 Green
Power U1.4-M12P1/ Uninterruptible 4 Green Module 12 P1 Green
M11P1 power supply 1
Module 8 P1 Green
Power U1.3-M9P1/ Uninterruptible 3 Green Module 9 P1 Green
M8P1 power supply 1
Module 11 P1 Green
Power U1.5-M15P1/ Uninterruptible 5 Green Module 15 P1 Green
M14P1 power supply 1
Module 14 P1 Green
Figure 339 on page 395 shows the side view of the automatic transfer switch. Each
cable connector and power socket is color-coded to match the color of the cable
end.
394 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
J2 line cord J1 line cord
Maintenance
Maintenance module
module
circuit breaker
power cord
Power output
LED
P3 F3
Uninterruptible
power supply Uninterruptible
power cord P2 F2 power supply
sockets circuit breakers
F1
P1
xiv10213
ac-sensor cable ac-sensor cable
LS port (X807) COMM port (X801)
The following table lists cable connections for the automatic transfer switch.
Table 58. Automatic transfer switch cable connections
From To
Connector Connector
Cable type Label Component Port color Component Port color
Main power n/a ATS J1 Black Customer power A Black
circuit
Main power n/a ATS J2 Black Customer power B Black
circuit
Power n/a ATS P1 Black Uninterruptible Hard Black
power supply 1 wired
Power n/a ATS P2 Black Uninterruptible Hard Black
power supply 2 wired
Power n/a ATS P3 Black Uninterruptible Hard Black
power supply 3 wired
Power ATSP4-CPWR ATS P4 Black Maintenance PWR Black
module
Power Unused ATS P5
Power Unused ATS P6
The following figure shows the PDUs at the rear of the rack. PDU 1 is on the left
and is used for power cables with blue connectors. PDU 2 is on the right, and is
used for power cables with red connectors. Each cable connector and power socket
is color-coded to match the color of the cable end. Not all ports in the PDUs are
used.
396 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
36
30
35
29
PDU2 34
PDU1 28
33
27
32
26
31
25
Phase 3
24
18
23
17
22
16
21
15
20
14
Phase 2
19
13
12
6
11
5
Phase 1 10
4
9
3
8
2
7
1
xiv10425
398 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 60. Power-distribution-unit cable connections (continued).
From To
Connector Connector
Cable type Label Component Port color Component Port color
Power U1.3-CPWR PDU 1 3 Red Maintenance PWR Red
module
System cables connect to the rear of the patch panel. Customer cables connect to
the front of the patch panel.
The following figure shows port connections on the utility patch panel.
RMM
M 1
A
I RMM
N
T 2
Spare
Module 3
M 1
A
N Module 2
A
G 2
E
M
E Module 1
N
T 3
Module 3
1
V
P Module 1
N
2
Module 3
1
T
E
C Module 2
H
2
Modem
xiv10088
System cables connect to the rear of the patch panel. Customer cables connect to
the front of the patch panel.
Module
1 1
F
I
B
R 2 2
E i
S
C C
H S
A 3 I 3
N
N
E
xiv10087
L 4 4
Figure 341. Host-connections patch panel with Fibre Channel and 1 Gb Ethernet iSCSI ports
400 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Patch panel 6 (P6)
Table 62. Patch panel 6 cable connections
From To
Connector Connector
Cable type Label Component Port color Component Port color
Fibre P6FM9.1-M9D1 Patch panel 6 F1 White Module 9 D1 White
Channel
Fibre P6FM9.2-M9D2 Patch panel 6 F2 White Module 9 D2 White
Channel
Fibre P6FM9.3-M9E1 Patch panel 6 F3 White Module 9 E1 White
Channel
Fibre P6FM9.4-M9E2 Patch panel 6 F4 White Module 9 E2 White
Channel
Ethernet P6M9.1-M9F1 Patch panel 6 1 Purple Module 9 F1 Purple
Ethernet P6M9.2-M9F2 Patch panel 6 2 Purple Module 9 F2 Purple
Ethernet P6M9.3-M9F3 Patch panel 6 3 Purple Module 9 F3 Purple
Ethernet P6M9.4-M9F4 Patch panel 6 4 Purple Module 9 F4 Purple
402 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 66. Patch panel 2 cable connections (continued)
From To
Connector Connector
Cable type Label Component Port color Component Port color
Ethernet P2M5.2-M5F2 Patch panel 2 2 Purple Module 5 F2 Purple
Ethernet P2M5.3-M5F3 Patch panel 2 3 Purple Module 5 F3 Purple
Ethernet P2M5.4-M5F4 Patch panel 2 4 Purple Module 5 F4 Purple
System cables connect to the rear of the patch panel. Customer cables connect to
the front of the patch panel.
1
F
I
B
R 2 1 1
E 0
C G
H b
A 3 E 2
N
N
E
xiv10424
L 4
Figure 342. Host-connections patch panel with Fibre Channel and 10 Gb Ethernet iSCSI
ports
404 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Table 69. Patch panel 5 cable connections (continued)
From To
Connector Connector
Cable type Label Component Port color Component Port color
10 Gb P5EM8.2-M8F2 Patch panel 5 E2 White Module 8 F2 White
Ethernet
406 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
MOD port
xiv10166
The following table lists the cable connections for the modem.
Table 74. Modem cable connection
From To
Connector Connector
Cable type Label Component Port color Component Port color
Telephone CMOD-UMOD Modem MOD Black Utility panel Modem Black
USB to USB Modem USBR Black Maintenance mUSB Black
module
Figure 344 on page 408 shows the inside view of the rack front door where the
logo LED is located.
xiv10214
Figure 344. Front-door logo LED cable
The following table lists the cable connection for the front-door logo LED.
Table 75. Front-door logo LED cable connection
From To
Supported
Cable type models Label Component Port Color Component Port Color
Power Model CRV.LED- Front door logo LED Black Module 5 mUSB Black
281x-114, M5.mUSB LED
281x-214
(see note)
Note: This cable might be disconnected for XIV systems running code V11.2.x and later. If this cable is not
connected in the XIV system that you are servicing, do not reconnect it.
408 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Notices
The legal notices pertain to IBM XIV Storage System documentation.
This information was developed for products and services offered in the U.S.A.
IBM may not offer the products, services, or features discussed in this document in
other countries. Consult your local IBM representative for information on the
products and services currently available in your area. Any reference to an IBM
product, program, or service is not intended to state or imply that only that IBM
product, program, or service may be used. Any functionally equivalent product,
program, or service that does not infringe any IBM intellectual property right may
be used instead. However, it is the user's responsibility to evaluate and verify the
operation of any non-IBM product, program, or service.
IBM may have patents or pending patent applications covering subject matter
described in this document. The furnishing of this document does not grant you
any license to these patents. You can send license inquiries, in writing, to:
The following paragraph does not apply to the United Kingdom or any other
country where such provisions are inconsistent with local law:
INTERNATIONAL BUSINESS MACHINES CORPORATION PROVIDES THIS
PUBLICATION "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER
EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS
FOR A PARTICULAR PURPOSE. Some states do not allow disclaimer of express or
implied warranties in certain transactions, therefore, this statement may not apply
to you.
Any references in this information to non-IBM Web sites are provided for
convenience only and do not in any manner serve as an endorsement of those Web
sites. The materials at those Web sites are not part of the materials for this IBM
product and use of those Web sites is at your own risk.
IBM may use or distribute any of the information you supply in any way it
believes appropriate without incurring any obligation to you.
All statements regarding IBM's future direction or intent are subject to change or
withdrawal without notice, and represent goals and objectives only.
All IBM prices shown are IBM's suggested retail prices, are current and are subject
to change without notice. Dealer prices may vary.
This information is for planning purposes only. The information herein is subject to
change before the products described become available.
This information contains examples of data and reports used in daily business
operations. To illustrate them as completely as possible, the examples include the
names of individuals, companies, brands, and products. All of these names are
fictitious and any similarity to the names and addresses used by an actual business
enterprise is entirely coincidental.
If you are viewing this information softcopy, the photographs and color
illustrations may not appear.
Trademarks
IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of
International Business Machines Corp., registered in many jurisdictions worldwide.
Other product and service names might be trademarks of IBM or other companies.
A current list of IBM trademarks is available on the web at Copyright and
trademark information at www.ibm.com/legal/copytrade.shtml.
Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered
trademarks or trademarks of Adobe Systems Incorporated in the United States,
and/or other countries.
Intel and Intel Xeon are trademarks or registered trademarks of Intel Corporation
or its subsidiaries in the United States and other countries.
Java and all Java-based trademarks and logos are trademarks or registered
trademarks of Oracle and/or its affiliates.
Homologation statement
This product may not be certified in your country for connection by any means
whatsoever to interfaces of public telecommunications networks. Further
certification may be required by law prior to making any such connection. Contact
an IBM representative or reseller for any questions.
410 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Glossary
This glossary includes terms and definitions for IBM XIV Storage System.
412 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
event A user or system activity that is logged data. A fully populated rack has six
(with an appropriate message). interface data modules.
host A port name of a host that can connect to
F the system. The system supports Fibre
fabric The hardware that connects workstations Channel and iSCSI hosts.
and servers to storage devices in a SAN.
The SAN fabric enables I
any-server-to-any-storage device
I/O input/output.
connectivity through the use of Fibre
Channel switching technology. image snapshot
A snapshot that has never been unlocked.
FC-AL Also known as arbitrated loop. A Fibre
It is the exact image of the master volume
Channel topology that requires no Fibre
it was copied from, at the time of its
Channel switches. Devices are connected
creation. See also snapshot.
in a one-way loop fashion.
interactive mode
FC-HBA
A means of entering XCLI commands on
Fibre Channel host bus adapter.
the XCLI client in which the IP address,
FC See Fibre Channel. user, and password information does not
need to be specified for each command.
Fibre Channel
Serial data transfer architecture developed Internet Protocol
by a consortium of computer and mass Specifies the format of packets (also called
storage device manufacturers and now datagrams), and their addressing schemes.
being standardized by ANSI. See also Transmission Control Protocol
(TCP).
functional area
One of the high-level groupings of icons IOPs input/output (I/O) per second.
(functional modules) of the left pane in
IP See Internet Protocol.
the IBM XIV Storage Management GUI
screen (for example, Monitor, iSCSI Internet SCSI. An IP-based standard for
Configuration, or Volume management). linking data storage devices over a
See functional module. network and transferring data by carrying
SCSI commands over IP networks.
functional module
One of the icons of a functional area, on
L
the left pane in the IBM XIV Storage
Management GUI screen. For example, latency
System (under Monitor) or Hosts and Amount of time delay between the
LUNs (under Configuration). See moment an operation is issued, and the
functional area. moment it is committed.
LDAP Lightweight Directory Access Protocol.
G
LDAP attribute
Graphical user interface (GUI)
A property of an LDAP object, with a
On-screen user interface supported by a
single or multiple values. A special object
mouse and a keyboard.
attribute is designated by an LDAP
GUI See graphical user interface (GUI). administrator to hold user group
memberships values corresponding to
H XIV roles.
H/W Hardware. LDAP authentication
A method for authenticating users by
HBA Host bus adapter.
validating the submitted credentials
host interface module against data stored on an LDAP directory.
The interface data module serves external
host requests with the ability to store
Glossary 413
LDAP directory multipathing
A hierarchical database stored on an Used for direct access from host-interface
LDAP server and accessed through LDAP modules to any volume.
calls.
P
LDAP server
A server that provides directory services peer Denotes a constituent side of a coupling.
through LDAP. Whenever a coupling is defined, a
designation is specified for each peer -
LDAP status
one peer is designated primary and the
The status of an LDAP server.
other is designated secondary.
load balancing
pool See storage pool.
Even distribution of load across all
components of the system. primary volume
A volume that is mirrored for backup on
locking
a remote storage system.
Setting a volume (or snapshot) as
unwritable (read-only).
R
LUN map
rack The cabinet that stores all of the hardware
A table showing the mappings of the
components of the system.
volumes to the LUNs.
remote mirroring
LUN Logical unit number. Exports a systems
The process of replicating a volume on a
volume into a registered host.
remote system.
M remote target connectivity
A definition of connectivity between a
main-power cable
port set of a remote target and a module
The electrical connection between the ac
on the local storage system.
power source and the automatic transfer
switch (ATS). remote target
An additional storage system used for
mandatory mode
mirroring, data migration, and so on.
A mode of remote mirroring in which I/O
operation stops whenever there is no role The actual role that the peer is fulfilling
communication to the secondary volume. as a result of a specific condition, either a
master or a subordinate.
master volume
A volume that has snapshots is called the rule See event notification rule.
master volume of its snapshots.
S
MIB Management Information Base. A
database of objects that can be monitored SAN Storage area network.
by a network management system. SNMP
SCSI Small computer system interface.
managers use standardized MIB formats
to monitor SNMP agents. secondary volume
A volume that serves as a backup of a
Microsoft Active Directory
primary volume.
See Active Directory
Simple Network Monitor Protocol
mirror volume
A protocol for monitoring network
A volume that contains a backup copy of
devices. See also MIB, SNMP agent, SNMP
the original volume.
manager, SNMP trap.
mirroring
SMS gateway
See remote mirroring.
An external server that is used to send
modified State SMSs.
A snapshot state. A snapshot in modified
state can never be used for restoring its
master volume.
414 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
SMTP gateway thin provisioning
An external host that is used to relay The ability to define logical volume sizes
email messages through the SMTP that are much larger than the physical
protocol. capacity installed on the system.
snapshot set Transmission Control Protocol
The resulting set of synchronized Transmission Control Protocol (TCP) on
snapshots of a volume set in a consistency top of the Internet Protocol (IP)
group. See also consistency group, Volume establishes a virtual connection between a
set. destination and a source over which
streams of data can be exchanged. See
snapshot
also IP.
A point-in-time snapshot or copy of a
volume. See also image snapshot. trap See SNMP trap.
SNMP agent
U
A device that reports information through
the SNMP protocol to SNMP managers. unassociated volume
A volume that is not associated with a
SNMP manager
consistency group. See Consistency group.
A host that collects information from
SNMP agents through the SNMP protocol. uninterruptible power supply
Provides battery backup power for a
SNMP trap
determined time, so that the system can
An SNMP message sent from the SNMP
power down in a controlled manner, on
agent to the SNMP manager, where the
the occurrence of a lengthy power outage.
sending is initiated by the SNMP agent
and not as a response to a message sent
V
from the SNMP manager.
volume cloning
SNMP
Creating a snapshot from a volume.
See Simple Network Monitor Protocol.
volume set
snooze
A cluster of specific volumes in a
The process of sending recurring event
consistency group, for which snapshots
notifications until the events are cleared.
are taken simultaneously, thus, creating a
storage pool synchronized snapshot of all of them.
A reserved area of virtual disk space Snapshots of the volume set can be taken
serving the storage requirements of the into multiple snapshot sets of the specific
volumes. consistency group. See also Snapshot set,
Volume set.
Sync Job
A synchronization procedure run by the volume
master at specified user-defined intervals, A logical address space, having its data
entailing synchronization between the content stored on the systems disk drives.
master and the subordinate. A volume can be virtually any size as
long as the total allocated storage space of
synchronization
all volumes does not exceed the net
The process of making the primary
capacity of the system. A volume can be
volume and secondary volume identical
exported to an attached host through a
after a communication downtime or upon
LUN. A volume can be exported to
the initialization of the mirroring.
multiple hosts simultaneously. See also
Storage pool, Unassociated volume.
T
target See remote target. W
TCP/IP WWPN
See Transmission Control Protocol, Internet Worldwide port name
Protocol.
Glossary 415
X
XCLI IBM XIV command-line interface (XCLI)
command set. See command-line interface.
XCLI client
The system on which the XCLI command
is entered.
XCLI identification parameters
Parameters that identify the user issuing
the command and the XIV system (if any)
on which the command is to run. XCLI
identification parameters can be specified:
v By entering them at the beginning of an
interactive mode session
v In a configuration file
v When running a command in basic
mode
v When running a list of commands as a
batch
XCLI system command
An XCLI command that is sent to the XIV
system for processing.
XCLI utility command
An XCLI command that is issued on the
XCLI client. An XCLI utility command is
not sent to an XIV system for processing.
XCLI utility commands are used for
setting up configurations on the XCLI
client and for queries (for example, of
software version) that can be processed
on the client.
XDRP The disaster recovery program for the
XIV system – The remote mirror feature
of the XIV system.
XIV mapping
An association of data on the LDAP
server (a specific LDAP attribute) and
data on the XIV system. The mapping is
used to determine which access rights to
grant to an authenticated LDAP user.
416 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Index
A cable connections (continued)
upper data modules 10-15 361
detaching
return hose 295
about this document utility patch panel 399 supply hose 294
sending comments xxvi cables diagnostic tests
ac-sensor cables ac-sensor, replacing ATS to module running 323
field replaceable units 356 1 278 disconnecting
replacing from ATS to module 1 278 ac-sensor, replacing ATS to ATS-to-uninterruptible power-supply
replacing from ATS to uninterruptible uninterruptible power supply 3 276 power cables 190, 191
power supply 3 276 connecting 40 automatic transfer switch cables 218
air-purging hose, opening and disconnecting uninterruptible power uninterruptible power supply
closing 298 supply 193 cables 193
ATS-to-uninterruptible power-supply emergency power off 55 disk drive modules
power cables replacing 272 installing 39
disconnecting 190, 191 replacing Ethernet 273, 280 LEDs 325
attaching replacing Fibre Channel 280 removing 36
rack doors 44 replacing InfiniBand 275 replacing 123
rack tie-down kit 24 replacing module-to-module 273 status 325
rack to non-raised floor 24 replacing module-to-switch 274 documentation
rack to raised floor 28 replacing patch panel 280 improvement xxvi
return hose 295 replacing serial-to-USB 273, 274 downloading
supply hose 294 capacity 6 Technician Assistant tool 16, 119
automatic transfer switch 230, 247 checking draining
about main-power cable uninterruptible power supply battery heat exchanger 293
configurations 111 born date 207
cable connections 394 closing the air-purging hose 298
connecting cables 221
disconnecting cables 218
collecting
system logs 324
E
installing 221, 230, 247 earthquake resistance kit
comments, sending xxvi
LEDs 333 installing 23
component replacement 120
powering off 217 emergency power off
connecting
powering on 223 setting up 56
automatic transfer switch cables 221
removing 220 emergency power off cables 55
power cables 199, 201
replacing ac-sensor cable to module emergency power off switch 54
room emergency power off switch 56
1 278 environmental notices xiii, xvii
connecting cables 40
replacing ac-sensor cable to EPO 54
uninterruptible power supply 198
uninterruptible power supply 3 276 Ethernet cables
connecting water supply to the rear-door
replacing, on-concurrent 217 replacing patch-panel cables 280
heat exchanger 46
Ethernet ports, number of 7
connectivity 7
Ethernet switch
considerations
B emergency power off 54
LEDs 330
event 321
batteries, heavy equipment xvi
events 321
installing uninterruptible power safety
supply 198, 210 site preparation xvi
removing uninterruptible power site safety xvi
supply 194, 208 F
Fibre Channel
D replacing patch-panel cables 280
C data module
Fibre Channel ports, number of 7
field replaceable units
cable connections 182, 184 installing 137
ac-sensor cables 356
automatic transfer switch 394 removing 132
components 351
front door logo LED 407 removing batteries 311
Ethernet cable 355
host-connections patch panels 400, data modules
fiber optic cable kit 356
403 about 100
front door logo-LED cable 357
InfiniBand switches 384 cable connections for lower data
host-attachment cables 357
interface modules 4-9 368 modules 380
InfiniBand cables 356
lower data modules 1-3 380 cable connections for upper data
main-power cables 357
maintenance module 388 modules 361
modem cable 356
modem 406 installing 35
non-stocked components 360
power-distribution units 396 LEDs 326
non-stocked serial-to-USB-cables 355
rack cabling verification test 348 replacing 129
power cords 358
uninterruptible power supplies 389
418 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
P radio frequency identification device tag
replacing 303
replacing (continued)
InfiniBand switch cables 275
packing an XIV system 96 raised floor InfiniBand switch power-supply
patch panel 8 attaching rack to 28 units 173
replacing cables 280 reader feedback, sending xxvi InfiniBand switches 168
PDFs xxiii rear-door heat exchanger interface modules 145
ports See also heat exchanger maintenance module 177
management 11 connecting the water supply 46 modem 270
patch panel 8 filling with water 47 module-to-module cables 273
positioning the rack 20 removing and installing 291 module-to-switch cables 274
power cables repairing 349 patch-panel cables 280
connecting 199, 201 replacing 290 power cables 272
disconnecting 190, 191 recycling batteries power distribution unit 284
replacing 272 data module 311 uninterruptible power supply 281
replacing from power distribution interface module 311 rack doors 287
unit 284 maintenance module 305, 307 rack side panels 298
replacing from uninterruptible power related information xxiii rack top cover 285
supply 281 relocating radio frequency identification device
power distribution unit 281x-114 93 tag 303
replacing power cables 284 281x-214 93 rear-door heat exchanger 290
power-distribution units preparation for 93 ruggedized brace 302
cable connections 396 XIV system weight-reduced rack 94 serial-to-USB cables 274
powering off 317 Remote Support replacing 273
automatic transfer switch 217 Support Access Level 1 uninterruptible power supply 187
model 281x-215 318 removing uninterruptible power-supply
uninterruptible power supply 212 batteries, uninterruptible power network-management cards 212
powering on 313 supply 194, 208 replacing uninterruptible power-supply
281x-215 315 data module 132 batteries 206
281x-216 62 disk drive modules 36 return hose, attaching and detaching
automatic transfer switch 223 host-retention plate 296 return hose 295
model 281x-114 62 interface module 147 room emergency power off switch
model 281x-214 62 modem 270 connecting 56
model 281x-215 68 rack door 19, 288 ruggedized brace
uninterruptible power supply 203, rack side panels 19, 299 installing 303
215 rack top cover 20, 41, 286 removing 302
preparing the site xvi rear-door heat exchanger 291 replacing 302
processors, number of 7 ruggedized brace 302
protocols uninterruptible power supply 190,
management ports 11
publications xxiii
196
uninterruptible power-supply
S
purging air 296 safety
network-management card 214
environmental notices xiii
removing batteries
information labels xiii
data module 311
R interface module 311
laser xiv
notices xiii
rack maintenance module 305, 307
sending
attaching to non-raised floor 24 removing guide rails 177
comments xxvi
attaching to raised floor 28 Removing maintenance module 177,
serial-to-USB cables
leveling 22 178, 179
replacing module-to-switch 274
positioning 20 removing protective wrappings 22
service call
setting up 17 repairing
completing 128, 144, 160, 165, 172,
rack components 3 rear-door heat exchanger 290, 349
175, 187, 205, 211, 215, 225, 259, 269,
rack doors repairing a leak in the heat
271
attaching 44 exchanger 349
setting up
installing 51, 289 replacing
emergency power off circuit 56
removing 19, 288 ac-sensor cables, ATS to module
setting up the rack
rack migration 53, 54 1 278
model 281x-114 17
rack side panels ac-sensor cables, ATS to
model 281x-214 17
installing 34, 300 uninterruptible power supply 3 276
model 281x-215 53
removing 19, 299 automatic transfer switch,
model 281x-216 54
replacing 298 on-concurrent 217
shutdown
rack tie-down kit cables 272
system 321
attaching 24 data modules 129
site, preparing xvi
rack top cover disk drive modules 123
SSD cache 7
installing 21, 287 Ethernet 280
status
removing 20, 41, 286 Ethernet cables
disk drive modules 325
replacing 285 replacing 273
supply hose, attaching and detaching
Fibre Channel 280
supply hose 294
Index 419
Support Access Level
Remote Support 1
V
system logs verifying
collecting 324 system health 323
verifying the XIV system 70
VPN ports
patch panel 8
T
Technician Assistant tool
downloading 16, 119
technician ports 8
W
tests warnings 13, 116
diagnostic 323 water supply
thermal shutdown 321 connecting to the rear-door heat
tools 120 exchanger 46
trademarks 410 work flow 120
troubleshooting
techniques 323
tips 323 X
two-main-power-cable configuration, XCLI
about 111 install 15, 118
XIV system
packing 96
U relocating 93
unconnected cables relocatingmodel 281x-114
removing protective wrappings 22 weight-reduced rack 94
uninterruptible power supplies XIV system weight-reduced rack
cable connections 389 packing 96
installing 197 XIVTop
LEDs 332 install 15, 118
uninterruptible power supply
battery born date 207
connecting cables 198
disconnecting cables 193
disconnecting power cables 190, 191
installing 197
installing batteries 198, 210
powering off 212
powering on 203, 215
removing 190, 196
removing batteries 194, 208
repair 189
replace 189
replacing 187
replacing ac-sensor cables 276
replacing power cables 281
uninterruptible power-supply batteries
replacing 206
Uninterruptible power-supply batteries
about 110
uninterruptible power-supply
network-management card
installing 214
removing 214
uninterruptible power-supply
network-management cards
about 111
replacing 212
uninterruptible power-supply units
about emergency power off 54
updating
Technician Assistant tool 16, 119
upgrading XIV system code 88
utility patch panels
cable connections 399
420 IBM XIV Gen3 281x-11x and 281x-21x Installation and Service Guide
Printed in USA
GC27-3921-16