June 2014

IBM
High Availability for Power Systems

Steve Finnes finnes@us.ibm.com

Client Presentation
#powersystems, #powerlinux, #bigdata,
#IBMWatson, #OpenPOWER
 Software
Power Virtualization Management

+
Increase IT productivity and agility
Manage scalability without complexity

Security and Compliance  Designed for Big Data

Protect Virtual Workloads  Superior cloud economics
Maintain and Demonstrate Compliance  Open Innovation Platform

Avoid the Cost and Risk of Downtime

 Roadmap to continuous availability
 High availability systems and scaling

Virtualization without Limits AIX - The Future of UNIX

 Drive over 90% utilization Total Integration with i
 Dynamically scale per demand
Scalable Linux ready for x86
Consolidation

Open Virtualization for scale-out Linux Systems

 Exploit existing Linux admin skills & tools
 Consolidate scale-out Linux workloads

2 © 2014 IBM Corporation

 clustering solutions for high availability
Application

Application

 PowerHA enables 24x365 operational availability

 Provides automation for planned and unplanned outages
 Offers solutions covering simple data center to multiple-site configurations

© 2014 IBM Corporation

 PowerHA SystemMirror Cluster for i
Benefits:
 Automated Fallover
Redundant LAN
 Non disruptive upgrades PTFs
 Application Monitoring
 Implemented in SLIC
 Event / ERROR Notification
Server A Server B
 GUI, CL mgmt
Cluster
Configuration
Different Failure Types:
 IP Loss Detection
Redundant SAN  Loss of Storage
 Application Interruption
 Server Crash
 Loss of Power

Configuration Options
Storage Enclosure
 Active / Passive
 Mutual Takeover
4

© 2014 IBM Corporation

PowerHA basic concepts

Admin domain

(IASP)
aka (volume group)
Application data

 PowerHA SystemMirror creates and manages a shared storage cluster topology

– IASP volume group hosts the DB, IFS data
– Admin Domain manages the sysbas data
– Note that the foundational topology does not involve replication

© 2014 IBM Corporation

 for i
 Comprehensive HA/DR solutions for multi-site or data center
 Provides automation for ease of use
 Implemented in IBM i, SLIC, and storage management
 Data replication is provided by IBM storage
 FlashCopy enables off line tape backup
 Designed for regular role swap operations and automated failovers
 Developed and supported by IBM

6 © 2014 IBM Corporation

IBM i HA/DR Customer Profile

TRADITIONAL PowerHA

 Internal Disk  IBM Storage or (Internal Disk with geomirroring)

 Logical replication  Switchable LUNs, Metro or Global Mirroring
 CBU with multiple cores licensed for replication workload  CBU with only 1 core licensed
 Role-swap = seldom if ever  Role-swap = daily, weekly, monthly, quarterly
 Backup window = ranges up to a few hours  Backup window = minutes
 TCO = staffing, SWMA, upgrade charges,  TCO = minimal staffing, SWMA
 Staffing = dedicated specialist  Staffing = minutes/week
 Outage management = complex  Outage management = simple
 Support = vendor  Support = IBM

planning time for the

annual DR test
block your calendars

© 2014 IBM Corporation

PowerHA Business Value & Objectives
 Native embedded technology
– PowerHA technology is an integrated extension of SLIC and IBM I
– IBM service and support
 Provide IBM i clients with confidence & certainly of outcome
– PowerHA eliminates the classic logical replication dilemmas:
• Have we identified all of the objects that need to be replicated ?
• Are all of those objects in sync ?
• Should we or should we not failover ?
 ROI acquisition and cost of ownership
– PowerHA is priced per processor core
– CBU reduces total number of licenses required
– FlashCopy (save window elimination)
– Minimize operational expense through automation
 Enable best of breed performance and HA/DR metrics
– Provide HA/DR and application performance
– Exploit and integrate modern storage technology
– Eliminate single points of failure
– Enable RPO of 0 and best case RTO

© 2014 IBM Corporation

Operational Simplicity – Actual Customer Scenario

Step Time (mins) Headcount Person mins PowerHA/DS8k/Metro Mirror Steps

1 0 0 0 Target replication Vg (IASP) is in sync

2 10 1 10 Quiesce app, vary off primary Vg

3 5 0 0 Fall-over & reverse replication from DR

site to primary site
4 5 0 0 Vary on application Vg, IP take over

0 0 0 0 Check job logs (no longer necessary)

6 10 1 10 Start application environment and

validate everything is up and running
7 0 0 0 Start production

Elapsed Time 30 mins 1 20 (fail back => go to step 1)

 Vary-on times dependent on database characteristics

 Typical roll swap scenarios don’t role back to primary immediately
 PowerHA cluster conducts operations, IT personal role is primarily monitoring
 Advance copy services with PowerHA minimizes storage/cluster management

© 2014 IBM Corporation

PowerHA on i and CBU cost savings example…U.S. only…

PowerHA consumes
only one core therefore
1 IBM i and 1PowerHA

 PowerHA is priced per processor core used in the HA/DR cluster

 Unlike Logical Replication…PowerHA consumes only one core (storage is doing the work)
 Taking advantage of the CBU topology in the example topology:
– Assume a three system 770 cluster, 7 iOS and 7 PowerHA
– PowerHA price: 5,000/core = $35,000…..$75,000 - $35,000 = savings: $40,000
– IBM i price: 59,000/core = $413,000 ….. $885,000 - $ 413,000 = savings: $472,000

Total savings….$512,000

© 2014 IBM Corporation

ELIMINATE the backup window with FlashCopy and BRMS

IASP

Prod LPAR FlashCopy

IASP

FlashCopy LPAR

BRMS

 FlashCopy with PowerHA essentially eliminates your backup window

 Full system flash copy is also an option though not as seamless as with IASPs
 Integrated with BRMS, this solution enables end to end automated backups
© 2014 IBM Corporation
PowerHA V7.2 universal FlashCopy target partition
FlashCopy
targets

IASP Production cluster 1

Target IASP Production cluster 2

Partition
Tape Backup

IASP Production cluster 3

Enables use of one partition to save multiple production environments

Allows attachment of an IASP to a partition not in the cluster device domain
Only one IASP can be attached to the partition at a time
Eliminate dedicated flash partitions per cluster

© 2014 IBM Corporation

Two-site solution for storage, HA/DR & automated tape backups

PowerHA Metro Mirror Cluster (or Global Mirror)

TS3500
Metro
Mirror
IASP IASP
BRMS

IASP

Site A Site B

V3700, V5000,V7000, SVC, DS8000

 HA/DR with Metro Mirror (or Global Mirror, or Switchable LUNs or all of them combined)
 Backup window elimination save automation with FlashCopy and BRMS

© 2014 IBM Corporation

Classic three system two-site PowerHA cluster

 PowerHA SystemMirror Enterprise Edition

– Provides RPO of zero and a remote location in a single cluster
 DS8K,SVC, Storwize V7000, V5000, V3700
– FlashCopy (ACS available from Lab Services)
– Metro Mirror, Global Mirror
– LUN level switching

© 2014 IBM Corporation

(MGM) Metro Mirror Global Mirror three site cluster – DS8000

PowerHA Metro-Global Mirror Cluster

IASP
IASP IASP Flash-
Global Copy
Metro
Mirror in GM
Mirror IASP

Site A Site B Remote site

© 2014 IBM Corporation
PowerHA SVC stretch cluster
Virtual
Virtual
switchable
switchable
Site
Site A
A Site B LUNs
LUNs

San
San Switch
Switch San Switch
Quorum Disk

SVC SVC

Storewize V7000 Storewize V7000

Mirrored Volumes

 PowerHA Standard Edition (appears as a switchable LUN cluster)

 Site A and Site B volumes are mirrored by the SVC (under the covers)
 Solution provides cross-campus continuously available storage in a PowerHA cluster

© 2014 IBM Corporation

 SystemMirror for i V7.2
 Minimize planned and unplanned outages in the data center
 Provide multi-site solutions for disaster recovery
 Tightly integrated with IBM i for robust operations
 Fault tolerant storage configurations with HyperSwap
 Comprehensive HA/DR with IBM Storage Copy Services

Announce – 4/28 GA – 5/5

Integrate and automate
HA/DR operations with • Single-node HyperSwap for cross-campus fault tolerant storage
IBM storage
• UID/GID post failover auto merge
Eliminate Storage
outages with HyperSwap • Admin Domain increased to 45,000 objects

Minimize cost with the • Object authority/ownership post fail over auto-sync
CBU for i
• Independent ASP Assignment; many to one FlashCopy operations
Simple, low cost
replication with • NEW - PowerHA Express Edition for i provides full system
Geographic Mirroring HyperSwap for continuously available storage

17 © 2014 IBM Corporation

PowerHA SystemMirror for i Express Edition

 The Express Edition is all about partition restart based HA/DR solutions
– Non clustered (ie non IASP) configurations
– Switchable VIOS/LUN configurations or replicated partition configurations
– Restore primary partition or partitions to second partition or partitions via reboot (IPL)

 Initial release (7.2) provides support for DS8000 with single partition/system HyperSwap
– Provides continuously available storage servers
– No downtime is associated with a HyperSwap switch (no IPL processing)

– Once configured, HyperSwap switch will occur automatically in the event of a storage
outage

– HyperSwap switch can be triggered manually via the Change HyperSwap Status
(CHGHYSSTS) command

– Can be combined with LPM

– Affinity between a partition and a storage server can be defined via the Add HyperSwap
Storage Description (ADDHYSSTGD) command

© 2014 IBM Corporation

 PowerHA SystemMirror 7.2 for i

PowerHA SystemMirror for IBM i Express Edition Standard Edition Enterprise Edition

Offering Focus Data Center CEC HA (per core) Data Center App HA (per core) Multi Site HA/DR (per core)

Small Tier
$2,000 $2,500 $3,250
Blade & Entry Power

Medium Tier
Scale

$2,800 $3,500 $5,000

Mid-range Power

Large Tier
$3,600 $4,500 $6,500
Enterprise Servers

US list prices for example only, prices vary by geo

 5770 HAS Base PID – no keys, no function

 Express Edition data simple center solution

– PID 57770 HAS
– Option 3
 Standard Edition data center solution
– PID 5770 HAS
– Option 2
 Enterprise Edition multi-site solution
– PID 5770 HAS
– Option 1

© 2014 IBM Corporation

PowerHA clustering vs partition restart technology
Cluster based HA/DR
– LUN Level Switching, Metro Mirror, Global Mirror, geomirror
– IASPs and Admin Domain data structure
– Event monitoring PROD (source) HA/DR (target)

– Automated failover processing Production PowerHA Target

LPAR LPAR
– FlashCopy for off-line backups
– Comprehensive HA/DR
IASP Network IASP
Ext. Storage Ext. Storage

Full System or partition restart based HA/DR

− Single operating system PROD (source) HA/DR (target)

− Remote restart is an IPL

LPAR LPAR
− Current methods are manual
− Lab services has an option for the DS8K

Network

Ext. Storage Ext. Storage

20
© 2014 IBM Corporation
PowerHA – geomirroring – HA/DR clustering

Admin Domain
Sysbas
Sysbas

production partition target partition

IASP IASP

geomirror
DB2, IFS DB2, IFS

 PowerHA geomirror cluster (typically with internal disk < 2 tbytes configurations)
 Complete HA/DR coverage for all outage types (hardware, middleware, operator error)
 Off line back-up followed by source side /target side tracking change resynchronization
 Synchronous mode up to 40 KM, production and target always identical
 Asynchronous mode unlimited distance, production and target ordered and consistent

© 2014 IBM Corporation

PowerHA – geomirroring – i hosting i remote partition restart for DR

i host partition i host partition

Admin domain*
Applications
Applications
IASP IASP
NWSSTG NWSSTG
client client
IBM i geomirror IBM i
partition hosted hosted partition
partition partition

* Admin Domain on host is optional

 IBM client placed into a network storage space which is placed into an IASP
 Guest and host partition must be shut down before remote host and client can be restarted
 Benefit: easy to set up (in production world wide today, Express Edition not required)
 Limitation: no heart beating, can’t do concurrent OS upgrades
 Unplanned failover requires an abnormal IPL of target

© 2014 IBM Corporation

 One Node HyperSwap PowerHA i 7.2 (stage 1)
 One Node HyperSwap
– Configure a single IBM i LPAR for HyperSwap
– No need for compute node on the second site
– Full LPAR (non IASP based)

 Hybrid deployment:
– PowerHA Clusters
– Single Node LPARs

Site 1 Site 2
L1 L2 N1 N2 N3 N4
Cluster
LPAR LPAR
nodes
1 2
Primary DS8K Secondary DS8K
Site 1 Site 2

Legend:
Active Path S1 S2
Passive Path

© 2014 IBM Corporation

PowerHA HyperSwap clustering technology (V7.2 stage 2 plans*)

Applications halts while cluster switches Applications continue to use the IASP
– Storage resumes after cluster switch – Storage switched via SLIC

Application
Application

PowerHA Enterprise Edition

PowerHA Enterprise Edition

IASP

IASP 1 IASP 2

SLIC

Metro Mirror
Metro Mirror

Primary DS8K Secondary DS8K

Primary DS8K Secondary DS8K

Traditional Metro Mirror Cluster HyperSwap Cluster

© 2014 IBM Corporation *plans subject to change

PowerHA V7.2 cluster with HyperSwap (stage 2 plans)

Production

Primary Storage Server Secondary Storage Server

– Provides continuously available storage within a PowerHA Enterprise Edition cluster

– PowerHA cluster manages failover process between production servers
– HyperSwap manages storage switching

© 2014 IBM Corporation

 (MGM) HyperSwap three site cluster – DS8000 (stage 2 plans)

PowerHA Metro-Global Mirror Cluster

HyperSwap

IASP
IASP IASP Flash-
Global Copy
Metro
Mirror in GM
Mirror IASP

Site A Site B Remote site

© 2014 IBM Corporation
IBM Confidential
IBM i CBU with PowerHA Voucher

 CBU + PowerHA SystemMirror 7.1 for IBM i

– Sell them together
– Three days of services included
– Fast start to better business continuity

Don’t forget about PowerCare

© 2014 IBM Corporation

 PowerHA Tools for IBM i – Lab Services

*DS8000 support available with PowerHA Tools for IBM i 6.1 or earlier, included in PowerHA SystemMirror 7.1 **V7000 support included with PowerHA 7.1 TR6

28
© 2014 IBM Corporation
 IBM Lab Services Offerings for PowerHA for IBM i
PowerHA Service Offering Description
IBM i High Availability Architecture An experienced IBM i consultant will conduct a planning and design
and Design Workshop workshop to review solutions and alternatives to meet HA/DR and
backup/recovery requirements. The consultant will provide an architecture
and implementation plan to meet these requirements.
PowerHA for IBM i Bandwidth Analysis An experienced IBM i consultant will review network bandwidth requirements
for implementing storage data replication. IBM will review I/O data patterns
and provide a bandwidth estimate to build into the business and project plan
for clients deploying PowerHA for IBM i.
IBM i Independent Auxiliary Storage Pool An experienced IBM i consultant will provide jumpstart services for migrating
(IASP) Workshop applications into an IASP. Training includes enabling applications for
IASPs, clustering techniques, plus managing PowerHA and HA/DR solution
options with IASPs.
PowerHA for IBM i Implementation Services An experienced IBM consultant will provide services to implement an HA/DR
solution for IBM Power Systems servers with IBM Storage. Depending on
specific business requirements, the end-to-end solution implementation may
include a combination of PowerHA for IBM i and/or PowerHA Tools for IBM i,
plus appropriate storage software such as Metro Mirror, Global Mirror and/or
Flashcopy.

For more information on PowerHA Tools for IBM i offerings and services,
contact: Mark Even even@us.ibm.com 507-253-1313

www.ibm.com/systems/services/labservices stgls@us.ibm.com

29 © 2014 IBM Corporation

 Additional resources for PowerHA IBM i

 PowerHA Wiki
– www.ibm.com/developerworks/ibmi/ha/

 Lab Services
– http://www-03.ibm.com/systems/services/labservices

 PowerCare
– http://www-03.ibm.com/systems/power/support/powercare/

 Redbooks at www.redbooks.ibm.com
– Implementing PowerHA for IBM i - SG24-7405-00 (Nov 2008)
– IBM i 6.1 Independent ASPs - SG24-7811-00
– PowerHA SystemMirror for IBM i Cookbook – SG24-7994-00 (Jan 2012)
– 'IBM i and IBM Storwize Family: A Practical Guide to Usage Scenarios'.
SG248197http://www.redbooks.ibm.com/redpieces/pdfs/sg248197.pdf
 IBM System Storage Solutions for IBM i
– Course code: AS930
– Duration: 4.0 days
– www-304.ibm.com/jct03001c/services/learning/ites.wss/us/en?pageType=course_description&courseCode=AS930

 High Availability Clusters (Power HA) and Independent Disk Pools for IBM i
– Course code: AS541
– Duration: 4.0 days
– www-304.ibm.com/jct03001c/services/learning/ites.wss/us/en?pageType=course_description&courseCode=AS541

© 2014 IBM Corporation

 Thank you

31
Special notices
This document was developed for IBM offerings in the United States as of the date of publication. IBM may not make these offerings available in
other countries, and the information is subject to change without notice. Consult your local IBM business contact for information on the IBM
offerings available in your area.
Information in this document concerning non-IBM products was obtained from the suppliers of these products or other public sources. Questions
on the capabilities of non-IBM products should be addressed to the suppliers of those products.
IBM may have patents or pending patent applications covering subject matter in this document. The furnishing of this document does not give
you any license to these patents. Send license inquires, in writing, to IBM Director of Licensing, IBM Corporation, New Castle Drive, Armonk, NY
10504-1785 USA.
All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives
only.
The information contained in this document has not been submitted to any formal IBM test and is provided "AS IS" with no warranties or
guarantees either expressed or implied.
All examples cited or described in this document are presented as illustrations of the manner in which some IBM products can be used and the
results that may be achieved. Actual environmental costs and performance characteristics will vary depending on individual client configurations
and conditions.
IBM Global Financing offerings are provided through IBM Credit Corporation in the United States and other IBM subsidiaries and divisions
worldwide to qualified commercial and government clients. Rates are based on a client's credit rating, financing terms, offering type, equipment
type and options, and may vary by country. Other restrictions may apply. Rates and offerings are subject to change, extension or withdrawal
without notice.
IBM is not responsible for printing errors in this document that result in pricing or information inaccuracies.
All prices shown are IBM's United States suggested list prices and are subject to change without notice; reseller prices may vary.
IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply.
Any performance data contained in this document was determined in a controlled environment. Actual results may vary significantly and are
dependent on many factors including system hardware configuration and software design and configuration. Some measurements quoted in this
document may have been made on development-level systems. There is no guarantee these measurements will be the same on generally-
available systems. Some measurements quoted in this document may have been estimated through extrapolation. Users of this document
should verify the applicable data for their specific environment.

Revised September 26, 2006

© 2014 IBM Corporation

Special notices (cont.)
IBM, the IBM logo, ibm.com AIX, AIX (logo), AIX 5L, AIX 6 (logo), AS/400, BladeCenter, Blue Gene, ClusterProven, DB2, ESCON, i5/OS, i5/OS (logo), IBM Business
Partner (logo), IntelliStation, LoadLeveler, Lotus, Lotus Notes, Notes, Operating System/400, OS/400, PartnerLink, PartnerWorld, PowerPC, pSeries, Rational, RISC
System/6000, RS/6000, THINK, Tivoli, Tivoli (logo), Tivoli Management Environment, WebSphere, xSeries, z/OS, zSeries, Active Memory, Balanced Warehouse,
CacheFlow, Cool Blue, IBM Watson, IBM Systems Director VMControl, pureScale, TurboCore, Chiphopper, Cloudscape, DB2 Universal Database, DS4000, DS6000,
DS8000, EnergyScale, Enterprise Workload Manager, General Parallel File System, , GPFS, HACMP, HACMP/6000, HASM, IBM Systems Director Active Energy
Manager, iSeries, Micro-Partitioning, POWER, PowerLinux, PowerExecutive, PowerVM, PowerVM (logo), PowerHA, Power Architecture, Power Everywhere, Power
Family, POWER Hypervisor, Power Systems, Power Systems (logo), Power Systems Software, Power Systems Software (logo), POWER2, POWER3, POWER4,
POWER4+, POWER5, POWER5+, POWER6, POWER6+, POWER7, POWER7+, Systems, System i, System p, System p5, System Storage, System z, TME 10,
Workload Partitions Manager and X-Architecture are trademarks or registered trademarks of International Business Machines Corporation in the United States, other
countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols
indicate U.S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law
trademarks in other countries.

A full list of U.S. trademarks owned by IBM may be found at: http://www.ibm.com/legal/copytrade.shtml.

Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or
other countries.
AltiVec is a trademark of Freescale Semiconductor, Inc.
AMD Opteron is a trademark of Advanced Micro Devices, Inc.
InfiniBand, InfiniBand Trade Association and the InfiniBand design marks are trademarks and/or service marks of the InfiniBand Trade Association.
Intel, Intel logo, Intel Inside, Intel Inside logo, Intel Centrino, Intel Centrino logo, Celeron, Intel Xeon, Intel SpeedStep, Itanium, and Pentium are trademarks or registered
trademarks of Intel Corporation or its subsidiaries in the United States and other countries.
IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce.
Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.
Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries.
Linux is a registered trademark of Linus Torvalds in the United States, other countries or both.
PowerLinux™ uses the registered trademark Linux® pursuant to a sublicense from LMI, the exclusive licensee of Linus Torvalds, owner of the Linux® mark on a world-
wide basis.
Microsoft, Windows and the Windows logo are registered trademarks of Microsoft Corporation in the United States, other countries or both.
NetBench is a registered trademark of Ziff Davis Media in the United States, other countries or both.
SPECint, SPECfp, SPECjbb, SPECweb, SPECjAppServer, SPEC OMP, SPECviewperf, SPECapc, SPEChpc, SPECjvm, SPECmail, SPECimap and SPECsfs are
trademarks of the Standard Performance Evaluation Corp (SPEC).
The Power Architecture and Power.org wordmarks and the Power and Power.org logos and related marks are trademarks and service marks licensed by Power.org.
TPC-C and TPC-H are trademarks of the Transaction Performance Processing Council (TPPC).
UNIX is a registered trademark of The Open Group in the United States, other countries or both.

Other company, product and service names may be trademarks or service marks of others.

Revised November 28, 2012

© 2014 IBM Corporation POP03352-USEN-02