IBM Power Systems Power HA System Mirror for

IBM Power Systems Power. HA System. Mirror for AIX © 2011 IBM Corporation

Power Your Planet + Workload-Optimizing Systems AIX - The Future of UNIX Total Integration with i Scalable Linux ready for x 86 Consolidation Virtualization without Limits ü Drive over 90% utilization ü Dynamically scale per demand Dynamic Energy Optimization ü 70 -90% energy cost reduction ü Energy. Scale™ technologies Resiliency without Downtime ü Roadmap to continuous availability ü High availability systems & scaling Management with Automation ü VMControl to manage virtualization ü Automation to reduce task time Systems for a Smarter Planet 2 © 2011 IBM Corporation

Power. HA System. Mirror Power Systems High Availability Solution For mission critical application availability through planned and unplanned outage events Editions targeted at data center and/or multi-site deployments, value grows in feature and function with each new release Shared Storage Clustering Technology designed for automation and minimal IT operations. Deep Integration for simplicity and reliability 3 © 2011 IBM Corporation

Power. HA System. Mirror Strategy Deep Integration – Cluster Aware AIX – Kernel based event processing – Centralize cluster topology management Ease of deployment & ease of use – Systems Director based management – Discovery based deployment – Cluster wide security Multi-Site & Disaster Recovery – Differentiate with IBM storage – Heterogeneous storage support Solution Package Optimization – Standard Edition, Enterprise Editions 4 © 2011 IBM Corporation

Power. HA System. Mirror Editions Power. HA System. Mirror Standard Edition Cluster management for the data center – Monitors, detects and reacts to events – Establishes a heartbeat between the systems – Enables automatic switch-over IBM shared storage clustering – Can enable near-continuous application service – Minimize impact of planned & unplanned outages – Ease of use for HA operations Power. HA System. Mirror Enterprise Edition Cluster management for the Enterprise – Multi-site cluster management – Includes the Standard Edition function 5 © 2011 IBM Corporation

Client Need: Data Center – – 6 Requirements Near continuous application service Recovery Time Objective (RTO) measured in minutes Recovery Point Objective (RPO) is Zero (no data loss) Eliminate affects of planned outages Solution Strategy: – Power. HA System. Mirror Standard Edition © 2011 IBM Corporation

Client Need Today: Unified HA/DR Solution Requirements – HA/DR clustering for data center & multi-site operations – Automated role-swap operations – Readily demonstrate remote recoverability compliance Solution Strategy: – Unified clustering solution for data center & multi-site resiliency – Power. HA System. Mirror Enterprise Edition Remote Site Data Center 7 © 2011 IBM Corporation

Power. HA System. Mirror 7. 1 for AIX Standard Edition Power. HA AIX IT operations skill base ü AIX Technical skill support base ü AIX Shared Storage management ü AIX Volume manager/Mirroring ü AIX File System ü AIX SMIT Management Tools ü AIX Event/error management ü AIX DLPAR HA/DR management ü Application agents ü Power. HA skills are an extension AIX skills Director based user interface ü AIX Cluster Aware ü Kernel based event management ü WW IBM and BP community support Power. HA Centralized cluster repository ü Triple redundant multi-cast heartbeat ü SAN based communications ü HA coverage for root Vg storage ü Sap Live. Cache Hot Standby ü Federated Security ü Power. HA System. Mirror is differentiated by integration with AIX Cluster Aware Kernel based event management 9 © 2011 IBM Corporation

Power. HA System. Mirror 7. 1 for AIX – Key differences ■ Integration with Cluster Aware AIX ■ Heartbeat mechanism ■ Cluster Repository Disk ■ Cluster Command Line, clmgr ■ Systems Director Management Interface Let’s take a closer look at these differences… 10 © 2011 IBM Corporation

Deprecated features in v 7. 1 All non-IP network types – RS-232, diskhb, mndhb, TMSSA, TMSCSI IP Network types ATM, FDDI, Token Ring Non-ECVGs Hostname changes IPAT via replacement – HWAT Heartbeat over Aliasing Two-Node configuration assistant Web. SMIT – Online planning worksheets – Cluster configuration html report Additional Limitations – Site Support – Cross-site LVM mirroring – IPV 6 support – 16 -node tested cluster restriction as per the README 7. 1. 0. UPDATE 11 © 2011 IBM Corporation

Cluster Aware AIX AIX-Level Cluster – AIX functionality not Power. HA Provides cluster framework, heartbeating, disk fencing but no failover Available in AIX 6. 1 TL 6 and AIX 7. 1 - bos. cluster. * Power. HA 7. 1 hands over heartbeating (previously topology services) to CAA Cluster definition – on CAA Repository Disk Power. HA Cluster definition – in Power. HA ODM Different commands to query AIX and Power. HA cluster CAA Storage Framework replaces Power. HA non-IP network Also used by – VIOS SSP – DB 2 Pure. Scale 12 © 2011 IBM Corporation

Existing – without CAA © 2011 IBM Corporation

With CAA grpsvcs daemon now called cthags Topology services no longer used © 2011 IBM Corporation

Cluster Aware AIX - differences ■ ■ ■ 15 Repository disk – Minimum recommended size 10 GB – Does not store Power. HA cluster configuration – Requires 4 GB or 8 GB FC adapters – Documented procedure for changing repository disk – recommended to avoid by proper planning – Must be highly available / SAN RAIDed / Multipathed – 7. 1 does NOT support 3 rd party Multipath eg. Power. Path but 7. 1. 1 (Dec 11) adds support for EMC Power. Path and Hitachi HDLM Sites – Does not support sites Hostname – CAA requires hostname and nodename must be the same © 2011 IBM Corporation

Cluster Aware AIX – differences continued ■ 7. 1 Requires specific vg and lv naming to be available # lsvg -l caavg_private: LV NAME TYPE LPs PVs LV STATE MOUNT POINT caalv_private 1 boot 1 1 1 closed/ syncd N/A caalv_private 2 boot 1 1 1 closed/ syncd N/A caalv_private 3 boot 4 4 1 open/syncd N/A fslv 00 jfs 2 4 4 1 open/syncd /clrepos_private 1 fslv 01 jfs 2 4 4 1 closed/syncd /clrepos_private 2 powerha_crlv boot 1 1 1 closed/syncd N/A ■ 7. 1. 1 does NOT require specific vg and lv naming to be available as we no longer have repository disk filesystems # lsvg -l caavg_private: LV NAME TYPE LPs PVs LV STATE MOUNT POINT caalv_private 1 boot 1 1 1 closed/ syncd N/A caalv_private 2 boot 1 1 1 closed/ syncd N/A caalv_private 3 boot 4 4 1 open/ syncd N/A powerha_crlv boot 1 1 1 closed/ syncd N/A 16 © 2011 IBM Corporation

Cluster Aware AIX – differences continued ■ v. SCSI support issues for repository disk – – ■ 6. 1. 6/7. 1 does not check disk type 6. 1. 6 SP 1 checks and will not allow v. SCSI 6. 1. 6 SP 2 checks and verifies v. SCSI device is indeed SAN based NPIV / Fibre OK Uses multicast for monitoring – Requires infrastructure to allow forwarding multicast packets – Uses SRM (Scalable Reliable Multicast) – Can test using mping AIX command ■ Heartbeat rates are not tunable – No failure detection rate settings (FDR) – Completely different to heartbeat over IP used in previous versions ■ Uses internal algorithm to determine health – Does consider things like network/system load 17 © 2011 IBM Corporation

“Monitoring” in CAA Now in kernel space not user space – Higher priority, allows for messages to be sent from node experiencing extreme resource contention - no DMS SAN-based communication interface (SFWCOM) – Replaces disk heartbeat – Uses target mode on HBA – Also requires creation of VLAN 3358 to create sfwcom. X device documentation APAR IV 03643 (google finds it) CAA Repository Disk also used for monitoring, only if all else fails Monitoring is more advanced – many more stats – Self-adjusting algorithms take into account load and network conditions – Cannot adjust Failure Detection Rate Can see all of this in lscluster command 18 © 2011 IBM Corporation

Default Multi Channel Health Management: Simple Setup Multiple channels – – – Network SAN Central Repository First line of Defense Second line of Defense Network SAN Third line of Defense Heartbeats Cluster Repository Triple redundant communication pipe 19 © 2011 IBM Corporation

SMIT Menu updates smit hacmp (v 6. 1) HACMP for AIX Move cursor to desired item and press Enter. Initialization and Standard Configuration New fastpath: smit sysmirro smit sysmr Power. HA System. Mirror Move cursor to desired item and press Enter. Cluster Nodes and Networks Cluster Applications and Resources Extended Configuration System Management (C-SPOC) Problem Determination Tools Can't find what you are looking for ? Not sure where to start ? System Management (C-SPOC) Problem Determination Tools Custom Cluster Configuration Can't find what you are looking for ? Not sure where to start ? Fastpath hacmp is still valid 20 © 2011 IBM Corporation

User Defined Resources Presently, A user can introduce a new resource type by creating a Application Server. – Power. HA requires a start/stop/monitor for that resource This approach is not flexible for end users What’s new in the 7. 1 release – User develops “bundle” which includes attributes/verifications/order for Power. HA etc. – Framework accepts Methods to verify/start/stop/monitor/cleanup/restart the user defined resource – A xml file can be supplied as input which will be having definition for the user defined resource type – Power. HA allows to create instances of the user defined resource type and these instances can be added into RG as resources. 21 VOLUME GROUP Acquisition Order – Volume Groups will be handled first – Application Servers will be handled last. Release Order DISK However, Power. HA follows a strict pre-known order to handles the resources. FILE SYSTEM User Defined Resource SERVICE IP APPLICATION © 2011 IBM Corporation

New Dependencies ■ Previously, Power. HA supports only parent-child dependency among Resource Groups. – Child RG starts after all of its parents start – Child RG stops before its parents stop ■ Not sufficient to support complex applications like SAP/File. Net – File. Net App Server requires to be started only after database, but no need to be stopped if the DB is down for sometime ■ What’s new – Two new dependencies introduced in Power. HA 7. 1 • • STARTAFTER STOPAFTER – Affects how RG started or stopped (New) – Simplified UI for managing these relations in both SMIT and Director 22 © 2011 IBM Corporation

Dynamic Node Priority new Adaptive Fallover ■ Present Power. HA support static/dynamic failover policies – Static: New failover node will be the next node from the node participation list – Dynamic Node Priority : allows the failover node to be having certain degree of free CPU/memory/IO activity ■ This is not sufficient in some specific cases like SAP Enqueue replication, where RG for Enqueue server need to failover where Enqueue Replication is running. What’s new in 7. 1 – Introducing a new dynamic failover policy where, it asks user to supply a script which can dictate the failover behavior. • The supplied script will be executed on all nodes by Power. HA to know whether the given node can be used as host for failing over RG • Since it is a script, no of checks can be performed by user to let Power. HA know whether the node can be used as a host on a dynamic basis. The DNP feature is enhanced to support two more policies. The return code of a user-defined script is used in determining the destination node: – cl_lowest_nonzero_udscript_rc – cl_highest_udscript_rc 23 © 2011 IBM Corporation

Rootvg System Event ■ New kernel level monitoring ■ Monitors the loss of rootvg ■ ■ Defaults response is to log event and reboot causing fallover to occur Smitty sysmirror->Custom Cluster Configuration->Events->System Events Change/Show Event Response Type or select values in entry fields. Press Enter AFTER making all desired changes. [Entry Fields] 24 * Event Name ROOTVG + * Response Log event and reboot + * Active Yes + © 2011 IBM Corporation

Clmgr – cluster command line ■ Much asked-for feature ■ Very complete, verbose, documented ■ All output logged automatically in clutils. log ■ -l flag does trace logging various levels ■ Can shorten keywords to aliases ■ Can do (almost) everything possible in smitty ■ Can save a huge amount of time in build, config, PD of clusters ■ Used by Systems Director plugin ■ Replaces previous clvt 25 © 2011 IBM Corporation

Clmgr – cluster command line ■ Supported actions Supported object classes • cluster • file_collection – add • site • fallback_timer – delete • node – manage • interface • volume_group (incomplete coverage) • logical_volume (incomplete coverage) – modify • network – move • resource_group – offline • service_ip • physical_volume (incomplete coverage) – online • persistent_ip • method (incomplete coverage) – query • application_controller • report – recover • application_monitor • snapshot – sync • dependency • tape • file_system (incomplete coverage) – view 26 © 2011 IBM Corporation

Clcmd – cluster distributed commands ■ /usr/sbin/clcmd ■ Provided by CAA ■ Distributes command to all cluster nodes – Ease of use – Reminiscent of dsh from SP 2 days ■ Example – clcmd cat /etc/cluster/rhosts NODE jessica. dfw. ibm. com ---------------jessica jordan ---------------NODE jordan. dfw. ibm. com ---------------jessica jordan 27 © 2011 IBM Corporation

IBM Director: Power. HA Management Interface State-of-the-art interface – – – 28 No charge plug-in Masks complexity Central management Real-time status Smart Assist integration Deployment wizards © 2011 IBM Corporation

Power. HA 7. 1 Standard Edition Smart Assists Simplified application availability – Included in the Standard Edition Advanced Power. HA agent – Discover, Configure, and Manage Support to define and deploy HA policies – Exploit advanced relationships – Flexible failover policies and resource order policies – Out of the box start, stop and health monitoring for common workloads 31 1 Websphere 2 IBM DB 2 3 Oracle Database 4 Oracle Application Server 5 IBM HTTP Server 6 Tivoli Directory Server 7 SAP 8 FIle. Net 9 Tivoli Storage Manager (3 Smart Assists) 10 Lotus Domino Server 11 MAXDB 12 Websphere MQ 13 AIX Print Server 14 AIX DHCP 15 AIX DNS © 2011 IBM Corporation

Power. HA System. Mirror Announce Highlights October annouce 7. 1. 1 TL Deliver new services faster SAP Live. Cache hot standby – Fast failover for SAP Deliver higher quality services Federated Security – Centralized cluster wide security management Deliver services with superior economics Editions grow in value with each product release – XIV and v 7000 support with Power. HA 6. 1 EE on AIX – SVC and v 7000 support with Power. HA 7. 1 EE on IBM I – EMC Power. Path and Hitachi HDLM multi-pathing based disks supported as repository disks – 5 year life cycle for Power. HA System Mirror 7. 1 on AIX 32 © 2011 IBM Corporation

Disaster Recover Trends and Directions INTERMEDIATE OPERATIONS Geographic dispersion Data replication Optional compliance testing LEGACY OPERATIONS Tape based back-up recovery Annual restore from tape exercises RPO hours if not days RTO hours if not days Manual compliance testing Data-centric recovery No Replication Recover from Tape 36 RPO minutes RTO hours Manual compliance testing Data-centric recovery Storage Replication Flash Copy Reboot/Restore ADVANCED OPERATIONS Data center clustering and Geographically dispersed clustering Semi-annual compliance testing RPO minutes RTO less than an hour Automated compliance testing Application-centric recovery Power. HA Storage Replication Flash Copy Automation © 2011 IBM Corporation

Power. HA System. Mirror 6. 1 Enterprise Edition Storage Options for your Enterprise Sync mode Async mode Active Consistency groups GLVM Yes ü ü XIV Metro Mirror Global Mirror ü ü Storwize® V 7000 Metro Mirror Global Mirror ü ü SVC Metro Mirror Global Mirror ü ü DS 8800 Metro Mirror Global Mirror ü ü EMC SRDF ü ü Hitachi True. Copy Universal Replicator ü ü Hitachi VSP Truecopy Universal Replicator ü ü HP Storage Works P 9500 Continuous Access Software replication ü ü Solutions for disaster recovery – Major vendors, popular options – IBM storage options that span the market 37 © 2011 IBM Corporation

Power. HA System. Mirror Data Resiliency Standard Edition Enterprise Edition (6. 1) Continuous Availability within a Data Center Disaster Recovery within a Metropolitan Region Disaster Recovery Unlimited Distance Single Data Center Applications remain active Continuous access to data in the event of a storage subsystem outage Power. HA with LVM Mirrors RPO=0 & RTO=0 38 Two Data Centers Systems remain active Multi-site recovery with no data loss Two Data Centers Systems remain active Disaster recovery for out of region interruptions Power. HA with GLVM or Metro Mirror GLVM or Global Mirror SRDF, Truecopy RPO=0 & RTO<1 hr RPO secs & RTO <1 hr © 2011 IBM Corporation

Summary – Best Fit options q DS 8000 – IBM’s Flagship Enterprise Class Storage Superior DR capabilities Tight integration with IBM i Reduced bandwidth costs Lower data loss risk q XIV – Enterprise Class Storage Reinvented Unique self optimizing grid architecture with extreme ease of use Enterprise class storage at lower total costs Metro and Global mirroring and other advanced features at no extra costs q IBM SAN Volume Controller (SVC) – Enterprise Class Virtualized Storage Market leading Storage Virtualization Ease of integration / leverage of existing storage infrastructure Lower storage costs (30% utilization improvement) q Storwize V 7000 - New Standard for Midrange Storage Mid-range storage with enterprise capabilities Built in storage virtualization for ease of integration Incredible ease of use 39 © 2011 IBM Corporation 39

Power. HA Webcast V 1. 0 Power. HA for AIX Resources Power. HA Website – www. ibm. com/systems/power/software/availability/ HACo. C (Availability Factory) hacoc@us. ibm. com – Contact your IBM representative or an IBM Business Partner. IBM Technology Service Offering for Power. HA System. Mirror XD deployment – http: //www-935. ibm. com/services/us/index. wss/offering/its/a 1000032 Redbooks – Power. HA on AIX (SG 24 -7739 -00) – SG 24 -7841 IBM Power. HA System. Mirror Enterprise Edition – SG 24 -7845 IBM Power. HA v 7. 1 – Education: Power. HA for AIX Implementation, Config and Administration AN 410 – Go to IBM. com/services/learning (search for AN 410 or Power. HA) Education: Lab Services AN 44 Extended Distance and Disaster Recovery – http: //www- 304. ibm. com/jct 03001 c/services/learning/ites. wss/us/en? page. Type=course_list&sub. Chapter=194&sub. Chapter. Ind=S&region=us&sub. Chapter. Nam e=AIX+high+availability&country=us – http: //lpar. co. uk/HA/home. html GLVM white paper – www. ibm. com/systems/resources/systems_p_os_aix_whitepapers_pdf_aix_glvm. pdf IBM storage virtualization offerings – www. ibm. com/systems/storage/virtualization SAP consulting services for POWERHA and POWERVM – gehenni@us. ibm. com – sbranden@us. ibm. com Wiki – http: //www. ibm. com/developerworks/wikis/display/Wiki. Ptype/High%20 Availability Edison Group Paper – http: //theedison. com/pdf/2011_Samples_IBM_Power. HA. pdf Risk Self Assessment: – www. ibm. com/smarterplanet/us/en/business_resilience_management/overview/index. html? re=2 brf 24 41 © Copyright IBM Corporation 2011 © 2011 IBM Corporation

Special notices This document was developed for IBM offerings in the United States as of the date of publication. IBM may not make these offerings available in other countries, and the information is subject to change without notice. Consult your local IBM business contact for information on the IBM offerings available in your area. Information in this document concerning non-IBM products was obtained from the suppliers of these products or other public sources. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. IBM may have patents or pending patent applications covering subject matter in this document. The furnishing of this document does not give you any license to these patents. Send license inquires, in writing, to IBM Director of Licensing, IBM Corporation, New Castle Drive, Armonk, NY 10504 -1785 USA. All statements regarding IBM future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. The information contained in this document has not been submitted to any formal IBM test and is provided "AS IS" with no warranties or guarantees either expressed or implied. All examples cited or described in this document are presented as illustrations of the manner in which some IBM products can be used and the results that may be achieved. Actual environmental costs and performance characteristics will vary depending on individual client configurations and conditions. IBM Global Financing offerings are provided through IBM Credit Corporation in the United States and other IBM subsidiaries and divisions worldwide to qualified commercial and government clients. Rates are based on a client's credit rating, financing terms, offering type, equipment type and options, and may vary by country. Other restrictions may apply. Rates and offerings are subject to change, extension or withdrawal without notice. IBM is not responsible for printing errors in this document that result in pricing or information inaccuracies. All prices shown are IBM's United States suggested list prices and are subject to change without notice; reseller prices may vary. IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply. Any performance data contained in this document was determined in a controlled environment. Actual results may vary significantly and are dependent on many factors including system hardware configuration and software design and configuration. Some measurements quoted in this document may have been made on development-level systems. There is no guarantee these measurements will be the same on generallyavailable systems. Some measurements quoted in this document may have been estimated through extrapolation. Users of this document should verify the applicable data for their specific environment. Revised September 26, 2006 42 © 2011 IBM Corporation

Special notices (cont. ) IBM, the IBM logo, ibm. com AIX, AIX (logo), AIX 5 L, AIX 6 (logo), AS/400, Blade. Center, Blue Gene, Cluster. Proven, DB 2, ESCON, i 5/OS (logo), IBM Business Partner (logo), Intelli. Station, Load. Leveler, Lotus Notes, Operating System/400, OS/400, Partner. Link, Partner. World, Power. PC, p. Series, Rational, RISC System/6000, RS/6000, THINK, Tivoli (logo), Tivoli Management Environment, Web. Sphere, x. Series, z/OS, z. Series, Active Memory, Balanced Warehouse, Cache. Flow, Cool Blue, IBM Systems Director VMControl, pure. Scale, Turbo. Core, Chiphopper, Cloudscape, DB 2 Universal Database, DS 4000, DS 6000, DS 8000, Energy. Scale, Enterprise Workload Manager, General Parallel File System, , GPFS, HACMP/6000, HASM, IBM Systems Director Active Energy Manager, i. Series, Micro-Partitioning, POWER, Power. Executive, Power. VM (logo), Power. HA, Power Architecture, Power Everywhere, Power Family, POWER Hypervisor, Power Systems, Power Systems (logo), Power Systems Software (logo), POWER 2, POWER 3, POWER 4+, POWER 5+, POWER 6, POWER 6+, POWER 7, System i, System p 5, System Storage, System z, TME 10, Workload Partitions Manager and X-Architecture are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U. S. registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A full list of U. S. trademarks owned by IBM may be found at: http: //www. ibm. com/legal/copytrade. shtml. Adobe, the Adobe logo, Post. Script, and the Post. Script logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries. Alti. Vec is a trademark of Freescale Semiconductor, Inc. AMD Opteron is a trademark of Advanced Micro Devices, Inc. Infini. Band, Infini. Band Trade Association and the Infini. Band design marks are trademarks and/or service marks of the Infini. Band Trade Association. Intel, Intel logo, Intel Inside logo, Intel Centrino logo, Celeron, Intel Xeon, Intel Speed. Step, Itanium, and Pentium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. IT Infrastructure Library is a registered trademark of the Central Computer and Telecommunications Agency which is now part of the Office of Government Commerce. Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates. Linear Tape-Open, LTO, the LTO Logo, Ultrium, and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U. S. and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries or both. Microsoft, Windows and the Windows logo are registered trademarks of Microsoft Corporation in the United States, other countries or both. Net. Bench is a registered trademark of Ziff Davis Media in the United States, other countries or both. SPECint, SPECfp, SPECjbb, SPECweb, SPECj. App. Server, SPEC OMP, SPECviewperf, SPECapc, SPEChpc, SPECjvm, SPECmail, SPECimap and SPECsfs are trademarks of the Standard Performance Evaluation Corp (SPEC). The Power Architecture and Power. org wordmarks and the Power and Power. org logos and related marks are trademarks and service marks licensed by Power. org. TPC-C and TPC-H are trademarks of the Transaction Performance Processing Council (TPPC). UNIX is a registered trademark of The Open Group in the United States, other countries or both. Other company, product and service names may be trademarks or service marks of others. Revised December 2, 2010 43 © 2011 IBM Corporation