IBM Linux on z Series Linux on System
IBM Linux on z. Series Linux on System Z An Introduction Scott O. Lundell solundel@us. ibm. com © 2008 IBM Corporation
IBM Linux on z. Series Trademarks The following are trademarks of the International Business Machines Corporation in the United States and/or other countries. DB 2* DB 2 Connect DB 2 Universal Database e-business logo GDPS* Geographically Dispersed Parallel Sysplex Hyper. Swap IBM* IBM e. Server IBM logo* Parallel Sysplex* System z Tivoli* VM/ESA* Web. Sphere* z/OS* z/VM* z. Series* * Registered trademarks of IBM Corporation The following are trademarks or registered trademarks of other companies. Intel is a registered trademark of the Intel Corporation in the United States, other countries or both. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Java and all Java-related trademarks and logos are trademarks of Sun Microsystems, Inc. , in the United States and other countries. UNIX is a registered trademark of The Open Group in the United States and other countries. Microsoft, Windows and Windows NT are registered trademarks of Microsoft Corporation. SET and Secure Electronic Transaction are trademarks owned by SET Secure Electronic Transaction LLC. * All other products may be trademarks or registered trademarks of their respective companies. Notes: Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user's job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios stated here. IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply. All customer examples cited or described in this presentation are presented as illustrations of the manner in which some customers have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual customer configurations and conditions. This publication was produced in the United States. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area. All statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Information about non-IBM products is obtained from the manufacturers of those products or their published announcements. IBM has not tested those products and cannot confirm the performance, compatibility, or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. Prices subject to change without notice. Contact your IBM representative or Business Partner for the most current pricing in your geography. Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series Agenda § Introduction to Linux on System Z § System Z Hardware Overview § Hypervisor Comparisons § Linux on System Z Value Proposition § Platform Placement Guidelines ► Operating System ► Hardware § Best Fit and Good Fit Examples Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series What is Linux § A fully-networked UNIX-like operating system § Multi-user, multitasking, multiprocessor § Coexists with other operating systems § Open Source software ►Community ►Fosters Development Network Fast Technical Innovation & Supercomputing Support ►Guarantees No Single Vendor Control Runs on multiple platforms Intelligent Networking Approximately 1% of Linux code is platform specific Applications are not binary compatible across platforms Linux is Everywhere Pervasive Computing © 2008 IBM Corporation
IBM Linux on z. Series What is Linux on System Z § A native System Z operating environment ► Pure Linux, an ASCII environment ► Exploits IBM S/390 hardware, including IEEE floating point ► Linux for S/390 - 32 -bit ► Linux for z. Series - 64 -bit § Not a unique version of Linux or other operating system ► Developed and supported by the Open Source Community ► Distributed by Su. SE, Red. Hat, and Others § Not a replacement for other IBM System Z operating systems § Can be run under z/VM or in its own LPAR ► Hardware provides a pool of capacity Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series What System Z Hardware Brings to Linux § The most reliable hardware platform available ► MTF measured in decades ► RAS features built into hardware § Scalability ► Both Physical and Logical ► Non-disruptive capacity upgrade on demand § Designed to support mixed work loads ► Complete work load isolation ► High speed inter-server connectivity ► High Internal Bandwidth, sophisticated cache nest ► Virtualization § Hipersockets ► Virtual network between LPARs, at memory speed § Integrated Facility for Linux (IFL) ► Lower priced hardware ► Protects against software costs Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series Linux on System Z Value Proposition § Virtualization -- Primary Value ► Consolidation of many servers – “Lots of Little” ► Cost savings ► – Software – People, particularly in volatile environment Lifecycle management ► – Rapid provisioning – Reclamation and reuse Environmental issues – Floorspace – Power and cooling Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series IBM System z 10 Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series z 10 EC – Under the covers (Model E 56 or E 64) Processor Books, Memory, MBA and HCA cards Internal Batteries (optional) Ethernet cables for internal System LAN connecting Flexible Power Supplies Service Processor (FSP) cage controller 2 x Support Elements cards Infini. Band I/O Interconnects 3 x I/O cages 2 x Cooling Units FICON & ESCON FQC Fiber Quick Connect (FQC) Feature (optional) Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series Memory DIMMs Quad-core chip MCM Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series z 10 Configuration Options § 1 – 4 books per machine ► 5 different configurations – Special high-end configuration is fifth § Each book has 12 – 17 general purpose processors ► Processors are purchased and turned on individually ► Additional processors on MCM used for spares and SAPs § Maximum of 64 general purpose processors per machine Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series Non-disruptive Hardware Changes § Books can be added, and in some situations removed § Unused engines on MCMs can be turned on and off ► Disaster recovery ► Temporary capacity ► Upgrades § New resources immediately available to all Linux virtual machines Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series Simplified Design Differences Between Distributed and Z Core Bus Core Core Adequate Cores Healthy Bus Healthy Cores Adequate Bus Great Performance* Good Throughput* Core Bus Good Performance* Great Throughput* Core Linux is Everywhere Core © 2008 IBM Corporation Core
IBM Linux on z. Series Comparison of 64 -way Machines System Z Other Machines Application Processors Cross check processors Spares System Assist Processors Additional processors on I/O Cards Linux is Everywhere © 2008 IBM Corporation Application Processors
IBMVirtualization Linux on z. Series Approaches Server Hardware Partitioning Apps . . . Bare-metal Hypervisor Apps OS OS OS Adjustable partitions Partition Controller . . . Hosted Hypervisor Apps OS OS . . . Apps OS Hypervisor Host OS SMP Server is subdivided into fractions each of which can run an OS Hypervisor provides fine-grained timesharing of all resources Hypervisor uses OS services to do timesharing of all resources Physical partitioning S/370™ SI-to-PP and PP-to-SI, Sun Domains, HP n. Partitions Hypervisor software/firmware runs directly on server System z LPAR and z/VM® POWER™ Hypervisor VMware ESX Server Xen Hypervisor software runs on a host operating system VMware Server Microsoft® Virtual Server HP Integrity VM User Mode Linux® Logical partitioning IBM e. Server™ p. Series® LPAR, HP v. Partitions Characteristics: • Bare-metal hypervisors offer high efficiency and availability • Hosted hypervisors are useful for clients where host OS integration is important • Hardware partitioning is less flexible than hypervisor-based solutions Linux is Everywhere 15 © 2008 IBM Corporation
IBM Linux. Implementation on z. Series Hypervisor Methods Trap and Emulate Virt Mach Load Add Store Priv. Op Load. . . • VM runs in user mode • All privileged instructions cause traps Trap Hypervisor Priv. Op emulation code Examples: CP-67, VM/370 Benefits: Runs unmodified OS Issues: Substantial overhead Hypervisor Calls (“Paravirtualization”) Virt Mach Load Add Store Hcall Load. . . • VM runs in normal modes • OS in VM calls hypervisor to access real resources Call Hypervisor service Examples: POWER Hypervisor, Xen Benefits: High efficiency Issues: OS must be modified to issue Hcalls Linux is Everywhere 16 Translate, Trap, and Emulate Virt Mach Load Add Store Trap. Op Load. . . • VM runs in user mode • Some IA-32 instructions must be replaced with trap ops Trap Hypervisor Priv. Op emulation code Examples: VMware, Microsoft VS Benefits: Runs unmodified, translated OS Issues: Substantial overhead Direct Hardware Virtualization Virt Mach Load Add Store Priv. Op Load. . . • VM runs in normal modes • Hardware does most of the virtualization (SIE architecture) • Hypervisor provides control Exit Hypervisor service Hypervisor calls also supported Examples: System z LPAR, z/VM Benefits: High efficiency, runs unmodified OS Issues: Requires underlying hardware support © 2008 IBM Corporation
IBM Linux on Server z. Series VMware ESX Traps No isolation or protection of VMs from failures in I/O adapters or drivers Application Guest OS VMM VMM VMkernel Scheduler CPU § § § Memory SCSI Driver Disk Ethernet Driver nic NIC Service Console OS VMware ESX x 86 SMP Hardware Supports a wide range of unmodified Windows and Linux versions Guest OS runs in User Mode; privileged instructions trap to Virtual Machine Monitor (VMM) ► “Trapping and mapping” is a significant source of performance overhead Guest OS binary code is translated incrementally at load time ► Instructions that behave differently in User Mode vis-à-vis Supervisor Mode must be replaced with explicit trap instructions so the appropriate behavior will occur Modified Linux device drivers run in the VMkernel Intel VT hardware feature is used only for 64 -bit guests Linux is Everywhere 17 Memory Mgmt Cannot add or remove VM resources on the fly © 2008 IBM Corporation
IBM Linux on z. Series IBM System z: The Ultimate Virtualization Platform § Virtualize everything with up to 100% utilization rates ► § Massively scale your workload on a single System z mainframe ► ► The Linux-on-z/VM record is 97, 943 virtual machines Each virtual machine on z/VM can access up to 24, 576 devices § Security ► ► Consolidate all types of workloads CPU, memory, network, I/O, cryptographic features, coupling facility, . . . Smart economics: start small and grow big in the same box for everything Highest security classification for general purpose servers in the world System z LPAR technology is EAL 5 certified § Non-disruptively add anything ► ► 54 x CPU scalability per mainframe, 32 x CPU scalability per z/VM LPAR z/VM is designed to support up to 8 TB of active virtual memory Linux is Everywhere © 2008 IBM Corporation Secure your virtual servers and reduce business risk Rapidly respond to workload spikes
IBM Linux on z. Series IBM System z Server Virtualization Linux Example IBM System z Server Linux Linux Linux Virtual 2 CPUs Linux z/VM Virtual CPUs z/OS z/VM LPAR 1 LPAR 2 LPAR 3 LPAR 4 Logical CPUs Real CPUs Logical CPUs CP 1 CP 2 CP 3 CP 4 Linux is Everywhere CP 5 IFL 1 IFL 2 IFL 3 © 2008 IBM Corporation Real CPUs
IBM Linux on z. Series Virtualization with z/VM V 5. 4 z/VM can provision virtual machines with a mix of real and virtual resources with exceptional levels of scalability, availability and security Optimize virtual servers with dedicated real resources Configure virtual machines with z/VM-unique facilities Linux Virtual Resources CMS z/OS Simulate resources not in the LPAR More than 1 TB* (in aggregate) z/VM Add virtual CPUs non-disruptively (up to 64) LPAR I/O and Network Real Resources Memory CPU Linux is Everywhere Up to 256 channel paths Up to 256 GB* Up to 32 CPUs* © 2008 IBM Corporation * z/VM V 5. 4 maximums
IBM Linux on z. Series System z Virtualization Architecture Summary I/O shared among entire machine Memory dedicated to an LPAR, can be reconfigured Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series z/VM Technology: Disk Supports Both Traditional Mainframe and FCP Disk § z/VM Minidisks ► Used for user filesystems ► Partial or full pack ► Shared or exclusive ► Can use minidisk caching § Dedicated FC devices ► Full FC LUNs ► Managed by Linux guest z/VM Memory VDISK Linux In Memory disk, TDISK ► Ideal for Linux page spaces TDISK Temporary work or utility disks. Linux is Everywhere Linux z/VM Control Program ► ► … z/VM Minidisk Cache (ECKD Devices Only) § Virtual Disk (VDISK) § Temporary Disks (TDISK) VDISK Shared Minidisk ECKD Storage Device Managed by z/VM CP FC Disk Managed by Linux You can mix/match both traditional z/VM (ECKD) and FC attachment for each guest © 2008 IBM Corporation
IBM Linux on z. Series System z and N_Port ID Virtualization (NPIV) Without N_Port ID Virtualization Linux 3 Linux 1 FCP Disk With N_Port ID Virtualization Linux 3 Linux 4 Linux 1 Linux 2 Linux 4 Linux 2 z/VM Linux 1 Linux 2 Linux 3 Linux 4 z/VM Linux 1 Linux 2 Linux 3 Linux 4 = Virtual Worldwide Port Name (WWPN) Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series Linux on System Z Value Proposition § Virtualization § Close Proximity to z/OS Data ► Hipersockets § Other z. Series Features ► Disaster Recovery ► Availability ► – Ability to create HA configuration with no additional hardware Backup Capabilities ► Security ► – The most secure network is no network Technology Refresh Cycle ► Others Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series Everyone can virtualize So what makes System Z different…. Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series Simplified Computer Architecture Memory Disk SAP C C C P P P Front side bus Cache design can have a great impact on performance and workload characteristics Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series Internal Bandwidth Example Private Cache C-C Bus Shared Cache Reported BW Zero C-C Bus Speed Zero Effective BW C-M-C Speed C-C Bus Speed Infinite Memory Cache Processors Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series What determines system capacity There's more to performance than just processing power § Single system capacity is determined by: ► Processor speed ► Memory hierarchy ► I/O structure CPU Busy CPU Time I/O Busy Memory Time I/O Time Processor, memory, and I/O times vary greatly by application and by machine type Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series Relative single system capacity There's more to performance than just processing power Data Intensive Workloads CPU Busy CPU Time Memory Time CPU Time I/O Time z. Series The relative difference between Data Intensive and Compute Intensive is an order of magnitude I/O Time Memory Time Others Compute Intensive Workloads Memory Time CPU Time I/O Time z. Series CPU Time Memory Time Linux is Everywhere I/O Time Others © 2008 IBM Corporation
IBM Linux on z. Series Why Virtualization Works A "Typical" Intel Server Utilization Profile VMWare Fragmented Whitespace Growth Headroom Spike Capacity Quantum Average Linux is Everywhere © 2008 IBM Corporation z. Linux
IBM Linux on z. Series Sweet Spots of Various Platforms Win. Tel ► Low hardware cost System Z ► Virtualization (lots of little) ► Dedicated servers ► Data intensive ► Software that only runs on Win. Tel ► Skewed or skewless OLTP ► System P ► ► Virtualization (moderate amount of medium) ► Compute intensive ► Parallel applications ► Skewless OLTP ► ► Large or unpredictable working sets Applications with fine grained interactions Lots of different applications simultaneously High Qo. S Requirements Controlled or distributable working sets Workload with common characteristics Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series Hardware selection for Linux applications Technical Considerations Other System Z Architecture Quality of Service System Z Other Architecture Speed of deployment System Z Other Architecture Data intensity System Z Other Considerations §Application availability §Certification of solution on hardware/software platform §Workload Management §Manageability and scaling characteristics §Especially DB 2 on z/OS §Proximity of data to application §The best network is an internal network! Architecture Compute intensity Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series Where to deploy – z/OS or Linux on System Z? Technical Considerations z/OS Linux z/OS §File sharing across a Sysplex §Manageability and scaling characteristics Speed of deployment z/OS Linux §Application availability §Workload Management function and granularity Quality of Service Linux Other Considerations §Availability of skill Degree of portability Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series z/OS and z. Linux Comparison z/OS z. Linux § WLM ► ► § VMRM Most sophisticated Allows highest utilization § Tight Integration between Applications § RACF ► Highest level of security § RAS ► Best HW and SW RAS § Shared Everything ► Requires careful testing § Sysplex § SW Pricing ► ► Generally MLC Capacity based § Fast Context Switching § Sophisticated HW Cache Hierarchy § Incremental costs decrease with increasing capacity Linux is Everywhere ► ► Hard and soft caps Utilization higher than distributed, lower than z/OS § Network Hop between Virtual Servers § Linux Security ► Multiple options § RAS ► z. Series HW, Linux SW § State of the Art Virtualization ► Isolated yet shared § Clustering done with SW § SW Pricing ► ► OTC, distributed basis Engine based § Fast Context Switching § Sophisticated HW Cache Hierarchy § Requires “Critical Mass” for cost savings © 2008 IBM Corporation
IBM Linux on z. Series What Makes Best Fit § Leverage classic strengths of the z. Series ► High availability ► High I/O bandwidth capabilities ► Flexibility to run disparate workloads concurrently ► Requirement for excellent disaster recovery capabilities ► Security § Shortening end-to-end path length for applications ► Collocation of applications ► Consolidation of applications from distributed servers ► Reduction in network traffic ► Simplification of support model Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series Best Fit § § § § § Web. Sphere MQSeries® DB 2 Connect™ CICS® Transaction Gateway IMS Connect™ for Java™ Web Logic/Web. Sphere Application Servers and Java applications for production and development Applications requiring top end disaster recovery model Com. Server and Communications Controller for Linux LDAP security services IBI Web Focus Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series What Makes a Good Fit § Evaluate server choices ► Correct application availability, ► Supporting applications, ► Total Cost of Ownership (TCO) ► Politics within the organization § Issues that can influence architecture decision ► Shortening end-to-end path length for applications ► Collocation of applications ► Consolidation of applications from distributed servers ► Reduction in network traffic ► Simplification of support model Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series Good Fit § § § § SAP Application Servers DB 2 UDB Oracle Database Apache Web serving SAMBA Network Infrastructure, FTP, NFS, DNS etc. . , e-Mail solutions Linux is Everywhere © 2008 IBM Corporation
IBM Linux on z. Series Summary If Linux makes sense for the Enterprise, then. . . Consider Linux on System Z for that subset where It is cheaper Or where there are other special considerations and benefits Linux is Everywhere © 2008 IBM Corporation
- Slides: 39