Parallel and Distributed Computing Clusters and Grids Information

Parallel and Distributed Computing: Clusters and Grids Information Session Subject Code: 433 -498 Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Lab. The University of Melbourne, Australia www. gridbus. org WW Grid

Scalable HPC: Breaking Administrative Barriers & new challenges 2100 2100 ? P E R F O R M A N C E 2 2100 Administrative Barriers • Individual • Group • Department • Campus • State • National • Globe • Inter Planet • Galaxy Desktop SMPs or Super. Computers Local Cluster Enterprise Cluster/Grid Global Cluster/Grid Inter Planetary Grid!

Why SC? Large Scale Explorations need them—Killer Applications. n Solving grand challenge applications using modeling, simulation and analysis Aerospace Life Sciences 3 CAD/CAM Digital Biology Internet & Ecommerce Military Applications

4

PART 2: Cluster Architectures 5 The promise of supercomputing to the average PC User ?

HPCC Books, 2 Volumes - Prentice Hall, 1999 Edited by R. Buyya with contributions from over 100 leading researchers 6 (www. buyya. com/cluster/)

Agenda • Cluster ? Enabling Tech. & • • Motivations Cluster Architecture Cluster Components Single System Image Next Section (after break) • Case Studies • Cluster Programming and Application • 7 Design Resources and Conclusions

Rise and Fall of Computer Architectures n Vector Computers (VC) - proprietary system: n n Massively Parallel Processors (MPP) -proprietary systems: n n difficult to use and hard to extract parallel performance. Clusters - gaining popularity: n n 8 suffers from scalability Distributed Systems: n n high cost and a low performance/price ratio. Symmetric Multiprocessors (SMP): n n provided the breakthrough needed for the emergence of computational science, buy they were only a partial answer. High Performance Computing - Commodity Supercomputing High Availability Computing - Mission Critical Applications

Cluster computing: Past, Present, Future PDA Clusters 9 1960 1980 s 1990 1995+ 2000+

Definition: What is a Cluster? n n 10 A cluster is a type of parallel or distributed processing system, which consists of a collection of interconnected stand-alone computers cooperatively working together as a single, integrated computing resource. “stand-alone” (whole computer) computer that can be used on its own (full hardware and OS).

So What’s So Different about Clusters? n n n Commodity Parts? Communications Packaging? Incremental Scalability? Independent Failure? Intelligent Network Interfaces? Complete System on every node n n n 11 virtual memory scheduler files … Nodes can be used individually or combined. . .

Cluster Computer Architecture Parallel Applications Sequential Applications Parallel Programming Environment Cluster Middleware (Single System Image and Availability Infrastructure) PC/Workstation Communications Software Network Interface Hardware Cluster Interconnection Network/Switch 12

A major issues in Cluster design 13 • Enhanced Performance (performance @ low cost) • Enhanced Availability (failure management) • Single System Image (look-and-feel of one system) • Size Scalability (physical & application) • Fast Communication (networks & protocols) • Load Balancing (CPU, Net, Memory, Disk) • Security and Encryption (clusters of clusters) • Distributed Environment (Social issues) • Manageability (admin. And control) • Programmability (simple API if required) • Applicability (cluster-aware and non-aware app. )

Scalability Vs. Single System Image UP 14

Cluster Applications n n Numerous Scientific & engineering Apps. Business Applications: n n n Internet Applications: n n ASPs (Application Service Providers); Computing Portals; E-commerce and E-business. Mission Critical Applications: n 15 E-commerce Applications (Amazon, e. Bay …. ); Database Applications (Oracle on clusters). command control systems, banks, nuclear reactor control, star-wars, and handling life threatening situations.

Science Portals - e. g. , Papia system RWCP - http: //www. rwcp. or. jp/papia/ 16 • Pentiums. • Myrinet. • Net. BSD/Linuux. • PM. • Score-D. • MPC++. Papia PC Cluster

Adoption of the Approach 17

Scalable HPC: Breaking Administrative Barriers & new challenges 2100 2100 ? P E R F O R M A N C E 18 2100 Administrative Barriers • Individual • Group • Department • Campus • State • National • Globe • Inter Planet • Galaxy Desktop SMPs or Super. Computers Local Cluster Enterprise Cluster/Grid Global Cluster/Grid Inter Planetary Grid!

Towards Grid Computing 19

What is Grid ? n A paradigm/infrastructure that enabling the sharing, selection, & aggregation of geographically distributed resources: n n Wide area n n n Computers – PCs, workstations, clusters, supercomputers, laptops, notebooks, mobile devices, PDA, etc; Software – e. g. , ASPs renting expensive special purpose applications on demand; Catalogued data and databases – e. g. transparent access to human genome database; Special devices/instruments – e. g. , radio telescope – SETI@Home searching for life in galaxy. People/collaborators. [depending on their availability, capability, cost, and user Qo. S requirements] for solving large-scale problems/applications. 20 q Thus enabling the creation of “virtual enterprises” (VEs)

P 2 P/Grid Applications-Drivers n Distributed HPC (Supercomputing): n n High-Capacity/Throughput Computing: n n Collaborative design, Data exploration, education. Service Oriented Computing (SOC): n 21 Medical instrumentation & Mission Critical. Collaborative Computing: n n Drug Design, Particle Physics, Stock Prediction. . . On-demand, realtime computing: n n Application service provides (ASPs) & Web services. Data-intensive computing: n n Sharing digital contents among peers (e. g. , Napster) Remote software access/renting services: n n Large scale simulation/chip design & parameter studies. Content Sharing (free or paid) n n Computational science. Computing as Competitive Utility: New paradigm, new industries, and new business.

A Typical Grid Computing Environment Grid Information Service Grid Resource Broker R 2 R 3 R 5 Application database R 4 RN Grid Resource Broker R 6 Grid Information Service 22 R 1 Resource Broker

Need Grid tools for managing Security Computational Economy Uniform Access Resource Discovery Resource Allocation & Scheduling Application Development Tools 23 System Management Data locality Network Management

mix-and-match Object-oriented Internet/partial-P 2 P Network enabled Solvers Market/Computational Economy 24

Many Grid Projects & Initiatives n Australia n n n n Europe n n n n n Nimrod-G Grid. Sim Virtual Lab Active Sheets DISCWorld. . new coming up UNICORE MOL UK e. Science Poland MC Broker EU Data Grid Euro. Grid Meta. MPI Dutch DAS XW, Ja. WS Japan n Korea. . . Ninf Data. Farm N*Grid 25 n USA n n n Cycle Stealing &. com Initiatives n n Globus Legion OGSA Javelin App. Le. S NASA IPG Condor-G Jxta Net. Solve Access. Grid and many more. . . Distributed. net SETI@Home, …. Entropia, UD, Parabon, …. Public Forums n n Global Grid Forum P 2 P Working Group IEEE TFCC Grid & CCGrid conferences http: //www. gridcomputing. com

Grid Computing Projects GRIDS Lab @ Melbourne

The Gridbus Vision: To Enable Service Oriented Grid Computing & Bus iness! WW Grid Nimrod-G World Wide Grid! 27

GRIDS Lab @ the U. of Melbourne, The Gridbus Project: www. gridbus. org n Grid Economy & Distributed Scheduling (via Nimrod-G Broker) n n n Grid. Sim Toolkit: Grid Modeling and Simulation (Java based): n http: //www. buyya. com/gridsim/ n http: //www. buyya. com/libra/ n http: //www. buyya. com/ecogrid/wwg/ Libra: Economic Cluster Scheduler Grid Bank: Accounting, Payment, Enforcement Mechanisms World Wide Grid (WWG) testbed: Application Enabler Projects: n n Virtual Laboratory Toolset for Drug Design High-Energy Physics and the Grid Network (HEPGrid) Brain Activity Analysis on the Grid Cluster and Grid Info Centres: n 28 http: //www. buyya. com/ecogrid www. buyya. com/cluster/ || www. gridcomputing. com

Nimrod/G : A Grid Resource Broker n n n A resource broker for managing, steering, and executing task farming (parameter sweep/SPMD model) applications on Grid based on deadline and computational economy. Based on users’ Qo. S requirements, our Broker dynamically leases services at runtime depending on their quality, cost, and availability. Key Features n n n n 29 n A single window to manage & control experiment Persistent and Programmable Task Farming Engine Resource Discovery Resource Trading Scheduling & Predications Generic Dispatcher & Grid Agents Transportation of data & results Steering & data management Accounting

Drug Design: Data Intensive Computing on Grid Molecules Protein n 30 Chemical Databases (legacy, in. MOL 2 format) It involves screening millions of chemical compounds (molecules) in the Chemical Data. Base (CDB) to identify those having potential to serve as drug candidates.

MEG(Magneto. Encephalo. Graphy) Data Analysis on the Grid: Brain Activity Analysis All pairs (64 x 64) of MEG data by shifting the temporal region of MEG data over time: 0 to 29750: 64 x 29750 jobs 64 sensors MEG 2 Data Generation 3 1 5 Results Data Analysis Nimrod-G 4 Life-electronics laboratory, • [deadline, budget, optimization preference] AIST 31 • Provision of expertise in the analysis of brain function • Provision of MEG analysis World-Wide Grid [Collaboration with Osaka University, Japan]

A Glance at Nimrod-G Broker Nimrod/G Client Nimrod/G Engine Schedule Advisor Trading Manager Grid Store Grid Dispatcher Grid Explorer Grid Middleware Globus, Legion, Condor, etc. TM TS GE GIS Grid Information Server(s) RM & TS G L G Globus enabled node. See HPCAsia 2000 paper! 32 RM & TS L C Legion enabled node. G RM: Local Resource Manager, TS: Trade Server C L Condor enabled node.

Active Sheet: Microsoft Excel Spreadsheet Processing on Grid Nimrod Proxy Nimrod-G World-Wide Grid 33

34

Grid. Sim Toolkit A Java based tool for Grid Scheduling Simulations Application, User, Grid Scenario’s Input and Results Application Configuration Resource Configuration User Requirements Grid Scenario . . . Output Grid Resource Brokers or Schedulers Grid. Sim Toolkit Application Modeling Resource Entities Information Services Job Management Resource Allocation Statistics Resource Modeling and Simulation (with Time and Space shared schedulers) Single CPU SMPs Clusters Load Pattern Network Reservation Basic Discrete Event Simulation Infrastructure Sim. Java Distributed Sim. Java Virtual Machine (Java, c. JVM, RMI) PCs 35 Workstations SMPs Clusters Distributed Resources

Selected Grid. Sim Users! 36

Alessandro Volta in Paris in 1801 inside French National Institute shows the battery while in the presence of Napoleon I Fresco by N. Cianfanelli (1841) (Zoological Section "La Specula" of National History Museum of Florence University)

What ? !? ! Oh, mon Dieu ! This is a mad man… 38 …. and in the future, I imagine a Worldwide Power (Electrical) Grid …. . .

2002 - 1801 = 201 Years 39

Download Software & Information n Nimrod & Parameteric Computing: n n Economy Grid & Nimrod/G: n n http: //www. buyya. com/ecogrid/wwg/ Cluster and Grid Info Centres: n 40 http: //www. buyya. com/gridsim/ World Wide Grid (WWG) testbed: n n http: //www. buyya. com/vlab/ Grid Simulation (Grid. Sim) Toolkit (Java based): n n http: //www. buyya. com/ecogrid/ Virtual Laboratory Toolset for Drug Design: n n http: //www. csse. monash. edu. au/~davida/nimrod/ www. buyya. com/cluster/ || www. gridcomputing. com

Further Information n Books: n n n IEEE Task Force on Cluster Computing n n 41 www. gridforum. org IEEE/ACM CCGrid’xy: www. ccgrid. org n n http: //www. ieeetfcc. org Global Grid Forum n n High Performance Cluster Computing, V 1, V 2, R. Buyya (Ed), Prentice Hall, 1999. The GRID, I. Foster and C. Kesselman (Eds), Morgan-Kaufmann, 1999. CCGrid 2002, Berlin: ccgrid 2002. zib. de Grid workshop - www. gridcomputing. org

Further Information n Cluster Computing Info Centre: n n Grid Computing Info Centre: n n http: //computer. org/dsonline/gc Compute Power Market Project n 42 http: //www. gridcomputing. com IEEE DS Online - Grid Computing area: n n http: //www. buyya. com/cluster/ http: //www. Compute. Power. com

Final Word? 43

Backup Slides