GCM and Grid COMP Overview of Grid Component

GCM and Grid. COMP Overview of (Grid Component Model) EU Project Denis Caromel OASIS INRIA-UNSA-CNRS I 3 S Melbourne, Jan. 29 2007 1. Pro. Active context 2. GCM European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Pro. Active and GCM • Structuring of the library ð 3 big layers ðInner bricks • Component Aspects: not only in Cp Box! European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

• New GUIs Pro. Active ðIC 2 D Eclipse ðTim. It European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Grid Computing with Pro. Active Shanghai Melbourne Hierarchical Deployment Amsterdam Challenges: Programming Model, Scale, Latency, Heterogeneity, Versatility (protocols, firewalls. . . ) European Commission Directorate-General Information Society Unit F 2 – Grid Technologies Beijing

Pro. Active : Active objects JVM A ag = new. Active (“A”, […], Virtual. Node) V v 1 = ag. foo (param); V v 2 = ag. bar (param); . . . v 1. bar(); //Wait-By-Necessity JVM A v 2 v 1 ag A WBN! V Java Object Future Object Wait-By-Necessity Req. Queue Active Object is a Dataflow Thread Proxy Request European Commission Synchronization Directorate-General Information Society Unit F 2 – Grid Technologies

Creating AO and Groups JVM A ag = new. Active. Group (“A”, […], Virtual. Node) V v = ag. foo(param); . . . v. bar(); //Wait-by-necessity A V Typed Group, Type, and Asynchrony Java or Active Object are crucial for Cpt. and GRID European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Objects to Distributed Components Component. Identity Cpt = new. Active. Component (params); A a = Cpt …. get. Fc. Interface ("interface. Name"); V v = a. foo(param); A Example of a component instance V Truly Distributed Components Typed Group Java or Active Object European Commission Directorate-General Information Society Unit F 2 – Grid Technologies JVM

GCM + Scopes and Objectives: Grid Codes that Compose and Deploy No programming, No Scripting, … No Pain Multi. Cast Innovation: Gather. Cast Composite Components Multicast and Gather. Cast European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

• GCM: Grid Component Model ð GCM Being defined in the No. E Core. GRID (42 institutions) ð Open Source Object. Web Pro. Active implements a preliminary version of GCM ð Service Oriented: NESSI relation exp. • Grid. COMP takes: ð GCM as a first specification, ð Pro. Active as a starting point, and Open Source reference implementation. The vision: GCM to be the GRID GSM European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Grid. COMP Partners European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

GCM Architecture European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

GCM Technical Structure 1. Component Specification as an XML schema or DTD 2. Run-Time API defined in several languages C, Java 3. Packaging described as an XML schema 4. Information for Deployment (Virtual Nodes, … Variables, File Transfer, …) European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Content and Activities • 1 - Primitive Component Programming • 2 - Legacy Code Wrapping, Interoperability • 3 - Composition and Composites, Deployment • 4 – Autonomic features • 5 – IDE for GCM (Composition GUI, etc. ) European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Collective Interfaces European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Collective Interfaces • Simplify the design and configuration of component • systems Expose the collective nature of interfaces ðCardinality attribute ðMulticast, Gathercast, gather-multicast • The framework handles collective behaviour • at the level of the interface • Based on Fractal API : ðDedicated controller ðInterface typing Verifications European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Multicast interfaces Transform a single invocation into a list of invocations • Multiple invocations ðParallelism ðAsynchronism ðDispatch • Data redistribution (invocation parameters) ðParameterisable: Distribution Function ðBroadcast, scattering ðDynamic redistribution: Dynamic dispatch • Result = list of results European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Multicast interfaces ðResults as lists of results ðInvocation parameters may also be distributed from lists European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Gathercast interfaces • Result: Transform: a list of invocations a single invocation • Synchronization of incoming Redistribution of results Redistribution function invocations ð ~ “join” invocations ð Timeout / Drop policy ð Bidirectional Bindings (callers callee) • Data gathering Aggregation of parameters into lists European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Status of GCM in Pro. Active • Partial implementation: ðADL schema, API, Multicast, Gathercast, … ðComponent GUI (prototype) • Distributed components for various applications: ðNumerical, Legacy, … • On-going experiments: ðup to 300+ CPUs European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Current GCM experiments in Pro. Active • JEM 3 D: 3 D electromagnetic application: a single Cp on 300+ CPUs on Grid • Vibro-Acoustic application with EADS (legacy MPI coupling) European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Current GCM experiments in Pro. Active • IBM: ðSecurity Fingerprint System • ATOS Origin: ðFinancial Application Optimization • Grid. Systems: ðWing Simulation ðTelecom Application, EDR processing European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Update on Pro. Active and GCM (1) • New Version under preparation: ðNov. 10: Pro. Active Version 3. 2 Beta ðJan. 26: Pro. Active Version 3. 2 (After Plug. Tests’ Learning, New Web Site) ðNew features in 3. 2 release: Next slide European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

New Web Site with 3. 2 Version European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Chinese Web thank to Tsinghua Univ. European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Update on Pro. Active and GCM (2) • New Features in Pro. Active Version 3. 2: ð New features in 3. 2 release: § Conformance tests for Fractal, towards conformance tests for GCM § IC 2 D Eclipse Plugin § Tim. It (Hierarchical, Visual) § Skeleton (improved, with File Transfer, Documentation) § g. Lite EGEE deployment updated § Support for Java 1. 5 Generics: ð Active Objects can be instantiated from Generic Classes ð Some Warnings removed § Improvements in OSGi integration § Prototype TTools for UML modeling of GCM components (TBC) European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

A Vision: GCM as EU’s GSM • Once upon a time: ð GSM: Global System for Mobile communication • Process: ð “critical decisions […] the GSM initiative became a success in Europe […] ð Initially the strategy and technical specifications were agreed for Europe and […] incorporating all non-European requirements […] worldwide to participate ” From: Gsm & Umts: The Creation of Global Mobile Communications Standardization of GSM was crucial for EU advances in Mobile Telephony (Science and Business) European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

A Vision: GCM as EU’s GSM GRID faces the same challenge: ðBuild Flexibility ðOpenness ðInteroperability Objectives: Build a Word-Wide standard for Science and Business GRIDs: GCM European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

GSM and GCM Pictures • GSM cells: • Components: European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

GSM and GCM Pictures European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

GSM and GCM Pictures European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Conclusion (1) Scientific Issues and Directions Components in the membrane: • Membrane: ð Meta-Objects Java Objects • Components: ð Active Objects • If Cp in Mb: ð Active Objects as Meta-Objects ð Not suited for all cases. If Dist. AO If light+local POJO TBD European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Conclusion (2) Key technology advancements • Programming the Grid with reusable, components ð vs. ad hoc solutions • Component for Separation of Concerns and AOP: ð Gathercast allows to have synchronisation outside functional code • Deployment on various architectures ð Super Computer Center, Clusters, data-center, desktop Grids, … • Interoperability with related Grid software • Integration into Service Oriented Architecture (SOA) European Commission Directorate-General Information Society Unit F 2 – Grid Technologies

Conclusion (3) Research Challenges • A general enough GCM, still efficient • Effective composition: Semantics, Deployment, Portability • Non-Functional Aspects: Security, Load-Balancing, Fault-tolerance, CP. Specif (Lotos, UML TTools, p. Nets) and Model Checking Verification European Commission Directorate-General Information Society Unit F 2 – Grid Technologies