Helix Nebula and the Helix Nebula Marketplace HNX
Helix Nebula and the Helix Nebula Marketplace (HNX) EGI Community Forum 2014 Phil Evans – CGI 19/05/2014
A European cloud computing partnership: big science teams up with big business Strategic Plan Establish multi‐ tenant, multi‐ provider cloud infrastructure Identify and adopt policies for trust, security and privacy Create governance structure Define funding schemes To support the computing capacity needs for the ATLAS experiment Setting up a new service to simplify analysis of large genomes, for a deeper insight into evolution and biodiversity Suppliers Adopters To create an Earth Observation platform, focusing on earthquake and volcano research To improve the speed and quality of research for finding surrogate biomarkers based on brain images
Helix Nebula FP 7 Assess the feasibility of a federated cloud computing platform for Europe and to address challenges in the following seven key areas: 1. A platform capable of development through PPP into a scalable science cloud; 2. A flexible governance structure capable of growing alongside the infrastructure itself; 3. Representations of functional and non‐functional requirements including policies for trust, security and privacy; 4. Agreements regarding inter‐operability with other, existing, e‐infrastructures; 5. Three flagships based at CERN, EMBL and ESA (represented by CNR), selected as ‘stretch’ targets highlighting extreme cases of the requirements of the ERA and space agencies. 6. Sustainable business models adhering to and supporting European‐level policies; 7. Roadmap and development plan for addressing issues on the road to 2020. 3
HNX Motivation and Approach Motivation • Stimulate European Cloud Business, create new business and jobs • Federation of contributors and European assets to create a new ecosystem enabling information driven economy. • Built‐in competition and no vendor lock in Approach to reach Information as a Service and Generic Iaa. S • Staged approach via release management – – – improved workflows better brokerage services: portal and brokerage tooling more Iaa. S suppliers improved interfacing more services like HPC aa. S or Information aa. S in next improved service catalogs
Helix Nebula Marketplace • Builds upon the work undertaken as part of the EC funding project • Support by European cloud providers and integration with existing e‐Infrastructures, form hybrid cloud Computing Market Place and open for new Cloud Providers • Trusted cloud services through compliance with EU regulations and legislation • Simplified procurement process for multiple cloud services • Offered to the global scientific community, for both publicly‐funded and commercial Research and Technology Organizations, offering large‐scale and HPC‐ type deployments from the start. • A focus on transparency and impartiality of the brokerage function. Trust is important. 5
HNX Platform • Initial four commercial cloud providers integrated • Amazon EC 2 Bridge for compatibility with third party tools such as Star. Cluster any EC 2‐ compatible tool • Integration with the EGI Fed. Cloud on our roadmap for 2014 EC 2 Bridge Atos Marketplace Operator Iaa. S Broker Cloud. Sigma Interoute T-Systems EGI Fed. Cloud GÉANT / Internet 6
Unique functionalities derived from the initiative 1. User and Organisation Role Management 2. Subscriber On‐boarding Module (ULM) + Contract Owner Approval Module 3. Electronic Contracting 4. Consolidated Metering & Billing Information 5. Federated Identity Management 6. Payment Module (OSS/BSS) 7. Ticketing module (listing & forwarding to levels)
Integrated Support • Single point of contact for user issues User Organisation • Triage and routing of issues performed by Marketplace Operator • Doesn’t block users having access to platform specific experts Iaa. S Provider(s) Email/Phone/Ticket Tool Marketplace Operator Brokerage Platform Providers Provider(s) EC 2 Bridge Provider
HNX Policy/Workflow Documents • Formalise how the companies participating in the Marketplace interact with each other at an operational level • Based upon the 14 processes covered by Fit. SM • Used in conjunction with the Workflows 9
Service Management • • • Supplier Relationship General Processes Service Portfolio Management Service Level Management Service Reporting Service Availability & Continuity Management • Capacity Management • Information Security Management • Customer Relationship Management • • • 10 Management Incident & Service Request Management Problem Management Configuration Management Change Management Release and Deployment Management Continual Service Improvement Management
Contractual Agreements, etc. User Organisation HNX Marketplace Operator BB EC 2 Bridge Iaa. S Provider A Portal Iaa. S Provider B 11
Contracts Users €n EGI Users A: Platform, Support* B: Iaa. S Resources* CGI D: Tooling Atos The Server Labs Four main contractual relationships (A, B, C, D) C: 2/3 Line Support, Platform *impacted by MSA T‐Systems n% Six. Sq HNX suppliers Iaa. S Providers EGI Cloud. Sigma Atos T‐Systems Interoute
Governance • Definition of a Governance model that will underpin the way in which the Marketplace participants work together • Define the focus and policies of the Marketplace going forward • Steer the Marketplace as the scope of services and participating providers grow • Ensure transparency and impartially of operations of the Marketplace
Roadmap: HNX 1. 1 3 Q 2014 Blue Box Slip. Stream 2. 2 API Fully documented Commercial Agreement Updates SLAs Iaa. S Provider Specific Multi‐Provider SLA Support Additional Brokerage Functions Iaa. S CSPs Additional Suppliers (+1‐ 2) Networking Advanced internet options (e. g. inter‐cloud routing) EGI Fed. Cloud Integration Catalogue Updates, alignment of units, T‐Shirt sizing Other New user‐level management Advanced Metering (e. g. Reservation/Burst) Enhanced usage and cost overview Online access to provider invoice detail incl. credits, discounts etc. (based on Fed Id. M)
Interoperability wish-list developed as D 6. 2 • 17 activities identified for future possible implementation
Roadmap: HNX 1. 2 4 Q 2014 Blue Box Slip. Stream 2. 3 API HNX API Bridge Updated for HNX API Commercial Electronic Contracting SLAs Iaa. S Provider Specific Multi‐Provider SLA Support Additional Brokerage Functions Iaa. S CSPs Additional Suppliers (+3‐ 4) Networking GEANT Agreement Finalised EGI Fed. Cloud Integration Catalogue Broker Iaa. S Performance Profiling Other Paa. S functions Provisions for Information aa. S
HNX v 1. 2 (Q 4 2014) API Paa. S Marketplace Operator Iaa. S Broker EC 2 Bridge new functions New Provider Atos Cloud. Sigma Interoute T-Systems GÉANT / Internet EGI Fed. Cloud New Provider
HNX – A Step towards Information as a Service • Ecosystem approach bringing Science and Industry together for the benefit of Europe • Drive collaboration into the core of this Ecosystem • Provide the means to support a value chain of Applications and API’s 18
Information-as-a-Service scenario (example) (a) (d) (b) Supplier X End User C (f) (h) Supplier Y (c) (e) (i) Services Catalogue SME B Saa. S B Supplier Z (g) Infrastructure Funding Agency Cust A
Thank you
- Slides: 20