Nuvla Science HNSci Cloud MultiCloud Alastair Pidgeon MarcElian

Nuvla. Science – HNSci. Cloud Multi-Cloud Alastair Pidgeon & Marc-Elian Bégin (RHEA/Six. Sq) December 1 st 2017

HNSCICLOUD – THE HYBRID CLOUD FOR SCIENCE Overview Pre-Commercial Procurement to demonstrate access to hybrid cloud services at scale Wide range of science users (10 members of Buyers Group, led by CERN) with diverse needs representing High Energy Physics, Astronomy, Molecular Biology Provide compute (VMs, HPC as a Service, GPU) and storage (SSD, Block, Object Store) Support Single Sign-On, Unified Data Management, Security Users access resource according to which Organisation, Project, Department etc. Procuring the resources. Procurer administrators control user access. Seen by the Buyers Group as a pre-cursor activity to European Opean Science Cloud HNSci. Cloud Prototype Activity Report Unclassified 3

HNSCICLOUD PRE-COMMERCIAL PROCUREMENT (PCP) EOSC Pre-Cursor – Demonstrating Hybrid Cloud Access at Scale (but <5% of expected demand) Phase 1 Phase 2 Phase 3 Scope Design Prototype Pilot Commercialisation Duration Dec 16 -Jan 17 Apr 17 -Dec 17 Feb 18 -Nov 18 Dec 18 -Dec 19 (TBC) v. CPU (cores) 100 3, 500 10, 000+ Storage (TB) 10 350 1, 000 Consortia 4 3 2 ? ? HPCaa. S, GPU access Open to early adopters Option Notes HNSci. Cloud Prototype Activity Report Unclassified 4

WORKING TOWARDS MASSIVE SCALE Aim to be in 2019… Managing Unified Data Management Solution 1 000 virtual machines Working across (multi-)clouds 10 000 concurrent users Working with both object store and block storage >100 PB of data Across range of clouds and regions and edge computing devices European Open Science Cloud foundation HNSci. Cloud Prototype Activity Report Delivered as Managed Service Deliver Most Economically Advantageous Tender (MEAT), via single contract Unclassified 5

HNSCICLOUD – THE HYBRID CLOUD FOR SCIENCE Nuvla for Science – Hybrid Multi-Cloud as a Service 1. Designed for Procurers & Users Qualified cloud providers compete for business 2. Most Economically Advantageous Tender Procurers set the criteria for the cloud(s) to satisfy 3. Multi-clouds offered via a single service User choice, high quality support, convenience 4. Can lower prices by aggregating demand Reserved instances, volume discounts, spot pricing 5. Designed for science HPC, GPU, multi-tenant/sub-tenant support at scale 6. Single sign-on for science edu. GAIN and Elixir Id. P – browser, API & CLI access 7. Free data ingress/egress Via GEANT network using Onedata services 8. Unified Data Management as a service POSIX file access and/or object storage 9. Integrated usage monitoring and accounting Monitor usage up to a few minutes ago HNSci. Cloud Prototype Activity Report Unclassified 6

OVERVIEW OF PROTOTYPE CLOUD PLATFORM Functional components to deliver complete data analysis platform… Integrated Realistic Minimally Intrusive Scalable Managed Sustainable HNSci. Cloud Prototype Activity Report Unclassified 7

OVERVIEW OF PROTOTYPE SOLUTION Functional components to deliver complete data analysis platform… HNSci. Cloud Prototype Activity Report Unclassified 8

OVERVIEW OF PROTOTYPE SOLUTION Functional components to deliver complete data analysis platform… HNSci. Cloud Prototype Activity Report Unclassified 9

OVERVIEW OF PROTOTYPE SOLUTION Functional components to deliver complete data analysis platform… HNSci. Cloud Prototype Activity Report Unclassified 10

OVERVIEW OF PROTOTYPE SOLUTION Functional components to deliver complete data analysis platform… HNSci. Cloud Prototype Activity Report Unclassified 11

CONTAINERS Support containerised applications and infrastructures… Rich set of container solutions ready for 1 -click deployments Support for multi-cloud available Stress tests and performance test used with large scale Kubernetes cluster HNSci. Cloud Prototype Activity Report Unclassified 13

CLOUD INFRASTRUCTURE EMBL/EBI Embassy – Private Cloud Integration Connected to Nuvla Tested and monitored Limited quota available Shows how “private clouds” can be integrated in the hybrid cloud HNSci. Cloud Prototype Activity Report Unclassified 14

NUVLASCIENCE IN USE DURING PHASE 2 Ongoing… Most of usage is for users’ test cases Evaluation of processing, data storage and network performance PCP has necessitated quota management for the Buyers Group members Wide range of users’ needs, expertise, cloud readiness level Justifies decision to support for self-provisioning, brokerage and managed services Feedback on the support provided has so far been very good HNSci. Cloud Prototype Activity Report Unclassified 15

RESOURCES How to get information and provide feedback… Documentation: http: //hn-prototype-docs. readthedocs. org/ Documentation Git. Hub: https: //github. com/Six. Sq/hn-prototype-docs Support: support@sixsq. com (or online) Knowledge Base: http: //support. sixsq. com (with full search) HNSci. Cloud Prototype Activity Report Unclassified 16

THANK YOU! Please come to see our demonstration… HNSci. Cloud Prototype Activity Report Unclassified 17