CERN Open Stack Status April 2014 Rackspace Analyst

CERN Open. Stack Status April 2014 Rackspace Analyst Event Tim Bell Tim. Bell@cern. ch

About Tim § Responsible for IT Infrastructure Group at § § CERN • Operating Systems • Clouds • Security Infrastructure Member of the Open. Stack Management Board and User Committee Prior to joining CERN • Ran the Deutsche Bank European Private • Banking Infrastructure team Consultant and Developer at IBM Tim Bell - CERN Open. Stack 2

Tim Bell - CERN Open. Stack 3

Tim Bell - CERN Open. Stack 4

Tim Bell - CERN Open. Stack 5

CERN Geneva Computing Facilities > 100 PB archive > 30 PB/year data to record analyse > 10, 000 servers > 75, 000 disk drives > 45, 000 tapes > Next run of LHC expected to double data rates > But many limits… Tim Bell - CERN Open. Stack 6

Private Open. Stack Cloud Status § Production since July 2013 • Started with Grizzly version of Open. Stack • Upgrade online to Havana in February 2014 § Team of 5 cloud engineers § Currently • ~3, 000 hypervisors in two data centres • ~60, 000 cores • ~3 PB disk storage pool for volumes • Adding around 100 hypervisors per week § Outlook • ~150, 000 cores by 2015 with same staff levels Tim Bell - CERN Open. Stack 7

Using Clouds § CERN data is currently sent to ~150 of sites § § around the world using the Worldwide LHC Computing Grid Many sites are working with clouds • Local private clouds • Bursting to public clouds for peak load Some opportunistic clouds emerging • 2 clouds of around 20, 000 cores in ATLAS and • CMS experimental areas Grants for research Tim Bell - CERN Open. Stack 8

CERN Openlab in a nutshell • A science – industry partnership to drive R&D and innovation with over a decade of success • Evaluate state-of-the-art technologies in a challenging environment and improve them § Test in a research environment today what will be used in many business sectors tomorrow • • Train next generation of engineers/employees Disseminate results and outreach to new audiences See http: //openlab. web. cern. ch Tim Bell - CERN Open. Stack 9

Goals for a year of joint research § A reference architecture for federation of § § Open. Stack clouds Blueprints and code contributions to the open source communities Presentations and white papers to allow others to build on our findings Rackspace Private Cloud @ CERN Rackspace Public Cloud CERN Private Cloud Tim Bell - CERN Open. Stack 10

Status – Completed Work § Identity federation now in the latest open source release • Developed by Openlab fellow • Will be included in core Open. Stack code base for Icehouse § Rackspace cloud testing progressing well • CERN workloads run in Rackspace London public cloud • Installed a Rackspace private cloud on CERN premises Tim Bell - CERN Open. Stack 11

Next Steps § Enhance federation of resources • Images • Service Catalog § Demonstrate at the next Openlab summit • Paris in November 2014 § Test at scale and deploy Tim Bell - CERN Open. Stack 12

Conclusions § CERN is running large scale Open. Stack § clouds in production • Small team • Growing and stable Openlab provides a framework for sharing challenges with industry • Rackspace collaboration already producing enhancements to the open source cloud software § Rackspace clouds have been successfully tested using CERN physics workloads • Similar performance and stability with existing solutions Tim Bell - CERN Open. Stack 13

Questions Q&A Tim Bell - CERN Open. Stack 14

CERN was founded 1954: 12 European States “Science for Peace” Today: 21 Member States ~ 2, 300 staff ~ 1, 000 other paid personnel > 11, 000 users Budget (2013) ~1, 000 MCHF Member States: Austria, Belgium, Bulgaria, the Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Israel, Italy, the Netherlands, Norway, Poland, Portugal, Slovakia, Spain, Sweden, Switzerland the United Kingdom Candidate for Accession: Romania Associate Members in Pre-Stage to Membership: Serbia Applicant States for Membership or Associate Membership: Brazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, Ukraine Observers to Council: India, Japan, Russia, Turkey, United States of America; European Commission and UNESCO Tim Bell - CERN Open. Stack 15

Move To The Clouds § Constraints • Staff levels fixed • Budget flat • Geneva computer centre at its limits • Infrastructure tools were brittle and fragile § Approach • Expand to a second data centre in Hungary • 200 Gbit/s network from Geneva to Budapest • Adopt common open source tools • Move to a cloud model • Project started in 2012 Tim Bell - CERN Open. Stack 16

If you are interested. . . § SAML 2 specification • http: //docs. oasisopen. org/security/saml/v 2. 0/saml-core-2. 0 -os. pdf § Shibboleth • http: //shibboleth. net/ § Extenal Identity Providers blueprint • https: //blueprints. launchpad. net/keystone/+spec/i dentity-providers § Identity Providers and Mapping rules CRUD specification • https: //review. openstack. org/#/c/59848/ Tim Bell - CERN Open. Stack 17