CERN Infrastructure Evolution Tim Bell tim bellcern ch

CERN Infrastructure Evolution Tim Bell tim. bell@cern. ch @noggin 143 19/09/2013 CERN Infrastructure Evolution 2

CERN was founded 1954: 12 European States “Science for Peace” Today: 20 Member States ~ 2, 300 staff ~ 1, 000 other paid personnel > 11, 000 users Budget (2013) ~1, 000 MCHF Member States: Austria, Belgium, Bulgaria, the Czech Republic, Denmark, Finland, France, Germany, Greece, Hungary, Italy, the Netherlands, Norway, Poland, Portugal, Slovakia, Spain, Sweden, Switzerland the United Kingdom Candidate for Accession: Romania Associate Members in Pre-Stage to Membership: Israel, Serbia Applicant States for Membership or Associate Membership: Brazil, Cyprus (awaiting ratification), Pakistan, Russia, Slovenia, Turkey, Ukraine Observers to Council: India, Japan, Russia, Turkey, United States of America; European Commission and UNESCO 19/09/2013 CERN Infrastructure Evolution 3

What are the Origins of Mass ? 19/09/2013 CERN Infrastructure Evolution 4

Matter/Anti Matter Symmetric? 19/09/2013 CERN Infrastructure Evolution 5

Where is 95% of the Universe? 19/09/2013 CERN Infrastructure Evolution 6

19/09/2013 CERN Infrastructure Evolution 7

19/09/2013 CERN Infrastructure Evolution 8

19/09/2013 CERN Infrastructure Evolution 9

Collisions 19/09/2013 CERN Infrastructure Evolution 10

A Big Data Challenge 19/09/2013 CERN Infrastructure Evolution 11

The CERN Meyrin Data Centre 19/09/2013 CERN Infrastructure Evolution 12

New Data Centre in Budapest 19/09/2013 CERN Infrastructure Evolution 13

Good News, Bad News 19/09/2013 CERN Infrastructure Evolution 14

We’re Not Special 19/09/2013 CERN Infrastructure Evolution 15

mcollective, yum Puppet Bamboo AIMS/PXE Foreman JIRA Open. Stack Nova git Koji, Mock Yum repo Pulp Active Directory / LDAP Hardware database Lemon / Hadoop / Log. Stash / Kibana Puppet-DB 19/09/2013 CERN Infrastructure Evolution 16

The Agile Experience 19/09/2013 CERN Infrastructure Evolution 17

Cultural Barriers 19/09/2013 CERN Infrastructure Evolution 18

Status Toolchain implemented in 18 months with enhancements and bug fixes submitted back to the community • Now in production in 3 Open. Stack clouds (over 50, 000 cores in total) in Geneva and Budapest managed by Puppet • Target is more than 300, 000 cores by 2015 and 90% compute resources in the private cloud • 19/09/2013 CERN Infrastructure Evolution 19

Summary Constraints on resources have led to major technology transformations at CERN • Open source community participation helps drive cultural change and motivates staff • CERN benefits and contributes back through code and outreach • 19/09/2013 CERN Infrastructure Evolution 20

Questions ? 19/09/2013 CERN Infrastructure Evolution 21

19/09/2013 CERN Infrastructure Evolution 22

Service Models • Pets are given names like pussinboots. cern. ch • They are unique, lovingly hand raised and cared for • When they get ill, you nurse them back to health • Cattle are given numbers like vm 0042. cern. ch • They are almost identical to other cattle • When they get ill, you get another one 19/09/2013 CERN Infrastructure Evolution 23

19/09/2013 CERN Infrastructure Evolution 24

http: //www. eucalyptus. com/blog/2013/04/02/cy 13 -q 1 -community-analysis-%E 2%80%94 -openstack-vs-opennebula-vs-eucalyptus-vscloudstack 19/09/2013 CERN Infrastructure Evolution 25

19/09/2013 CERN Infrastructure Evolution 26

Tier-0 (CERN): • Data recording • Initial data reconstruction • Data distribution Tier-1 (11 centres): • Permanent storage • Re-processing • Analysis Tier-2 (~200 centres): • Simulation • End-user analysis • Data is recorded at CERN and Tier-1 s and analysed in the Worldwide LHC Computing Grid • In a normal day, the grid provides 100, 000 CPU days executing over 2 million jobs 19/09/2013 CERN Infrastructure Evolution 27

19/09/2013 CERN Infrastructure Evolution 28

Block Storage Provider Cinder Account mgmt system Microsoft Active Directory Network Compute Keystone Scheduler Nova CERN Infrastructure Evolution 19/09/2013 Horizon CERN Network Database Glance 29 CERN DB on Demand

Training for Newcomers Buy the book rather than guru mentoring 19/09/2013 CERN Infrastructure Evolution 30