GRID activities INFNCNAF Cristina Aiftimiei SDDS cristina aiftimieicnaf

GRID activities INFN/CNAF Cristina Aiftimiei /SDDS cristina. aiftimiei@cnaf. infn. it This work is licensed under a Creative Commons Attribution-Non. Commercial-Share. Alike 4. 0 International License

Outline • INFN – National Institute for Nuclear Physics, Italy § Projects • NGI_IT § Operations Coordination § GRID Central Services • GRID Middleware development & support Open. Stack Summit – Tokyo 2015 2

INFN = Istituto Nazionale di Fisica Nucleare (National Institute for Nuclear Physics) Italian research agency dedicated to the study of the fundamental constituents of matter and the laws that govern them, under the supervision of the Ministry of Education, Universities and Research (MIUR). § It conducts theoretical and experimental research in the fields of subnuclear, nuclear and astroparticle physics, in close collaboration with Italian universities. o Strong experience and know-how also in cutting-edge technology and instruments. Among them, long-standing experience on HPC, distributed storage and computing (Grids and Clouds) • Strong focus also on technology transfer programs. § Transfer of technologies and know-how to Italian and European companies, developed within INFN scientific programs. 3

• INFN sites § About 30 among full INFN branches and collaboration groups hosted in university departments § 4 national laboratories: Catania, Frascati, Gran Sasso, Legnaro § 3 national centers: o CNAF, National Center for Research and Development in Informatics and Telematics, Bologna o GSSI, Gran Sasso Science Institute, L’Aquila o TIFPA, Trento Institute for Fundamental Physics and Applications, a Trento 4

INFN - lines of research & projects • Projects addressing “next generation computing infrastructure” § Data. Grid (2001 – 2004) o Research and Technological Development for an International Data Grid q EC: 9. 6 M€ - INFN 9. 69% § Data. Ta. G (2002 -2004): o Research & technological development for a Data Trans. Atlantic Grid q EC: 4. 1 M€ - INFN 15. 29% § EGEE I, III (2004 – 2010) o Enabling Grids for E-scienc. E q EC: 100, 8 M€ - INFN 11% § EMI (2010 – 2013) o Europeean Middleware Initiative q EC: 12 M€ - INFN 16% § EGI-Inspire (2010 – 2014) o Integrated Sustainable Pan-European Infrastructure for Researchers in Europe q EC: 25 M€ - INFN 6, 9% 5

INFN - lines of research & projects • Projects addressing “next generation computing infrastructure” § Data. Grid (2001 – 2004) o Research and Technological Development for an International Data Grid q EC: 9. 6 M€ - INFN 9. 69% § Data. Ta. G (2002 -2004): o Research & technological development for a Data Trans. Atlantic -Grid Computing enabling resource sharing Grid and coordinated problem q EC: 4. 1 M€ - INFN 15. 29% solving in dynamic, multi-institutional virtual organization § EGEE I, III (2004 – 2010) o Enabling Grids for E-scienc. E q EC: 100, 8 M€ - INFN 11% § EMI (2010 – 2013) o Europeean Middleware Initiative q EC: 12 M€ - INFN 16% § EGI-Inspire (2010 – 2014) o Integrated Sustainable Pan-European Infrastructure for Researchers in Europe q EC: 25 M€ - INFN 6, 9% 6

INFN - lines of research & projects • NEW projects addressing “next generation computing infrastructure” § National Projects o PRISMA (2012 – 2015) q Piattafo. Rme cloud Interoperabili per SMArt-government • MIUR/EC 27. 4/20. 3 M€ - INFN 8, 14% o OCP (2014 – 2016) q Open. City. Platform - Smart Cities and Communities and Social Innovation • MIUR 11. 9 M€ - INFN 13, 2% § International Projects o EGI – Engage (2015 – 2017) q Engaging the Research Community towards an Open Science Commons • `EC: 8 M€ - INFN 7, 5% o INDIGO – Data. Cloud (2015 – 2017) q INtegrating Distributed data Infrastructures for Global Expl. Oitation • EC: 11 M€ - INFN ~18, 7% 7

INFN - lines of research & projects • NEW projects addressing “next generation computing infrastructure” § National Projects o PRISMA (2012 – 2015) q Piattafo. Rme cloud Interoperabili per SMArt-government • MIUR/EC 27. 4/20. 3 M€ - INFN 8, 14% o OCP (2014 – 2016) Cloud Computing - enabling ubiquitous, convenient, on-demand […] q Open. City. Platform - Smart Cities and Communities and Social Innovation • MIURpool 11. 9 M€of configurable computing resources […] that access to a shared can§be. International rapidly provisioned and released […] Projects o EGI – Engage (2015 – 2017) q Engaging the Research Community towards an Open Science Commons • `EC: 8 M€ - INFN 7, 5% o INDIGO – Data. Cloud (2015 – 2017) q INtegrating Distributed data Infrastructures for Global Expl. Oitation • EC: 11 M€ - INFN ~18, 7% 8

Outline • INFN – National Institute for Nuclear Physics, Italy § Projects • NGI_IT § Operations Coordination § GRID Central Services • GRID Middleware development & support Open. Stack Summit – Tokyo 2015 9

NGI_IT Grid > Coordination of the Italian NGI • The Grid Operation Service supports a large variety of scientific disciplines organized in 30+ VOs, including the WLCG ones • Operation of central services § § § • INFN-distributed cluster of WMS/LB, top-BDII, VOMS A national NAGIOS-SAM instance Local and central highly-available LFC instances Squid and CVMFS services A general-purpose Grid Web portal Additional tasks § Coordination of the Italian Resource Center managers § Coordination of the Grid User Support § Involvement in the EGI. eu Operations team, with roles of supervision of the status of the overall infrastructure and of contributing to the software provisioning process § The supervision of the activity of the IGI Computer Security Incident Response Team 22. 09. 2016 10

NGI_IT - Sites: • Certified: 43 § Included 4 EGI Fed. Cloud+ 1 “Central Services” • Candidate: 1 • Closed: 48 22. 09. 2016 11

NGI_IT - Services: 427 (268 WLCG): • CREAM CE: 72 (53) • APEL: 40 (24); glite. APEL – 27 (20) • site-BDII: 23 (11) • SRM: 45 (24) • VO-box: 5 • Central Services: § § § Top-BDII: 11 (2) WMS: 16 ARGUS: 11 (9) VOMS: 10 (1) My. Proxy: 2 central. LFC: 2 22. 09. 2016 12

NGI_IT - Operations 22. 09. 2016 13

NGI_IT - Operations • WMS § § § • VOMS § • 4 production in DNS load-balancing, 1 for site certification LFC (virtual) § • • • 3 (virtual), replicated - 2 @ PD, 1 @ UNINA BDII-top (virtual) § § • 4 (+ 2 @ CT, 1 @ FE) serving 38 VO (4 LHC) 3 (virtual) used by Nagios-monitoring 1 (virtual) for site certification 2 + 2 (19 + 2 VO) 2 My. Proxy 1 Nagios (virtual) serving whole NGI_IT – in decommissionig 3 CVMFS (virtual) for virgo, padme, gridit 2 SQUID server x. GUS – NGI_IT ticketing system 22. 09. 2016 14

GRID Middleware development & support Software Products > Sto. RM • Storage Manager Service (SRM) for generic disk-based storage systems with a POSIX API § • SRM solution of choice for the Tier-1, which is based on GPFS. The integration with the tape system (based on TSM) is through GEMSS Major activities § § Web. DAV support much more reliable and being improved Additional refactoring and simplification of the code base to further reduce the maintenance. VOMS • • Attribute authority which serves as a central repository for authorization information associated to a member of a VO The administration Web interface to VOMS now connects directly to the CERN database containing user affiliation to experiments Argus • • Authorization Service that renders consistent authorization decisions for distributed services Based on the XACML standard 22. 09. 2016 15

GRID Middleware development & support • Grid & Cloud Portal https: //portal. italiangrid. it § Grid Job submission via Web o o § Grid & Cloud data management via Web o o § § Simple Job Submission via DIRAC Workflow management and submission via WS-Pgrade Move data from local PC to Grid. Move, Rename, Replica, Delete, Set ACL for the Grid data. Move data from Grid to local PC or Remote (SFTP, WEBDav). Move data from Grid to Cloud and viceversa Making easier the request and management of X. 509 certificate and the request for a VO membership Provisioning of a Cloud enviroment via Web o o o Instantiate and manage a Virtual Machine. Manage Public and Private SSH keys. Browse Metadata Catalog. Connect to a Virtual Machine. Resource Providers available: 22. 09. 2016 16

Supported VOs ~30 (% of 3, 452, 876, 596 Normalised CPU time (HEPSPEC 06) usage 2015 -2016 • • ) alice (24%), atlas (26%), cms (21%), lhcb (12%) – > total = 83% virgo (5%), belle (4%), biomed (2, 41%), compchem (2%), pamela (1%), calet. org (1%) 22. 09. 2016 17

22. 09. 2016 18

22. 09. 2016 19

20