GRID Stato dellarte Alessandro Paolini INFNCNAF Workshop della

GRID – Stato dell’arte Alessandro Paolini (INFN-CNAF) Workshop della Commissione Calcolo e Reti dell'INFN Laboratori Nazionali del Gran Sasso 10 – 13 Giugno 2008 1

Primary components of the production grid The primary components of the Italian Production Grid are: • Computing and storage resources • Access point to the grid • Services Other elements are as much fundamental for the working, managing and monitoring of the grid: • Middleware • Monitoring tool • Accounting tool • Management and control infrastructure • Users 2

GRID Management Grid management is performed by the Italian Regional Operation Center (ROC). The main activities are: • • Production of Infngrid release and test Deployment of the release to the sites, support to local administrators and sites certification • Periodical check of the resources and services status • Support at an Italian level • Support at an European level • Introduction of new Italian sites in the grid • Introduction of new regional VOs in the grid 3

The Italian Regional Operation Center (ROC) • One of 10 existing ROC in EGEE • • • 4 Operations Coordination Centre (OCC) – Management, oversight of all operational and support activities Regional Operations Centres (ROC) – providing the core of the support infrastructure, each supporting a number of resource centres within its region Grid Operator on Duty Grid User Support (GGUS) – At FZK, coordination and management of user support, single point of contact for users

Users and sites support EGEE make use of the GGUS (Global Grid User. Support) ticketing system Each ROC utilizes different tools interfaced to GGUS in a bidirectional Way. By means of Web services, it is possible to: • Transfer tickets from the global to regional system • Transfer tickets from the regional to the global system The user groups support, whom ticket will be addressed, are defined Either in GGUS either in the regional systems In the Italian Regional Operation Centre the ticketing system utilized is based on XOOPS/x. Help 5

Sistema di supporto italiano 6

GRID Services Allow you to use the grid resources: • Resource Broker (RB) / Workload Management System (WMS): they are responsible for the acceptance of submitted jobs and for sending those jobs to the appropriate resources • Information System (IS): provides information about the grid resources and their status • Virtual Organization Management System (VOMS): database for the authentication and authorization of the users • Gridice: monitoring of resources, services and jobs • Home Location Register (HLR): database for the accounting informations of the usage of resources • LCG file catalog (LFC): file catalog • File Transfer Service (FTS): file movements in an efficient and reliable way • Mon. Box: collector for local data of R-GMA 7

Access to the GRID • Access by means of an User Interface (UI). It could be: – A dedicated PC, installed in a similar way to the others grid elements – UI Plug-and-Play (UI Pn. P), a software you can install on any pc without root privilegies – A web portal: https: //genius. ct. infn. it/ • To access the GRID you need a personal certificate released by a Certification Authority trusted by EGEE/LCG infrastructure: the user authentication is performed through X-509 certificates To be authorized to submit jobs you have to belong to a Virtual Organisation (VO). A VO is a kind of users group usually working on the same project and using the same application software on the grid. • 8

General Purpose Services (I) 2 Resource Brokers 1 Top Level BDII 2 voms servers + 1 replica per ciascuno 1 gridice server 1 LCG File Catalog server 9

General Purpose Services (II) 3 WMS 2 Logging & Bookkeeping 2 Resource Brokers 2 Top Level BDII 1 server My. Proxy 1 FTS 10

VOMS Servers (I) 11

VOMS Servers (II) 12

Accounting using DGAS (Distributed Grid Accounting System) is fully deployed in INFNGrid (13 site HLRs + 1 HLR of 2 nd level (testing). The site HLR is a service designed to manage a set of ‘accounts’ for the Computing Elements of a given computing site. For each job executed on a Computing Element (or a on local queue), the Usage Record for that job is stored on the database of the site HLR. Each site HLR can: • Receive Usage Records from the registered Computing Elements. • Answer to site manager queries such as: – Datailed job list queries (with many search keys: per user, VO, FQAN , CEId…) – Aggregate usage reports, such as per hour, day, month…, with flexible search criteria. • • Optionally forward Usage Records to APEL database. Optionally forward Usage Records to a VO specific HLR. Site layer Site HLR Resource’s layer Usage Metering 13 GOC -Aggregate site info -VO (with role/group) usage on the site. -Detailed Resource Usage info -Job level info

Tier 1 & Tier 2 HLRs host hlr-t 1. cr. cnaf. infn. it prod-hlr-02. ct. infn. it prod-hlr-01. pd. infn. it prod-hlr-01. ba. infn. it atlashlr. lnf. infn. it t 2 -hlr-01. lnl. infn. it prod-hlr-01. mi. infn. it t 2 -hlr-01. na. infn. it gridhlr. pi. infn. it t 2 -hlr-01. roma 1. infn. it grid 005. to. infn. it sito INFN-T 1 INFN-CATANIA INFN-PADOVA INFN-BARI INFN-FRASCATI INFN-LEGNARO INFN-MILANO INFN-NAPOLI, INFN-NAPOLI-ATLAS INFN-PISA INFN-ROMA 1, INFN-ROMA 1 -CMS, INFN-ROMA 1 -VIRGO INFN-TORINO 11 Home Location Register di sito per Tier 1 e Tier 2 2 HLRs per i siti medio-piccoli HLR prod-hlr-01. pd. infn. it (INFN-PADOVA) reference for central-northern area sites CNR-ILC-PISA CNR-PROD-PISA INAF-TRIESTE INFN-CNAF INFN-BOLOGNA INFN-FERRARA INFN-FIRENZE 14 HLR prod-hlr-01. ct. infn. it (INFN-CATANIA) reference for central-southern area sites ENEA-INFO INFN-CAGLIARI INFN-LECCE INFN-LNS INFN-NAPOLI-CMS INFN-ROMA 2 INFN-GENOVA INFN-PARMA INFN-PERUGIA INFN-TRIESTE SNS-PISA UNIV-PERUGIA INFN-ROMA 3 ITB-BARI SPACI-CS-IA 64 SPACI-LECCE-IA 64 SPACI-NAPOLI-IA 64

VO Dedicated Services (I) 15

VO Dedicated Services (II) 16

Experimental Services • Tests su alcuni componenti rilasciati dagli sviluppatori, in parallelo con SA 3 – Applicazione delle ultime patch appena rilasciate su alcuni WMS presenti in produzione, per consentire alle VO di testarne la compatibilità con i loro tools – Cream. CE: in collaborazione con alcuni siti in cui sono state installate diverse istanze 17

Other Services 18

Deployment Status (I) SITE STATUS CNR-ILC-PISA CERTIFIED INFN-PISA CERTIFIED CNR-PROD-PISA CERTIFIED INFN-ROMA 1 CERTIFIED ENEA-INFO CERTIFIED INFN-ROMA 1 -CMS CERTIFIED ESA-ESRIN CERTIFIED INFN-ROMA 1 -VIRGO CERTIFIED INFN-BARI CERTIFIED INFN-ROMA 2 CERTIFIED INFN-BOLOGNA CERTIFIED INFN-ROMA 3 CERTIFIED INFN-CATANIA CERTIFIED INFN-T 1 CERTIFIED INFN-CNAF CERTIFIED INFN-TORINO CERTIFIED INFN-CNAF-LHCB CERTIFIED INFN-TRIESTE CERTIFIED INFN-FERRARA CERTIFIED SNS-PISA CERTIFIED INFN-FRASCATI CERTIFIED SPACI-CS-IA 64 CERTIFIED INFN-GENOVA CERTIFIED SPACI-NAPOLI CERTIFIED INFN-LECCE CERTIFIED UNI-PERUGIA CERTIFIED INFN-LNL-2 CERTIFIED INAF-TRIESTE HW PROBLEMS INFN-LNS CERTIFIED INFN-CAGLIARI HW PROBLEMS INFN-MILANO CERTIFIED INFN-CASCINA HW PROBLEMS INFN-NAPOLI CERTIFIED INFN-FIRENZE Supp. Unavailable INFN-NAPOLI-ATLAS CERTIFIED INFN-NAPOLI-CMS TESTs ONGOING INFN-NAPOLI-PAMELA CERTIFIED ITB-BARI Cooling Maint. INFN-PADOVA CERTIFIED SISSA-TRIESTE TESTs ONGOING INFN-PARMA CERTIFIED SPACI-LECCE-IA 64 HW & MW PROBLEMS INFN-PERUGIA CERTIFIED SPACI-NAPOLI-IA 64 HW & MW PROBLEMS 19 44 Siti in totale: 35 Siti attivi 2 siti in fase di certificazione 31 siti INFN 13 siti di altri enti (cnr, enea, esa, inaf, spaci, univ. PG) 3 siti con architettura IA 64 (1 attivo)

20 20

Release INFNGRID • Based on g. Lite 3 • We are still in a O. S. transition phase: there are two releases INFNGRID: 3. 0 for SL 3, 3. 1 for SL 4 Several customizations: additional VOs (~20) accounting (DGAS): New profile (HLR server) + additional packages on CE and WN monitoring (GRIDICE) Quattor (collaboration with CNAF-T 1) Dynamic Information-Providers for LSF: corrected configuration, new vomaxjobs (3. 1/SL 4 WIP) transparent support to MPICH and MPICH-2 GRel. C (Grid Relational Catalog) Sto. RM (Storage Resource Manager) GFAL Java API & NTP 21 Work-in-progress: cream. CE patched My. Proxy (long-live proxy delegation with voms extensions) AMGA Web Interface GSAF (Grid Storage Access Framework) Secure Storage System g. Lite for Windows with torque/maui support

Deployment Status (II) • • • • EGEE g. Lite 3. 1 updates (http: //glite. web. cern. ch/glite/packages/R 3. 1/updates. asp) 29. 05. 08 - 3. 1 Update 25 INFNGRID g. Lite 3. 1 22. 05. 08 - 3. 1 Update 24 Update 22/23/24/25 (SL 4) - WIP 16. 05. 08 - 3. 1 Update 23 13. 05. 08 - 3. 1 Update 22 24. 08 - 3. 1 Update 21 22. 04. 08 - 3. 1 Update 20 INFNGRID g. Lite 3. 1 Update 18/19/20/21 (SL 4) - 28/04/2008 15. 04. 08 - 3. 1 Update 19 07. 04. 08 - 3. 1 Update 18 INFNGRID g. Lite 3. 1 Update 17 (SL 4) - 01/04/2008 19. 03. 08 - 3. 1 Update 17 06. 03. 08 - 3. 1 Update 16 INFNGRID g. Lite 3. 1 27. 02. 08 - 3. 1 Update 15 Update 14/15/16 (SL 4) - 18/03/2008 21. 02. 08 - 3. 1 Update 14 22

Deployment Status (III) • • • EGEE g. Lite 3. 0 updates (http: //glite. web. cern. ch/glite/packages/R 3. 0/updates. asp) INFNGRID g. Lite 3. 0 Update 43 (SL 3) - WIP/2008 22. 05. 08 - 3. 0. 2 Update 43 INFNGRID g. Lite 3. 0 Update 42 (SL 3) - 28/04/2008 18. 04. 08 - 3. 0. 2 Update 42 INFNGRID g. Lite 3. 0 Update 41 (SL 3) - 01/04/2008 19. 03. 08 - 3. 0. 2 Update 41 04. 03. 08 - 3. 0. 2 Update 40 INFNGRID g. Lite 3. 0 Update 40 (SL 3) - 18/03/2008 INFNGRID g. Lite 3. 0 Update 39 (SL 3) - 05/02/2008 25. 01. 08 - 3. 0. 2 Update 39 INFNGRID g. Lite 3. 0 Update 38 (SL 3) - 25/01/2008 14. 01. 08 - 3. 0. 2 Update 38 INFNGRID g. Lite 3. 0 Update 37 (SL 3) - 05/12/2007 28. 11. 07 - 3. 0. 2 Update 37 12. 11. 07 - 3. 0. 2 Update 36 INFNGRID g. Lite 3. 0 Update 35/36 (SL 3) - 11/29/2007 31. 10. 07 - 3. 0. 2 Update 35 23

Supported VOs 49 VOs supported: 4 LHC (ALICE, ATLAS, CMS, LHCB) 3 test (DTEAM, OPS, INFNGRID) 20 Regional 1 catch all VO: GRIDIT 21 Other VOs 24 24

VO Regionali 225 numero di utenti registrati nelle VO regionali italiane 200 175 2376 utenti registrati in CDF 150 125 100 75 50 25 25 en it m r. e cy u cl op s in gv e co ne m a pa ss it i fn. . in lib ht s lig ar g pa o m el a vi rg o af in b eu io co chin m a pc he th m eo ph y eu s in di a pl an ck eg rid id eu it m ed gr fn gr id 0 in VO utenti argo 25 bio 68 compassit 7 compchem 59 cyclops 13 egrid 28 enea 12 enmr. eu 14 euchina 61 euindia 51 eumed 99 gridit 132 inaf 27 infngrid 207 ingv 13 libi 17 lights. infn. it 16 pamela 19 planck 33 theophys 57 virgo 18

HLRmon 26

WMS MONITOR (I) 27

WMS MONITOR (II) 28

Useful links • Italian grid project: http: //grid. infn. it/ • Italian production grid: http: //grid-it. cnaf. infn. it/ • HLR MON: https: //dgas. cnaf. infn. it/hlrmon/report/charts. php • WMS MON: https: //cert-wms-01. cnaf. infn. it: 8443/wmsmon/main. php • g. Lite Middleware: http: //glite. web. cern. ch/glite/default. asp 29