INFN Grid actvities and plans Grid it LCG

  • Slides: 65
Download presentation
INFN Grid actvities and plans: Grid. it, LCG and EGEE CERN, LCG PEB September

INFN Grid actvities and plans: Grid. it, LCG and EGEE CERN, LCG PEB September 16 th 2003 Mirco Mazzucato INFN-Padova mirco. mazzucato@pd. infn. it last update 07/10/2020 17: 46 1

Summary Status and plans of the INFN Grid project § § Foundation and costituency

Summary Status and plans of the INFN Grid project § § Foundation and costituency The current 4 Areas of activity after re-organization § MIDDLEWARE ¨ The contribution to EU projects: Data. Grid, Data. TAG, LCG, EGEE ¨ The INFN development of middleware § THE ITALIAN PRODUCTION GRID MANAGEMENT ¨ Infrastructure for LCG and INFN ¨ Infrastructure for the FIRB Grid. it project ¨ The EU e. Infrastructure: EGEE § THE SUPPORT TO APPLICATIONS § DISSEMINATION § § last update 07/10/2020 17: 46 The new IG-BIGEST initiative Conclusions 2

(V 1. 0 approved by INFN Board of Directors Februay 25 th 2000) last

(V 1. 0 approved by INFN Board of Directors Februay 25 th 2000) last update 07/10/2020 17: 46 4

INFN Grid: participants § INFN Grid is a “special project” and was including since

INFN Grid: participants § INFN Grid is a “special project” and was including since the beginning: The computing professional and facilities of ~20 INFN sites The 4 LHC experiments Virgo : The gravitational Wave interferometer APE (the INFN home developed parallel facility for Lattice QCD) Several groups of computing scientists: Catania, Torino, Pisa, Venezia, Bologna. . . § Today: ~80 technical FTEs (140 people) + Experiment Physicists § § § § § “Special project” -> report directly to INFN manag. not to CSNs It has been conceived mainly as a common project to develop new technologies and prototype the computing model and infrastructure for the new expriments LHC and Virgo But it has been enlarged to CDF and Babar…. The budget: 2 -3 M€/Year Tier 1 and Tier 2 have an additional reserved budget of >=21 M€ last update 07/10/2020 17: 46 5

INFN Grid: management § INFN Grid has and is managed by the Executive Board

INFN Grid: management § INFN Grid has and is managed by the Executive Board which is constituted by ¨ the computing coordinators of the LHC experiments and Virgo ¨ APE (not very active) ¨ The 2 INFN Grid technical coordinator + Area Managers ¨ The Director of Cnaf and INFN National Tier 1 ¨ The project Manager § The Technical Board which is now constituted by ¨ the Managers of the most important area of activities ( middleware, deployment and operation, security, applications. . . ); was WP leaders before. . . § § Site administrative coordination is provided by COLGs § 1 per site § last update 07/10/2020 17: 46 It has proven to be an efficient structure but it is now evolving to face the evolution of activities 6

The INFN-GRID EB Management Executive Board: Project Manager : Mirco Mazzucato Deputy Laura Perini

The INFN-GRID EB Management Executive Board: Project Manager : Mirco Mazzucato Deputy Laura Perini Responsible CNAF and Tier-1: Federico Ruggieri Experiments representatives: Paolo Capiluppi (CMS) Domenico Galli (LHCB) Massimo Masera (ALICE) Laura Perini (ATLAS), Raffaele Tripiccione (APE) Fulvio Ricci (VIRGO) Mauro Morandin BABAR Stefano Belforte CDF Tech. Coordinators: Antonia Ghiselli & L. Luminari Coordinator Testbed INFN: Luciano Gaido Middleware: F. Prelz GOC: C. Vistoli Chair Institution Board: Lodovico Riccati Admin+other Sciences: G. Maggi, L. Merola last update 07/10/2020 17: 46 7

The INFN Grid project: GOALS (Updated) § Promote the development of the technology: Middleware

The INFN Grid project: GOALS (Updated) § Promote the development of the technology: Middleware area § Through the participation to European and International projects ¨ Data. Grid, Data. TAG, GLUE, LCG, EGEE § National R&D activities § Originally ‘ 99: Develop the Grid Infrastructure for INFN § Including Tier 1, Tier 2 and Tier 3: 20 sites §. . . and later supporting EDG, EDT GLUE, Dissemination. . . testbeds § ‘ 02 make a production world-wide infrastructure for LHC § LCG: Tier 1 e Tier 2 ; INFN: Tier 3 § Summer ‘ 02: study management issues related to the deployment of a National Grid infrastructure for several Sciences § FIRB: Grid. it project § ‘ 04: and integrate it in an EU e. Infrastructure supporting all sciences and the European Research Area (ERA) § EU FP 6: EGEE, IG-BIGEST § last update 07/10/2020 17: 46 Support applications in the construction of a grid production and analysis environment and Dissemination 8

INFN and Data. Grid § § Main effort is on WP 1: WMS (~15

INFN and Data. Grid § § Main effort is on WP 1: WMS (~15 FTEs) § Efforts are now devoted to complete the WP 1 interface to VOMS and bug fixes for LCG § INFN Grid is now supporting a special development testbed aiming at speeding up the release of the WP 1 new functionalities: ¨ DAGMAN for job dependencies ¨ Job partionning ¨ Accounting ¨ MPI, for parallel jobs Plans are being done to deliver all these for November 1 rst 2003 (after tests in the development testbed) The new functionalities like DAGMAN are essential to build a robust Grid distributed Production and Data analysis system INFN is currently evaluating the effort needed to interface to US RLS last update 07/10/2020 17: 46 9

Data. TAG and GLUE: activities § § Completed the Interoperability efforts with the US

Data. TAG and GLUE: activities § § Completed the Interoperability efforts with the US project i. VDGL (+Trillium) to define the GLUE ( Global Laboratory Uniform Environment) schema for CE, SE and NE http: //128. 3. 182. 66/mtgs/ivdgl/Interoperability. htm § GLUE information schema for CE, SE, NE is included now in Globus toolkit: INFN is a Globus Contributor § Data. TAG with i. VDGL have provided interoperable EDG(EU) and VDT(US) middleware for ATLAS and CMS § Demo at IST 2002 an SC 2002 § Being now repeated at IST 2003 and SC 2003 § § § INFN and EDT support LCG-0 currently deployed in CMS: 7 -8 sites § 500 K evts for PCP completed (KIN+SIM) Data. TAG is providing support to the construction of the LHC experiment production environment aiming at fully exploiting the LCG grid infrastructure. Should interwork with US i. VDGL infrastructure INFN Data. TAG expts support teams in ALICE (1 p), ATLAS (2 p), CMS (2 p) last update 07/10/2020 17: 46 10

Data. TAG WP 4 GLUE testbed Grid Computing and Storage elements in • INFN

Data. TAG WP 4 GLUE testbed Grid Computing and Storage elements in • INFN Bologna, Padova, Milan • CERN • FNAL • Indiana University Middleware • INFN Bologna, Padova, Milan • EDG 1. 4/GLUE • CERN • LCG-0 • FNAL - Indiana University • VDT 1. 1. X last update 07/10/2020 17: 46 Grid Services in Bologna/INFN: • RB/Glue aware based on EDG 1. 4 • GIIS GLUE testbed top level • VOMS • Monitoring Server 11

The Middleware developments born in INFN www. infn. it/grid § The Genius Portal developed

The Middleware developments born in INFN www. infn. it/grid § The Genius Portal developed with NICE ¨ Remain an INFN supported activity § The Grid. ICE Monitoring ¨ Now an official collaboration with EDG, EDT and LGC § The Virtual Organization Membership System (VOMS) ¨ ¨ ¨ last update 07/10/2020 17: 46 Now adopted by EDG, EDT, LCG and evaluated by several US projects in alternative to Globus CAS Is now being integrated with VOX in US Is now bein released 12

Università di Catania and INFN Catania - Italy The GENIUS Grid Portal Slides by

Università di Catania and INFN Catania - Italy The GENIUS Grid Portal Slides by Roberto Barbera (*)work in collaboration with A. Falzone and A. Rodolico Par. Co 2003, Dresden, 02. 09. 2003 CHEP 10. 02. 2000 last update 2000, 07/10/2020 17: 46 13 Roberto Barbera

Università di Catania and INFN Catania - Italy A web portal: why and how

Università di Catania and INFN Catania - Italy A web portal: why and how ? § It can be accessed from everywhere and by “everything” (desktop, laptop, PDA, WAP phone). § keep the same user interface to several back-ends (grid “dialects” command-line UI’s) § Hide users from EDG, VDT, Globus languages and versions § Take care of “security” at all levels: § § 1) secure for web transactions, 2) secure for user credentials, 3) secure for user authentication, 4) secure at VO level. § All available grid services are incorporated in a logic way, just “one mouse click away”. § Its layout is easily understandable and user friendly. Par. Co Dresden, 02. 09. 2003 last update 2003, 07/10/2020 17: 46 14 Roberto. Barbera

Università di Catania and INFN Catania - Italy GENIUS® (Grid Enabled web e. Nvironment

Università di Catania and INFN Catania - Italy GENIUS® (Grid Enabled web e. Nvironment for site Independent User job Submission) [https: //genius. ct. infn. it] INFN/NICE collaboration GENIUS web portal Applications’ specific layer Data. GRID architecture GLOBUS toolkit ALICE ATLAS CMS LHCb Other apps High level GRID middleware Basic Services OS & Net services Par. Co Dresden, 02. 09. 2003 last update 2003, 07/10/2020 17: 46 15 Roberto Barbera

Università di Catania and INFN Catania - Italy GENIUS: how it works https+java/xml+rfb GENIUS

Università di Catania and INFN Catania - Italy GENIUS: how it works https+java/xml+rfb GENIUS WEB Browser Engin. Frame 3 -tier model Local WS Apache EDG UI last update 07/10/2020 17: 47 EDG+GSI the Grid 16 Roberto Barbera

Università di Catania and INFN Catania - Italy GENIUS show: the main page last

Università di Catania and INFN Catania - Italy GENIUS show: the main page last update 07/10/2020 17: 47 17 Roberto Barbera

Università di Catania and INFN Catania - Italy GENIUS show: OS authentication last update

Università di Catania and INFN Catania - Italy GENIUS show: OS authentication last update 07/10/2020 17: 47 18 Roberto Barbera

Università di Catania and INFN Catania - Italy GENIUS show: grid authentication t u

Università di Catania and INFN Catania - Italy GENIUS show: grid authentication t u a y x ro P My last update 07/10/2020 17: 47 19 t a c i t n e h ! n io Roberto Barbera

Università di Catania and INFN Catania - Italy Grid authentication with My. Proxy EDG

Università di Catania and INFN Catania - Italy Grid authentication with My. Proxy EDG UI GENIUS Server (EDG UI) WEB Browser Local WS last update 07/10/2020 17: 47 My. Prox y Server grid-proxy-init myproxy-init ut p t ou s d i gr y an e el d t- e g xy n io t a g o r p y m exe cut ion e ic v r e the Grid 20 Roberto Barbera

Università di Catania and INFN Catania - Italy GENIUS and Grid. ICE monitoring last

Università di Catania and INFN Catania - Italy GENIUS and Grid. ICE monitoring last update 07/10/2020 17: 47 21 Roberto Barbera

Università di Catania and INFN Catania - Italy GENIUS: PDA version (new!) last update

Università di Catania and INFN Catania - Italy GENIUS: PDA version (new!) last update 07/10/2020 17: 47 22 Roberto Barbera

Genius: Other Services available § § § VO selection RB selection Graphic Job description

Genius: Other Services available § § § VO selection RB selection Graphic Job description (with Datamat) § Generate JDLs § § § § § last update 07/10/2020 17: 47 Generate single and multi-jobs File publication in RLS File browsing File inspection File replication File download Browse testbed: discover Ce, Se Provide Chat facility Interface with many applications to EDG and LCG M/W is available 23

Università di Catania and INFN Catania - Italy ALICE: interactive analysis last update 07/10/2020

Università di Catania and INFN Catania - Italy ALICE: interactive analysis last update 07/10/2020 17: 47 24 Roberto Barbera

Università di Catania and INFN Catania - Italy (courtesy of L. Vaccarossa) ATLAS: “GLUE”

Università di Catania and INFN Catania - Italy (courtesy of L. Vaccarossa) ATLAS: “GLUE” job submission US EU last update 07/10/2020 17: 47 25 Roberto Barbera

Università di Catania and INFN Catania - Italy (courtesy of L. Vaccarossa) ATLAS: interactive

Università di Catania and INFN Catania - Italy (courtesy of L. Vaccarossa) ATLAS: interactive analysis last update 07/10/2020 17: 47 26 Roberto Barbera

Università di Catania and INFN Catania - Italy (courtesy of M. Verlato) CMS grid

Università di Catania and INFN Catania - Italy (courtesy of M. Verlato) CMS grid integration schema Par. Co Dresden, 02. 09. 2003 last update 2003, 07/10/2020 17: 47 27 Roberto Barbera

Università di Catania and INFN Catania - Italy (courtesy of M. Verlato) A recent

Università di Catania and INFN Catania - Italy (courtesy of M. Verlato) A recent development for CMS: GENIUS/CMSPROD integration last update 07/10/2020 17: 47 28 Roberto Barbera

last update 07/10/2020 17: 47 29

last update 07/10/2020 17: 47 29

last update 07/10/2020 17: 47 30

last update 07/10/2020 17: 47 30

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project

Università di Catania and INFN Catania - Italy ALICE Collaboration and Data. Grid Project Ba. Bar: GENIUS/AFS interface last update 07/10/2020 17: 47 31 Roberto Barbera

Università di Catania and INFN Catania - Italy Ba. Bar: multi-job queue last update

Università di Catania and INFN Catania - Italy Ba. Bar: multi-job queue last update 07/10/2020 17: 48 32 Roberto Barbera

Università di Catania and INFN Catania - Italy GENIUS show: Earth Ob. app. last

Università di Catania and INFN Catania - Italy GENIUS show: Earth Ob. app. last update 07/10/2020 17: 48 33 Roberto Barbera

Università di Catania and INFN Catania - Italy GENIUS show: Biomed. app. last update

Università di Catania and INFN Catania - Italy GENIUS show: Biomed. app. last update 07/10/2020 17: 48 34 Roberto Barbera

Università di Catania and INFN Catania - Italy Genius: Summary and future § All

Università di Catania and INFN Catania - Italy Genius: Summary and future § All GENIUS services (also those not shown here) can be “seen” at the URL: § http: //alipc 1. ct. infn. it/grid/genius/ gallery § Interface to LCG 1 is almost completed § It is now interfaced to CMSPROD to generate automatically JDLs for all steps of one production assignment and submit jobs to the grid § Will provide a fully automatic control of all steps of the production for CMS PCP and DC until conclusion § Will be interfaced to other expts DC production environments § Will be used in EGEE for dissemination § Will be supported by INFN and Nice last update 07/10/2020 17: 48 36 Roberto Barbera

Grid. ICE The eyes of the grid A monitoring tool for a Grid Operation

Grid. ICE The eyes of the grid A monitoring tool for a Grid Operation Center Collaboration: INFN, EDT, LCG Sergio Andreozzi, Sergio Fantinel, Gennaro Tortone last update: 07/10/2020 17: 48 Mirco Mazzucato Infn -Padova 37

Grid. ICE base architecture and features • The tool is meant to address the

Grid. ICE base architecture and features • The tool is meant to address the problem of grid monitoring from the GOC viewpoint (VOs managers, sites supervisors) • Collection of different level metrics: low level (CPU load, memory/disk usage per host), service level (gatekeeper, gsiftp, …), high level (VO resource usage) • It is based on well known and widely deployed grid services: EDG-WP 4 fmon service for the collection of the measures at the site low level; MDS-GIS structure and interface with the integration of an extended GLUE schema to collect the information from the grid sites. • Automatic discovery of all the available resources, from a single network adapter of a computational site node to high level services (computational/storage). • The ability to collect Experiment specific measures (e. g. , CMS CMKIN/CMSIM event production) • Historical tracking of all the metrics with the ability of plotting and programmed alarm generation (e. g. , e-mail, sms) last update: 07/10/2020 17: 48 Mirco Mazzucato Infn -Padova 38

Grid. ICE status and release • GUI reporting the status of the available resources

Grid. ICE status and release • GUI reporting the status of the available resources in different ways aggregated per VO or per SITE with detailed description of all different components (see next slide) to give a number of different viewpoint of the testbed status/behaviour. • Generation of graph for aggregated metrics (e. g. , jobs, disk space) • Simple client side installation with a single RPM! • Software and instructions to install the monitoring server. • Deployment status: currently, a set of important testbeds are being monitored by Grid. ICE: • CMS-LCG 0 production • LCG 1 Certification • LCG 1 deployment • Grid. it • Data. TAG last update: 07/10/2020 17: 48 Mirco Mazzucato Infn -Padova 39

Grid. ICE Plans • Short term (foreseen for november ’ 03) • Monitoring of

Grid. ICE Plans • Short term (foreseen for november ’ 03) • Monitoring of collective grid services: • ability to add/configure any type of service (e. g. , Resource Broker, Logging and Bookkeeping, Batch Server, Resource Locator Service, …); • for every service the set of most important demons/processes will be tracked and monitored • Long term (one year and half from now) • Develop a new monitoring service structure following the GMA proposal based on event driven paradigm using new technology to achieve a more scalable mechanism; the following technologies are under evaluation: JMS/OGSA/WEB SERVICES; XML to improve message exchange portability and compatibility. last update: 07/10/2020 17: 48 Mirco Mazzucato Infn -Padova 40

Data presentation service (1) last update: 07/10/2020 17: 48 Mirco Mazzucato Infn -Padova 41

Data presentation service (1) last update: 07/10/2020 17: 48 Mirco Mazzucato Infn -Padova 41

Data presentation service (2) last update: 07/10/2020 17: 48 Mirco Mazzucato Infn -Padova 42

Data presentation service (2) last update: 07/10/2020 17: 48 Mirco Mazzucato Infn -Padova 42

VOMS Authorization § At least 2 entities involved ¨ Resource Providers (e. g. Tiers

VOMS Authorization § At least 2 entities involved ¨ Resource Providers (e. g. Tiers in LCG framework) ¨ Virtual Organizations (e. g. LHC experiments collaborations) § Resource granting established by agreements VO’s - RP’s. ¨ VO’s administer user membership, roles and capabilities ¨ RP’s evaluate authorization granted by VO to a user and map into local credentials to access resources § Need tool to manage membership for large VO’s (10000 users) ¨ Globus mechanism (grid-mapfile) not scalable § VO membership service (VOMS) ¨ Extends existing grid security infrastructure architecture with embedded VO affiliation assertions ¨ Permits authorization control on grid services for job submission, file and database access. last update 07/10/2020 17: 48 43

The National Grid e. Infrastructure § § § Main objective for INFN Grid in

The National Grid e. Infrastructure § § § Main objective for INFN Grid in the second half of 2003 and during 2004 is the deployment and operation of a National Production Grid Infrastructure (see document “The INFN-Grid Production Infrastructure” in grd. infn. it/grid/doc). This includes § LCG resources integration, including the Regional Centre at CNAF, T 2 s and related operation and management of general grid services § The FIRB Grid. it resources and operation and managment activities § The INFN Grid resources integration including Tier 3 § The EU FP 6 e. Infrastructure of EGEE last update 07/10/2020 17: 48 45

Production Grid: Planned activities § § Management/deployment of middleware (Start with LCG-1): 4 p

Production Grid: Planned activities § § Management/deployment of middleware (Start with LCG-1): 4 p The National Grid Operation Center (Service) § Development of supporting tools: 6 p ¨ SW repository, knowledge database, monitoring, support to installation/configuration, release test and validation (on each site) § Grid Administration: ¨ Central Team (8 p) + ¨ Site managers (20 p) § VO service support : 1 p per VO § User application support : 1 per VO § Release distribution, documentation & porting: 2 p § Coordination and integration with other EU GOC: 6 p § § Total people involved : ~35 p Part are funded by FIRB Grid. it (9 p), part by INFN and the rest will be funded by EGEE last update 07/10/2020 17: 48 46

INFN in Grid. it : Infrastructure deployment + support Status and plans Slides from

INFN in Grid. it : Infrastructure deployment + support Status and plans Slides from A. Caltroni, E. Ferro (INFN-Padova) A. Ferraro (INFN-CNAF) last update: 07/10/2020 17: 48 Mirco Mazzucato Infn -Padova 47

The Grid. it National Program TORINO MILANO PAVIA PADOVA BOLOGNA GENOVA PISA PERUGIA CNR

The Grid. it National Program TORINO MILANO PAVIA PADOVA BOLOGNA GENOVA PISA PERUGIA CNR & University HPC, Parallel Programming, Grid computing, Scientific libraries, Data base and knowledge discovery, Earth Observation, Computational chemistry, Image processing, … INFN & University Grid infratsructure(INFN-Grid, Data. Tag) , e-science applications: Astrophysics, ROMA Bioinformatics, Geophysics, … NAPOLI BARI ASI Funding: € 8. 1 M 3 -Year Project Start-up: November 2002 UR INFN: € 1. 58 M MATERA LECCE CAGLIARI COSENZA PALERMO last update 07/10/2020 17: 48 48 Applications of Earth Observation

The national Grid. it e. Infrastructure § In Grid. it INFN is responsible for

The national Grid. it e. Infrastructure § In Grid. it INFN is responsible for the creation of a national Grid Infrastructure and for studying and prototyping a national Grid Operation Service (GOS) § The generalization of the infrastructure support is a model successfully established in Italy with the research network (GARR) § § The GOS will also support several Italian Sciences applications and the operation of the Italian infrastructure also in the context of the new European Infrastructure project EGEE The Italian e. Science Grid. it infrastructure currently support: § § § § Astrophysics Biology Computational Chemistry Geophysics Earth Observation but other sciences are joining thanks to new MIUR funds (e. g. new SPACI and other PON projects) 9 FTE’s funded to INFN last update 07/10/2020 17: 48 49

Main INFN Grid. it activities § Select middleware for Grid. it infrastructure § ->LCG-1

Main INFN Grid. it activities § Select middleware for Grid. it infrastructure § ->LCG-1 § Deployment (already started at the beginning of August with an "unofficial" tag) of a "stable" grid infrastructure (LCG 1) § Study and solve production Grid management issues § Provide management tools § Support site setup § Help other institutions to use port/run their apps on the grid § Overview current developments. They are not final choices but a first step to understand related issues making real experience § Collaboration with LCG and EGEE in future last update 07/10/2020 17: 48 51

Deployment (1): Documentation § Documentation for users § Personal certificates howto § Job submission

Deployment (1): Documentation § Documentation for users § Personal certificates howto § Job submission howto § Grid dictionary § Documentation for site managers § § Server certificates howto LCFGng server installation (new guide without EDG relations) Grid. it middleware installation Post installation tests § Documentation for grid apps developers (in the future…) § Not yet finished but the light is coming. . . last update 07/10/2020 17: 48 52

Deployment (2): Simplify, simplify… § It is well known that the setup of LCFGng

Deployment (2): Simplify, simplify… § It is well known that the setup of LCFGng server + grid middleware is not a "Plug. And. Play" game § Grid. it try to simplify install and update procedures with a couple of packages: § git-lcfgutils: 1 package with a set of tools for common LCFGng server taks § git-lcfgconf-<griditversion>: 1 package with the LCFGng profiles specific of the Grid. it version (*-cfg. h and *rpm. h) ¨ No more manual CVS access ¨ Possibility to install more versions (smooth upgrade) last update 07/10/2020 17: 48 53

Deployment (3): (Try to) simplify the site manager's life § 1 command to update

Deployment (3): (Try to) simplify the site manager's life § 1 command to update all stuff needed by the LCFGng server: git-updateserver <griditversion> § It calls other tools (they can be run standalone) that perform common LCFGng tasks § "smart" packages download (all and only those needed): git -download § server packages update: git-updatesrvpackages § build installroot: git-buldinstallroot § create hdfiles: git-createhdfiles § git-updateserver is used for both installation and upgrade last update 07/10/2020 17: 48 54

Deployment (4): the GOC side § This automation is possible because GOC manage directly

Deployment (4): the GOC side § This automation is possible because GOC manage directly all aspects of the software repository § GOC activities for the deployment: § add Grid. it VOs to standard LCG ones § tools to compare quickly Grid. it packages lists and configuration files with the updates of LCG 1 § publish HTML packages lists for each release and for each grid element § document very carefully all aspects § test all installation and upgrade procedures last update 07/10/2020 17: 48 55

Support site (1) § Web site: http: //grid-it. cnaf. infn. it last update 07/10/2020

Support site (1) § Web site: http: //grid-it. cnaf. infn. it last update 07/10/2020 17: 48 56

Support site (2) § Composed by: § § last update 07/10/2020 17: 48 TYPO

Support site (2) § Composed by: § § last update 07/10/2020 17: 48 TYPO 3 (Content Management System) One. Or. Zero (Trouble Tickets System) CVS (Software Version Management) Grid monitoring (links to Grid. Ice server) 57

Support site (3): TYPO 3: Content Management System § TYPO 3, www. typo 3.

Support site (3): TYPO 3: Content Management System § TYPO 3, www. typo 3. org, Open Source CMS § Done with PHP + My. SQL § No html files to write but a complex and powerful web backend last update 07/10/2020 17: 48 58

Support site (4): One. Or. Zero: Users & Site Managers support § One. Or.

Support site (4): One. Or. Zero: Users & Site Managers support § One. Or. Zero, an Open Source trouble ticketing system § We added some customization last update 07/10/2020 17: 49 59

Support site (5) CVS repository § Almost all our docs + tools are stored

Support site (5) CVS repository § Almost all our docs + tools are stored in a CVS repository § Standard CVSWeb interface § Only for our needs, not for grid users nor site managers but accessible to everybody last update 07/10/2020 17: 49 60

To summarize: LCG-1 vs Grid. it 1. 0 § Grid. it 1. 0 =

To summarize: LCG-1 vs Grid. it 1. 0 § Grid. it 1. 0 = LCG 1 + some VO (infngrid, theophys, inaf, ingv, bio, gridit) § Installed apps of Atlas, Alice, CMS, LHCb and Babar + (in the future) apps from other sciences (biology, astronomy, …) § For both LCFGng for installation & management § Different organization of LCFGng repository directories § Reduced users pool: 20 users per VO instead of 50 (but could be increased) § LCFGng resources: Grid. it resources are a superset of LCG 1 (because of the addition of other VOs) last update 07/10/2020 17: 49 61

Coming (ASAP) § Install Grid services with LCG 1: Broker, GIIS, BDII and RLS

Coming (ASAP) § Install Grid services with LCG 1: Broker, GIIS, BDII and RLS § Integrate Grid. Ice monitoring § Test that we installed (CE, SE, WN, UI) are really in the grid § Release officially Grid. it 1. 0 (SE+CE+WN+UI): documentation + LCFGng stuff + packages last update 07/10/2020 17: 49 62

Mangement structure for the production Grid ~36 people Experiments 2 p EGEE, LCG coord

Mangement structure for the production Grid ~36 people Experiments 2 p EGEE, LCG coord Grid Resource Coordination Committee release Configuration management Management 4 p • Planning/Deployment 6 p GRID Projects 8 p • resource Policy usage • Management tools Operations Central Team Monitoring Authorization 4 p Site-man 2 p last update 07/10/2020 17: 49 Experimemt or research org. support Grid. Service support VO support Release distribution, documentation and porting 63 4 p User support Application

INFN prod. Grid (sites and resources) Experiments resources LCG T 1 -T 2 (Large

INFN prod. Grid (sites and resources) Experiments resources LCG T 1 -T 2 (Large Farms) Farm+ QG Solo QG MI/T 2 Atlas CT CNAF/T 1 PD CA PV FIRB BA Roma 1 GE Roma 3 BO LNL/T 2 CMS TO PI TS LE PD BA FE NA …. Siti di aggregazione Infn, ingv, inaf, bio last update 07/10/2020 17: 49 64 TO/T 2 Alice MI BO T 2 CNAF NA Roma 2 15*3+ 8+ (ba) 5 op

The re-organization of the testbeds § § Middleware private testbeds EDG Development testbed §

The re-organization of the testbeds § § Middleware private testbeds EDG Development testbed § Extension of the sites (CNAF, CT e TO) for extensive testing § EDG Application testbed § Reduction of number of sites (da 5 a 2 x l’INFN: PD e CNAF) § LCG Certification Testbed § 1 or 2 sites are ready to join CERN LCG certification testbed (Cnaf+. . ) § INFN Dissemination testbed § Ba + Pd. . § LCG Production testbed (LCG-1) § § 4 Italian sites: CNAF (Tier-1) e LNL, MI e TO (Tier-2) General production grid: Grid. it, EGEE § All INFN sites + Grid. it resources last update 07/10/2020 17: 49 65

The National Coordination of Grid activities in Italy The e. Business e. Industry e.

The National Coordination of Grid activities in Italy The e. Business e. Industry e. Government EScience and Technology (BIGEST) Italian Grid Initiative last update: 07/10/2020 17: 49 Mirco Mazzucato Infn -Padova 66

The Italian Grid for Business, Industry, Government, EScience&Technology (IGBIGEST) § § § It is

The Italian Grid for Business, Industry, Government, EScience&Technology (IGBIGEST) § § § It is a new national initiative leveraging from INFN, FIRB Grid. it and PON projects and aiming at coordinating all Italian Grid efforts and the Italian participation to EU FP 6 and international grid projects IG-BIGEST is coordinated by INFN and includes all Italian Sciences Institutions, major computing centers and many Industries ready to invest in early tests The IG-BIGEST main objectives are § To promote the creation of a general EU grid infrastructure for e. Science ¨ ->EU e. Infrastructure proposal: EGEE § To promote R&D on open Grid issues § To support development of specific components and usage of Grid by major applications in e-Science, e. Industry and e. Government § last update 07/10/2020 17: 49 ->New projects 67

INFN prod. Grid (sites and resources) Experiments resources LCG T 1 -T 2 (Large

INFN prod. Grid (sites and resources) Experiments resources LCG T 1 -T 2 (Large Farms) Farm+ QG Solo QG MI/T 2 Atlas CT CNAF/T 1 PD CA PV FIRB BA Roma 1 GE Roma 3 BO LNL/T 2 CMS TO PI TS LE PD BA FE NA …. Siti di aggregazione Infn, ingv, inaf, bio last update 07/10/2020 17: 49 68 TO/T 2 Alice MI BO T 2 CNAF NA Roma 2 15*3+ 8+ (ba) 5 op

Conclusions § INFN Grid has been re-organized to deploy and operate a general production

Conclusions § INFN Grid has been re-organized to deploy and operate a general production grid for: § Grid. it § LCG § EGEE § At the same time old WP activities have been grouped in 4 areas of activities § § § last update 07/10/2020 17: 49 Middleware Production grid Application support Dissemination IG-BIGEST provide overall coordination of Italian grid activities in view also of the participation to international project 69