EGIIn SPIRE Connecting the European Grid Infrastructure to

EGI-In. SPIRE Connecting the European Grid Infrastructure to Research Communities Steve Brewer Chief Community Officer, EGI. eu 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 1 www. egi. eu

What is EGI? • European: – Focus on meeting the needs of European Researchers – Their key need is to collaborate internationally • Grid: – Federation of shared resources – Supportive of the collaborative social network • Infrastructure: – Physical and organisational structures – Services and facilities for an economy to function 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 2 www. egi. eu

European Grid Infrastructure • European Data Grid (EDG) – Explore concepts in a testbed • Enabling Grid for E-scienc. E (EGEE) – Moving from prototype to production • European Grid Infrastructure (EGI) – Routine usage of a sustainable einfrastructure 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 3 www. egi. eu

European Grid Infrastructure Status April 2010 (yearly increase) • 10000 users: +5% • 243020 LCPUs (cores): +75% • 40 PB disk: +60% • 61 PB tape: +56% • 15 million jobs/month: +10% • 317 sites: +18% • 52 countries: +8% • 175 VOs: +8% • 29 active VOs: +32% 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 4 www. egi. eu

EGI Collaboration Research Community N G I E I R O Research Community N G I Research Community E I R O N G I EGI. eu 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 5 www. egi. eu

EGI. eu • Coordination for European Grid resources – Established February 8 th 2010 – Central policy & services needed to run a grid – Sustainable small coordinating organisation • Based in Amsterdam – Coordinating core (~20 people) in Amsterdam – Technical services from partners (~20 people) EGI and EGI. eu supported initially by EGI-In. SPIRE 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 6 www. egi. eu

The EGI-In. SPIRE Project Integrated Sustainable Pan-European Infrastructure for Researchers in Europe • A 4 year project with € 25 M EC contribution – Project cost € 72 M – Total Effort ~€ 330 M – Effort: 9261 PMs Funded Un-Funded Project Partners (51) • EGI. eu, 40 NGIs, 2 EIROs • Asia Pacific (8 partners) 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 7 www. egi. eu

A Virtuous Service Cycle Production quality infrastructure built from technology deployed across Europe Users Infrastructure New technology releases assessed against defined criteria before being deployed Requirements Resource providers represented by NGIs/EIROs in the Operations Management Board Assessment 05/09/2021 EGI-In. SPIRE RI-261323 Users represented by Virtual Research Communities in the User Community Board EGI Astro PP USAG: User Services Advisory Group OTAG: Operational Tools Advisory Group Technology Coordination Board prioritised for Technology Providers Technology 8 www. egi. eu

EGI Supports Innovation • Deploy Technology Innovation – Distributed Computing continues to evolve • To include: Grids, Desktops, Virtualisation, Clouds, … • Enable Software Innovation – Provide reliable persistent technology platform • Tools built on g. Lite/UNICORE/ARC/Globus • Support Research Innovation – Infrastructure for data driven research • Support for international research (e. g. ESFRI) 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 9 www. egi. eu

User Community Services • Enable (and cultivate) a human network – Researchers in International Collaborations – National Research Collaborations through the NGI – Scale up from the single VO to a community • Provide a federated Helpdesk linking: – Human and Technical services (e. g. Training) – Discipline specific support (e. g. Bio Apps) – Operation teams in the resource centres 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 10 www. egi. eu

Current Technical Services • Training Events – Calendar of training events available to all infrastructure providers and technologies. • Training Repository – Central point for the training material from EGI community • Applications Database – A catalogue of all applications that have been ported or are being ported within the infrastructure • VO Services – To help build the collaborations within your community • • VOMS VO database & registration services Basic portals VO Dashboards 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 11 www. egi. eu

Other Activities • Communication – With NGIs, VRCs and other projects • Needs of the Heavy User Communities – General & community specific services • Building a community – Two Annual meetings: Users & Technology • Technology Assessment and Integration – Liaison with software providers – Definition and verification of requirements 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 12 www. egi. eu

Research Innovation • Infrastructure to support European Researchers – Within the EU 27 – Geographical Europe – Interoperability worldwide for collaboration • Work with Virtual Research Communities – Groupings of aligned Virtual Organisations – Enable their community specific support activity: • Support, training, consultancy, requirements etc. 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 13 www. egi. eu

Interacting with VRCs • EGI has to scale – In terms of users & disciplines – Bring resources together to serve users • Focus on Virtual Research Communities – VRCs links EGI to a community structure • Group defined by Mo. U, conference, organisation, … – It is the human collaborative side of the grid • The VO is the technical instantiation of collaboration 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 14 www. egi. eu

An Evolving Relationship User Community Support Team (EGI. eu) Defined by Mo. U 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 15 www. egi. eu

Why become a VRC? • Evolve and drive forwards EGI’s services – User Community Board (UCB) • Policy, procedures and technical management – User Services Advisory Group (USAG) • Technical evolution of the provided services • Benefit from and share your experiences with others • Use our expertise to integrate your communities resources into the production infrastructure • Managed helpdesk for resolving infrastructure and support issues – if you have them! 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 16 www. egi. eu

A Virtuous User Cycle Aka: “the chicken and egg conundrum. . . Feedback through VRCs in the User Community Board Design Discover How can I contribute? Where is the community? - VRCs Mailing lists Workshops Forums Blogs Projects Sharing stories Collaborating 05/09/2021 EGI-In. SPIRE RI-261323 User Services Advisory Group to drive detailed design Deliver Integrated Services • Human • Technical • Infrastructure EGI Astro PP - Applications Data collections Requirements Proposals Projects Success stories How do I use these resources? - Attend training courses - Utilise training material - Access data - Run applications on the grid 17 www. egi. eu

A Virtualised Future? VO Specific Operations Staff Infrastructure Providers 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 18 www. egi. eu

Summary • EGEE: – Demonstrated a production e-infrastructure • EGI: – Provide a sustainable production e-infrastructure • EGI. eu established in Amsterdam – Supported transition through EGI-In. SPIRE – Reaching out to Virtual Research Communities 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 19 www. egi. eu

Questions? • Call for papers opens October 2010 • See www. egi. eu/EGIUF 2011 for more details • Contact: – Steven Newhouse • director@egi. eu – Steve Brewer • cco@egi. eu 05/09/2021 EGI-In. SPIRE RI-261323 EGI Astro PP 20 www. egi. eu