Photon and Neutron Open Science Cloud WP 6

Photon and Neutron Open Science Cloud WP 6 – EOSC integration J-F. Perrin (ILL) 15 th Jan 2019 Page 1 This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 823852

What is EOSC? Objective “Ensure that European scientists reap the full benefits of data-driven science” In practical term Federate, at the EU level, data and computing services to provide a user friendly and as comprehensive as possible, environment for data scientists. Current status Governance structure in place (Vienna, 23 Nov 2018). 300 M€ invested in projects: EOSC pilot, EOSC Hub, FREYA, … Pa. NOSC The portal is live https: //eosc-portal. eu/ Page 2 Author – Presentation Name – date This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 823852

Current portal Page 3 J-F. Perrin (ILL) - Pa. NOSC kick-off 15 -16 January 2019 This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 823852

Collaboration at the EU level Engagement in building EOSC: strategic, executive and technical. Engaging with other EOSC Stakeholders ( participations in conferences, workshops, steering committees & WG) Build strong links and get a mutual understanding with the different EOSC stakeholders. Help to shape an EOSC which is meaningful for our user communities. Collecting needs and requirements from the Pa. NOSC partners and provides a collective response. Making use of relevant EOSC services for the project. … J-F. Perrin (ILL) - Pa. NOSC kick-off 15 -16 January 2019 Page 4 This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 823852

Service Catalogue Integration of the Pa. NOSC services into the EOSC Service catalogue - Integrate standards in terms of service management: Fit. SM - In terms of service description, documentation - implement tools to collect and report usage statistics - monitor services, is the Service Level Agreement met? Participate in the evolution of the service catalogue - Is the information available sufficient for our users? - Is the current organisation of services meaningful? -… Page 5 J-F. Perrin (ILL) - Pa. NOSC kick-off 15 -16 January 2019 This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 823852

Data availability Data sets at the Pa. N RIs vary from few GB to 100 TB … How to move data to other cloud Iaa. S (I. E. computing Infrastructure) ? - What protocol / standards should be implemented? - What are the technical / Organisational constraints? - What are the real limits of such a model? When data are too big to be moved - How to integrate on premises resources into the EOSC compute cloud? - Security constraints? - Business model? Page 6 J-F. Perrin (ILL) - Pa. NOSC kick-off 15 -16 January 2019 This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 823852

Authentication Authorisation Infrastructure A common identification (at least fully interoperable) of the users by the different service providers is key for the success of EOSC - Check-in Page 7 J-F. Perrin (ILL) - Pa. NOSC kick-off 15 -16 January 2019 How to unify AAI - Integration model? Metadata availability at the service? Technical solutions (Id. P – SP)? Security, Incident response in the frame of EOSC? - Responsibilities? - Need for a sustainable model (that could grow with user adoption, ensure compliance with regulations, …) - Ensure that EOSC AAI reply to our needs. This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 823852

Services Support Awesome! we have fantastic services published on the EOSC portal … - How do we collect users support requests / tickets form data scientists? Technical issues vs scientific questions? How to ensure proper response when the request concerns many RIs? Where are the limits? What is the model after the end of Pa. NOSC (link with WP 7) This organisation should ensure that all requests are addressed following the Service Level Agreements published in the EOSC service catalogue, and that activities are aligned with the customer relationship process to be jointly defined with the support of the EOSC-hub project. Page 8 J-F. Perrin (ILL) - Pa. NOSC kick-off 15 -16 January 2019 This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 823852

Pa. N Software catalogue Page 9 J-F. Perrin (ILL) - Pa. NOSC kick-off 15 -16 January 2019 This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 823852

Pa. N Software catalogue https: //software. pan-data. eu - Software catalogue for the Pa. N community References Analysis and Simulation software supported at the facilities Provides complete examples with data sets Practical example for scientific instruments Needs to be adapted: - Link/implement to Docker/ VM image registries - Integrate into the EOSC database catalogue (APIs) - Integrate EOSC monitoring tools - … Page 10 J-F. Perrin (ILL) - Pa. NOSC kick-off 15 -16 January 2019 This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 823852

Data archiving pilot Not all of us have long term archiving capabilities, could we archive in EOSC? Easy, many companies are doing it! Really easy even with high throughput production data over the Internet? - Page 11 What are the different requirements of the archivers? Get insight on the real technical requirements Organisational model? Cost and economical model? J-F. Perrin (ILL) - Pa. NOSC kick-off 15 -16 January 2019 This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 823852

Procurement of commercial cloud services (M 30 - M 42) Commercial cloud services may constitute an important alternative “scale-out” solution for peak demands of data analysis needs in the RIs. - Mechanism? How to? Real cost (in a mutualised tender) ? How to allocate resources to in-house scientists? Business model for data scientist? Page 12 J-F. Perrin (ILL) - Pa. NOSC kick-off 15 -16 January 2019 This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 823852

Photon and Neutron Open Science Cloud Thank your for your attention. Page 13 This project has received funding from the European Union's Horizon 2020 research and innovation programme under grant agreement No 823852