www egi eu EGIe Infra Data Management Onedata

www. egi. eu @EGI_e. Infra Data Management Onedata features and status Baptiste Grenier & Giuseppe La Rocca EGI Foundation The work of the EGI Foundation is partly funded by the European Commission under H 2020 Framework Programme

Release notes – v 18. 02. 1 -rc 13 • The new versions provides many improvements and new features, from which the most important are: § Add fixes to improve the stability with Oneprovider. § Improved speed of indexing of large datasets. § Implementation of user defined data indexes, used for querying the data based on specific metadata. § Web. DAV support. § Improvements in the metadata extraction, ingestion and manipulation. § Improved data monitoring API allowing to monitor the changes in data and depending on the type of the change invoking actions, i. e. data replication. § AAI: Support for OIDC. § PID management: Handle. net/B 2 Handle integration. § Cataloguing and discovery: B 2 Find integration. § Data-intensive computation: Integration with the EGI Notebooks. § APIs updated. The work of the EGI Foundation is partly funded by the European Commission under H 2020 Framework Programme www. egi. eu @EGI_e. Infra 1/25/2022 2

Perform data analysis on large volume of data Demo at CS 3 ● Analysis ○ Notebooks / Jupyter. Lab ○ Fed. Cloud resources ● Data management ○ Data. Hub / Onedata ■ Space ■ Onezone ■ Oneprovider ■ Oneclient ● AAI (OIDC) ○ Check-in ● PID management ○ B 2 HANDLE ○ Handle. net ● Cataloguing and discovery ○ B 2 FIND The work of the EGI Foundation is partly funded by the European Commission under H 2020 Framework Programme www. egi. eu @EGI_e. Infra 1/25/2022 3

Next steps • Move the service in Beta § To be discussed during the next SSB meeting. • Finalize the OLA for Onezone/Oneprovider. • PANOSC WP 6: § Evaluation of the solution for possible pilots. • Training: § Organizing a session about data platforms for data processing during the EOSChub week. § Preparation of a training for EGI staff The work of the EGI Foundation is partly funded by the European Commission under H 2020 Framework Programme www. egi. eu @EGI_e. Infra 1/25/2022 4

Links • EGI Data. Hub § § https: //datahub. egi. eu/ https: //community. egi. eu/c/egi-services/datahub https: //egi-datahub. readthedocs. io/ https: //wiki. egi. eu/wiki/EGI_Federated_Data • System requirements § https: //onedata. org/docs/doc/system_requirements. html • Official Onedata documentation § https: //onedata. org/#/home/documentation § Getting started o https: //github. com/onedata/getting-started § Source code: https: //github. com/onedata The work of the EGI Foundation is partly funded by the European Commission under H 2020 Framework Programme www. egi. eu @EGI_e. Infra 1/25/2022 5

Thank you for your attention. Questions? The work of the EGI Foundation is partly funded by the European Commission under H 2020 Framework Programme This work by the EGI Foundation is licensed under a Creative Commons Attribution 4. 0 International License. www. egi. eu @EGI_e. Infra