EUDAT Three Years On Shaun de Witt Jensen

EUDAT Three Years On Shaun de Witt, Jensen (STFC)

Outline • • Where EUDAT Started Where is it Now What is the Future Contact Information

A Caveat… • This is NOT an official EUDAT Presentation. • Opinions expressed may not represent the views of the EUDAT Project

EUDAT – The History • Aims to Develop a Pan-European Collaborative Data Infrastructure – Cost Efficient and High Quality Collaborative Data Infrastructure – Flexible to meet users needs with a view to long term sustainability – Across geographic and disciplinary boundaries • Funded by European Community’s Seventh Framework Programme (FP/2007 -2013), grant agreement No 283304

Partners

Communities

The Plan Joint Metadata Service AAI PID Aggregated EUDAT metadata domain. Data inventory Network of trust among authentication and authorization actors Identity Integrity Authentication Location Dynamic Replication Dynamic replication to HPC workspace for processing Safe Replication Data curation and access optimization Research Data Store Researcher data store (simple upload, share and access)

Achieving The Vision • Reuse, Reuse – Minimal development – Campaign to select underlying technologies • Sustainability, maturity, open-ness, deployment • Main tools: – IRODS, INVENIO, CKAN, (OWNCLOUD)

Branding and Evolution • • Safe Replication Dynamic Replication Metadata Research Data Store Drop-box like Semantic Annotation – B 2 Note Generic Execution Framework

Current Services

• http: //www. eudat. eu/b 2 safe • Currently used by 10 distinct communities – Approx 200 TB stored

• http: //www. eudat. eu/b 2 stage • Currently used by 3 communities – May be used in future PRACE call – May link to other e-Infrastructures

• http: //eudat. eu/b 2 find – http: //b 2 find. eudat. eu/ • 11 communities, 384, 000 data sets

• http: //www. eudat. eu/b 2 share – https: //b 2 share. eudat. eu/ • 5 communities, 160 objects

• http: //www. eudat. eu/b 2 drop – https: //b 2 drop. eudat. eu/ • Currently in beta testing – But you can register and use it

Plus Infrastructure • • • Help desk Central Monitoring Site Registry Resource Co-ordination Documentation

The B 2 Suite

The Future

EUDAT 2020 • Second round of EC Funding Secured under Horizon 2020 – More partners (35 different organisations) – Sustainability – Closer ties to other e-Infrastructures – Improvements to Existing Services and Integrating B 2 Suite – New Services and Policies – New Research Areas

New Services • • Workflow Integration Semantic Annotation Workspaces Integration with data analytics

New Policies • Data Curation • Data Provenance

New Research • Science Driven – Data Lifecycle Modelling and Directives – Handling of Dynamic Data • Technology Driven – Increased use of HTTP and Web. DAV – Integration of Object Stores – Use of Data Graphs – Improving tape efficiency

Contacts

Questions?