Open Data Open Science Open Search CERN Dr

  • Slides: 22
Download presentation
Open Data Open Science Open Search @ CERN Dr Tim SMITH, Dr Andreas Wagner

Open Data Open Science Open Search @ CERN Dr Tim SMITH, Dr Andreas Wagner - CERN OSSYM - Web-meeting on Open Internet Search CERN – 2020/05/26 CERN – IT Department CH-1211 Genève 23 Switzerland www. cern. ch/i t

CERN Science for Peace Collaboration Fundamental Research 27 km 23 Member States 70 Countries

CERN Science for Peace Collaboration Fundamental Research 27 km 23 Member States 70 Countries 120 Nationalities 600 Universities -271. 3 o. C 99. 999999%

Big Data ! 40 million collisions /s 150 M sensors Trigger 100 k events

Big Data ! 40 million collisions /s 150 M sensors Trigger 100 k events /s Record 10 GB /s Calibrate Reconstruct 10 M lines of code Analysis at 167 sites around world 320 PB

Data Driven Science Opal Experiment 1903 1995

Data Driven Science Opal Experiment 1903 1995

Research Iceberg k. B 1, 000 MB 1, 000 GB 1, 000, 000 TB

Research Iceberg k. B 1, 000 MB 1, 000 GB 1, 000, 000 TB 1, 000, 000 PB 1, 000, 000 @Tim. Smith. CH

The Web Free Market Share ≠ Publish ≠ Preserve @Tim. Smith. CH

The Web Free Market Share ≠ Publish ≠ Preserve @Tim. Smith. CH

CERN Open Data http: //opendata. cern. ch http: //inveniosoftware. org

CERN Open Data http: //opendata. cern. ch http: //inveniosoftware. org

Analysis Preservation Internal Peer Review http: //github. com/cernanalysispreservation External Peer Review

Analysis Preservation Internal Peer Review http: //github. com/cernanalysispreservation External Peer Review

Enabling Open Science Open Access Pilot Open Access Mandate Open Data Pilot ORD &

Enabling Open Science Open Access Pilot Open Access Mandate Open Data Pilot ORD & DMP by default @Tim. Smith. CH

Open Research as a Service http: //zenodo. org

Open Research as a Service http: //zenodo. org

Open Research as a Service

Open Research as a Service

Share ≠ Publish ≠ Preserve

Share ≠ Publish ≠ Preserve

Towards Digital Age Scholarship Research Centric Article Centric Peer Reviewers @Tim. Smith. CH

Towards Digital Age Scholarship Research Centric Article Centric Peer Reviewers @Tim. Smith. CH

Preservation ↔ Reusability http: //reana. io

Preservation ↔ Reusability http: //reana. io

Open Science… Public good Equality of access Efficiency Reproduce Validate Quality science Economy Reuse

Open Science… Public good Equality of access Efficiency Reproduce Validate Quality science Economy Reuse Impact Measure Innovation …to advance knowledge, technology, society

Search @ CERN Moving from a commercial Enterprise Search solution … . . .

Search @ CERN Moving from a commercial Enterprise Search solution … . . . to an Open Source Enterprise Search solution

Open Source Enterprise Search solution Core components • Invenio • open source framework for

Open Source Enterprise Search solution Core components • Invenio • open source framework for large-scale digital repositories • Elasticsearch What’s new? • Multiple micro-services • Decentralized • Global aggregator

Open Source Enterprise Search solution • JSON documents (extensible) • Full text indexing (PDF,

Open Source Enterprise Search solution • JSON documents (extensible) • Full text indexing (PDF, PPT, . . . ) • Access control and isolation • Document level ACLs • Web UI + RESTful API • Python, Invenio Framework • Docker, Open. Shift • Elasticsearch

Open Source Enterprise Search solution • Presently working on migrating of CERN’s main document

Open Source Enterprise Search solution • Presently working on migrating of CERN’s main document repositories: • EDMS • CERN’s Engineering and Equipment Data Management System • Indico • Provides support for organising events of all sizes • JACo. W • Joint Accelerator Conferences Website

Open Search – Search @ CERN Looking forward to: • Continue our exchange of

Open Search – Search @ CERN Looking forward to: • Continue our exchange of knowledge and experience • Evaluate technical solutions • Support the activities of the Open Search Foundation • Foster the scientific exchange • Open Search Symposium 2020 and beyond

Open Search… Public good Equality of access Quality Efficiency Open Search Economy Impact Measure

Open Search… Public good Equality of access Quality Efficiency Open Search Economy Impact Measure Innovation …to advance knowledge, technology, society

Thank You ! Questions ? CERN Open Data http: //opendata. cern. ch http: //github.

Thank You ! Questions ? CERN Open Data http: //opendata. cern. ch http: //github. com/cernopendata CERN Analysis Preservation http: //analysispreservation. cern. ch http: //github. com/cernanalysispreservation analysispreserv http: //orcid. org/0000 -0002 -1567 -7116 http: //cern. ch/Tim. Smith REANA http: //www. reanahub. io http: //github. com/reanahub http: //openaire. eu Invenio http: //inveniosoftware. org http: //github. com/ inveniosoftware Zenodo http: //zenodo. org http: //github. com/zenodo_org