NDS Labs and Dataverse David Raila National Data

NDS Labs and Dataverse: David Raila National Data Service Labs July 12, 2016 Dataverse Community Meeting 2016 Harvard Medical School Dataverse Community Meeting - July 12, 2016

NDS Labs and Dataverse The National Data Service National effort towards enabling scientists to broadly publish, find, and reuse digital data collections. Bringing together R&D software and cyberinfrastructure efforts focused on the management, movement, access, analysis and overall publication of data. Addressing interoperability of data management tools and services. “To build on the data archiving and sharing efforts already underway within specific communities and link them together with a common set of tools designed around the following capabilities” Dataverse Community Meeting - July 12, 2016 2

NDS Labs and Dataverse NDS Labs ● Develops environments, tools, and practices for rapid development, sharing, integration, experimentation, and collaboration around NDS-oriented applications. ● Assembling modern innovations in IT, cloud, and container-based service infrastructures in reusable form. ● Fast, self-managed, scalable, reliable, reusable, turn-key environments. ● Data tools, developer tools, infrastructure tools Dataverse Community Meeting - July 12, 2016 3

NDS Labs and Dataverse NDS Labs Testdrive ● Web-based, turn-key deployment of data tools ● Browse catalog of tools - community contributed ● Deploy in seconds ● Add, remove at will ● Test, evaluate, compare ● A personal test environment Dataverse Community Meeting - July 12, 2016 4

NDS Labs and Dataverse Example: Dataverse ● Integration of new, existing and modified containers ● Room for more! https: //github. com/nds-org/ndslabs-specs/dataverse https: //github. com/nds-org/ndslabs-dataverse Dataverse Community Meeting - July 12, 2016 5

NDS Labs and Dataverse Clowder: with Terra-MEPP Mobile Energy. Crop Phenotyping (MEPP) https: //github. com/nds-org/ndslabs-specs/clowder https: //github. com/nds-org/ndslabs-clowder Dataverse Community Meeting - July 12, 2016 6

NDS Labs and Dataverse + i. RODS in NDS Labs i. CAT Dataverse Files irsync bitcurator. r archive. r Dataverse Preservation Federation Collaboration to add Odum/RENCI Dataverse-i. RODS integration in Labs 10 different containers representing Dataverse, local i. RODS i. CAT, preservation federation i. CAT Files are synchronized from Dataverse to a local i. RODS instance Custom curation workflow applies Bit. Curator rule to identify sensitive information Dataverse Community Meeting - July 12, 2016 7

NDS Labs and Dataverse NDS Labs Develop ● Turn-key, web hosted developer tools ● Code, test, containerize from a browser ● Sharable - developer and Data tools ● Button-press publish to NDS Labs catalog ● NDSC 6 October Dataverse Community-Meeting - July 12, 2016 8

NDS Labs and Dataverse Contribute and collaborate ● General Q&A (Google group) ○ https: //groups. google. com/forum/#!forum/ndslabs ○ Ask questions, propose ideas, announce your services ● Code and issues (Github): ○ Fork, create pull requests, report issues ○ https: //github. com/nds-org/ndslabs ● Developer chat (Gitter) Dataverse Community Meeting - July 12, 2016 9