The Dryad Data Repository Metadata Workflows and Processes

  • Slides: 33
Download presentation
The Dryad Data Repository: Metadata Workflows and Processes 2 nd Data Management Workshop November

The Dryad Data Repository: Metadata Workflows and Processes 2 nd Data Management Workshop November 28 th – 29 th 2014 University of Cologne, Germany Jane Greenberg Professor, College of Computing & Informatics (CCI) Director, Metadata Research Center <MRC> Erin Clary, Dryad Curator, CCI/MRC 1

Dryad…a curated general-purpose repository…makes data discoverable, freely reusable, and citable. s to t s

Dryad…a curated general-purpose repository…makes data discoverable, freely reusable, and citable. s to t s i t n e i s, es sc g l n b i a d n n i e f “… hed s i l b u p validate w analysis ne ose p r u p e explore r gies, o l ns o o i d t o s h e t u e q m rch a e s e r r e h t data fo y b d ipate c i t n d a n n a u , s r o s. ” auth l e i a d n i u t g i s r o hetic t n y s m g/) r o. perfor d a y tadr a d / / : p t (ht 3 Not s i th

http: //datadryad. org/

http: //datadryad. org/

JDAP

JDAP

Pre-populated metadata field

Pre-populated metadata field

7

7

Elsevier’s Science Direct: EXAMPLE: Dryad Unmack, et al, Phylogeny and biogeography…Molecular Phylogenetics and Evolution

Elsevier’s Science Direct: EXAMPLE: Dryad Unmack, et al, Phylogeny and biogeography…Molecular Phylogenetics and Evolution http: //dx. doi. org/10. 1016/j. ympev. 2012. 019. 8

Elsevier’s Science Direct: EXAMPLE: Dryad Unmack, et al, Phylogeny and biogeography…Molecular Phylogenetics and Evolution

Elsevier’s Science Direct: EXAMPLE: Dryad Unmack, et al, Phylogeny and biogeography…Molecular Phylogenetics and Evolution http: //dx. doi. org/10. 1016/j. ympev. 2012. 019

Data downloads reuse citation Download 10678 times Observations, motivating study of metadata capital 1.

Data downloads reuse citation Download 10678 times Observations, motivating study of metadata capital 1. Metadata generation costs money 2. Metadata reuse is a part BIG of Dryad’s workflow 3. Metadata reuse via OAI 4. Metadata reuse via data sharing, reuse, and repurposing

Greenberg J, Swauger S, Feinstein EM (2013) Data from: Metadata capital in a data

Greenberg J, Swauger S, Feinstein EM (2013) Data from: Metadata capital in a data repository. Proceedings of the International Conference on Dublin Core and Metadata Applications http: //dx. doi. org/10. 5061/dry ad. 8 c 1 p 6

wo rkf low Journal Re. Blackout s Wrkfl Am. Ntrl N N MBE Bio.

wo rkf low Journal Re. Blackout s Wrkfl Am. Ntrl N N MBE Bio. Risk BMJ Open N Y Y N N N Y …. • Journals (80+…PLOS): http: //datadryad. org/pages/i ntegrated. Journals • X >10 GB = $15, $10+ statistics Type Total 30 days Data packages 6867 198 Data files 21056 977 Journals 364 77 Authors 24500 3492 639314 36006 Downloads

http: //wiki. datadryad. org/Sample_Dryad_Content#Examples_by_file_type

http: //wiki. datadryad. org/Sample_Dryad_Content#Examples_by_file_type

Interoperability Governance Technology “non-profit status, 12 member Board of Directors” DSpace DOIs via CDL/Data.

Interoperability Governance Technology “non-profit status, 12 member Board of Directors” DSpace DOIs via CDL/Data. Cite CC 0 (<m> + data) Integration with specialized repositories and databases § Federated searching with Tree. BASE and KNB LTER § Tree. BASE submission (OAI-PMH) § Gen. Bank (currently in development) § Sets policy, goals • science, journals, societies, OCLC, MS § 2006 Dryad development – NESCent +<MRC> • Stakeholders: journals, publishers and scientific societies, and researchers. § 2009 -2012: Interim Board $ PAYMENT-Sept. 1, 2014

Sustainability: Plan Comparison Payment Plan Member Non-member Minimum purchase 1. Voucher Plan USD$65 per

Sustainability: Plan Comparison Payment Plan Member Non-member Minimum purchase 1. Voucher Plan USD$65 per data package USD$70 per data package 25 vouchers 2. Deferred Payment Plan USD$70 per data package USD$75 per data package 1 yr contract 3. Subscription Plan Annual fee based on USD$25 per published research article Annual fee based on USD$30 per published research article 2 yr contract NA USD$80 per data package, payable by the submitter 1 data package For individuals: Pay on acceptance

More on grown and sustainability § Membership: http: //datadryad. org/pages/ membership. Overview § Pricing

More on grown and sustainability § Membership: http: //datadryad. org/pages/ membership. Overview § Pricing and sponsorship of deposits: http: //datadryad. org/pages/prici ng § Journal integration: § http: //datadryad. org/pages/journal. Integra tion

18

18

Metadata research & development 1. Curation workflow - cognitive walkthroughs 2. Dryad metadata scheme

Metadata research & development 1. Curation workflow - cognitive walkthroughs 2. Dryad metadata scheme development - crosswalk analyses (Dube, et al, 2007; Carrier, et al, 2007; White et al. , 2008, Greenberg, et al, 2010; Greenberg 2009; 2010) 3. Metadata reuse - content analysis (Greenberg, IDCC Research Summit, 2010) 4. Instantiation - multi-method study (comprehensions assessment) (Greenberg, RDAP, 2010, UNAM 2012) 5. Name-authority control - exploratory study (Haven, 2009, INLS 720) 6. KO/metadata community practices - Concurrent triangulation mixed methods (survey + simulation experiment) (White, 2010, ASIST, 2010 JLM) 7. Metadata functions - quantitative categorical analysis (Willis, Greenberg, and White, 2010, CODATA, 2012, JASIST) 8. Vocabulary needs (HIVE) – mapping study (Greenberg, (HIVE) 2009, CCQ; Scherle, 2010, Code 4 Lib) 9. Metadata theory – deductive analysis (Greenberg, 2009)

Dryad DCAP, ver. 3. 0 § § bibo (The Bibliographic Ontology) dcterms (Dublin Core

Dryad DCAP, ver. 3. 0 § § bibo (The Bibliographic Ontology) dcterms (Dublin Core terms) dryad (Dryad) Dw. C (Darwin Core) Singapore Framework Vision 1. Simple: automatic metadata gen; heterogeneous datasets *Data-package centric 2. Interoperable: harvesting, crosssystem searching 3. Semantic Web compatible: sustainable; supporting machine processing Greenberg, et al, 2009, Metadata Best Practice for a Scientific Data Repository, JLM, DOI: 10. 1080/1938638090 3405090.

Helping Interdisciplinary Vocabulary Engineering (HIVE) 21

Helping Interdisciplinary Vocabulary Engineering (HIVE) 21

~~~~Amy DATA publication

~~~~Amy DATA publication

Package metadata harvested from email Contr. 101 (gr. 99%, bl. 1%) Subj. 177 (gr.

Package metadata harvested from email Contr. 101 (gr. 99%, bl. 1%) Subj. 177 (gr. 97%, rd. 2%, bl. 1%)

Cost / value Modified Capitalsigma notation Reuse n R + ∑ ai = R

Cost / value Modified Capitalsigma notation Reuse n R + ∑ ai = R + a 1 + a 2 +a 3 + …an i=1 R = value of the metadata record i= number of usages a = incremental increase in value n = maximum number of reuse

Author/Submitter | Curator 100 metadata instantiations • 8 of 12 metadata properties had reuse

Author/Submitter | Curator 100 metadata instantiations • 8 of 12 metadata properties had reuse @ 50% or greater • 5 of 8 confirmed reuse at • 80% or higher. • Basic bib. vs. complex 27

Author Dcterms. spatial Subject Dw. C. Scientific. Name

Author Dcterms. spatial Subject Dw. C. Scientific. Name

Conclusion…other Valuation Approaches § Market cap of Facebook per user: $40 – $300 §

Conclusion…other Valuation Approaches § Market cap of Facebook per user: $40 – $300 § Revenues per record per user: $4 – $7 per year • Facebook • Experian § Market prices of personal data: • • • $0. 50 for street address $2. 00 for date of birth $8 for social security number $3 for driver’s license number $35 for military record SOURCE: OECD. Exploring the Economics of Personal Data: A Survey of Methodologies for Measuring Monetary Value. OECD Digital Economy Papers. Office for Economic Cooperation and Development Publishing, 2013.

Concluding comments § Success story § Contribution, have to start somewhere… • Good timing,

Concluding comments § Success story § Contribution, have to start somewhere… • Good timing, the right discipline § Confirmed use, reuse § Machine capabilities § An educative commons, intellectually engaging

http: //wiki. datadryad. org/Sample_Dryad_Content

http: //wiki. datadryad. org/Sample_Dryad_Content

Acknowledgments § Dryad Consortium Board, journal partners, and data authors § NESCent: Laura Wendell

Acknowledgments § Dryad Consortium Board, journal partners, and data authors § NESCent: Laura Wendell (Executive Director), Hilmar Lapp, Heather Piwowar, Peggy Schaeffer, Ryan Scherle, Todd Vision (PI) § **Drexel/UNC <Metadata Research Center>: Jose R. Pérez. Agüera, Sarah Carrier, Elena Feinstein, Lina Huang, Robert Losee, Hollie White, Craig Willis, Jane Smith, Shea Swuager, Liz Turner, Christine Mayo, Adrian Ogletree, Erin Clary § U British Columbia: Michael Whitlock § NCSU Digital Libraries: Kristin Antelman § HIVE: Library of Congress, USGS, and The Getty Research Institute; and workshop hosts § Yale/Tree. BASE: Youjun Guo, Bill Piel § Data. ONE: Rebecca Koskela, Bill Michener, Dave Veiglais, and many others § British Library: Lee-Ann Coleman, Adam Farquhar, Brian Hole § Oxford University: David Shotton 32

http: //datadryad. org http: //blog. datadryad. org http: //datadryad. org/wiki http: //code. google. com/p/dryad-users@nescent.

http: //datadryad. org http: //blog. datadryad. org http: //datadryad. org/wiki http: //code. google. com/p/dryad-users@nescent. org Facebook: Dryad Twitter: @datadryad http: //ils. unc. edu/mrc/hive/ http: //code. google. com/p/hive-mrc/ Metsdata Reserch Center: http: //cci. drexel. edu/mrc 33