The Dryad Data Repository Metadata Workflows and Processes

































- Slides: 33
The Dryad Data Repository: Metadata Workflows and Processes 2 nd Data Management Workshop November 28 th – 29 th 2014 University of Cologne, Germany Jane Greenberg Professor, College of Computing & Informatics (CCI) Director, Metadata Research Center <MRC> Erin Clary, Dryad Curator, CCI/MRC 1
Dryad…a curated general-purpose repository…makes data discoverable, freely reusable, and citable. s to t s i t n e i s, es sc g l n b i a d n n i e f “… hed s i l b u p validate w analysis ne ose p r u p e explore r gies, o l ns o o i d t o s h e t u e q m rch a e s e r r e h t data fo y b d ipate c i t n d a n n a u , s r o s. ” auth l e i a d n i u t g i s r o hetic t n y s m g/) r o. perfor d a y tadr a d / / : p t (ht 3 Not s i th
http: //datadryad. org/
JDAP
Pre-populated metadata field
7
Elsevier’s Science Direct: EXAMPLE: Dryad Unmack, et al, Phylogeny and biogeography…Molecular Phylogenetics and Evolution http: //dx. doi. org/10. 1016/j. ympev. 2012. 019. 8
Elsevier’s Science Direct: EXAMPLE: Dryad Unmack, et al, Phylogeny and biogeography…Molecular Phylogenetics and Evolution http: //dx. doi. org/10. 1016/j. ympev. 2012. 019
Data downloads reuse citation Download 10678 times Observations, motivating study of metadata capital 1. Metadata generation costs money 2. Metadata reuse is a part BIG of Dryad’s workflow 3. Metadata reuse via OAI 4. Metadata reuse via data sharing, reuse, and repurposing
Greenberg J, Swauger S, Feinstein EM (2013) Data from: Metadata capital in a data repository. Proceedings of the International Conference on Dublin Core and Metadata Applications http: //dx. doi. org/10. 5061/dry ad. 8 c 1 p 6
wo rkf low Journal Re. Blackout s Wrkfl Am. Ntrl N N MBE Bio. Risk BMJ Open N Y Y N N N Y …. • Journals (80+…PLOS): http: //datadryad. org/pages/i ntegrated. Journals • X >10 GB = $15, $10+ statistics Type Total 30 days Data packages 6867 198 Data files 21056 977 Journals 364 77 Authors 24500 3492 639314 36006 Downloads
http: //wiki. datadryad. org/Sample_Dryad_Content#Examples_by_file_type
Interoperability Governance Technology “non-profit status, 12 member Board of Directors” DSpace DOIs via CDL/Data. Cite CC 0 (<m> + data) Integration with specialized repositories and databases § Federated searching with Tree. BASE and KNB LTER § Tree. BASE submission (OAI-PMH) § Gen. Bank (currently in development) § Sets policy, goals • science, journals, societies, OCLC, MS § 2006 Dryad development – NESCent +<MRC> • Stakeholders: journals, publishers and scientific societies, and researchers. § 2009 -2012: Interim Board $ PAYMENT-Sept. 1, 2014
Sustainability: Plan Comparison Payment Plan Member Non-member Minimum purchase 1. Voucher Plan USD$65 per data package USD$70 per data package 25 vouchers 2. Deferred Payment Plan USD$70 per data package USD$75 per data package 1 yr contract 3. Subscription Plan Annual fee based on USD$25 per published research article Annual fee based on USD$30 per published research article 2 yr contract NA USD$80 per data package, payable by the submitter 1 data package For individuals: Pay on acceptance
More on grown and sustainability § Membership: http: //datadryad. org/pages/ membership. Overview § Pricing and sponsorship of deposits: http: //datadryad. org/pages/prici ng § Journal integration: § http: //datadryad. org/pages/journal. Integra tion
18
Metadata research & development 1. Curation workflow - cognitive walkthroughs 2. Dryad metadata scheme development - crosswalk analyses (Dube, et al, 2007; Carrier, et al, 2007; White et al. , 2008, Greenberg, et al, 2010; Greenberg 2009; 2010) 3. Metadata reuse - content analysis (Greenberg, IDCC Research Summit, 2010) 4. Instantiation - multi-method study (comprehensions assessment) (Greenberg, RDAP, 2010, UNAM 2012) 5. Name-authority control - exploratory study (Haven, 2009, INLS 720) 6. KO/metadata community practices - Concurrent triangulation mixed methods (survey + simulation experiment) (White, 2010, ASIST, 2010 JLM) 7. Metadata functions - quantitative categorical analysis (Willis, Greenberg, and White, 2010, CODATA, 2012, JASIST) 8. Vocabulary needs (HIVE) – mapping study (Greenberg, (HIVE) 2009, CCQ; Scherle, 2010, Code 4 Lib) 9. Metadata theory – deductive analysis (Greenberg, 2009)
Dryad DCAP, ver. 3. 0 § § bibo (The Bibliographic Ontology) dcterms (Dublin Core terms) dryad (Dryad) Dw. C (Darwin Core) Singapore Framework Vision 1. Simple: automatic metadata gen; heterogeneous datasets *Data-package centric 2. Interoperable: harvesting, crosssystem searching 3. Semantic Web compatible: sustainable; supporting machine processing Greenberg, et al, 2009, Metadata Best Practice for a Scientific Data Repository, JLM, DOI: 10. 1080/1938638090 3405090.
Helping Interdisciplinary Vocabulary Engineering (HIVE) 21
~~~~Amy DATA publication
Package metadata harvested from email Contr. 101 (gr. 99%, bl. 1%) Subj. 177 (gr. 97%, rd. 2%, bl. 1%)
Cost / value Modified Capitalsigma notation Reuse n R + ∑ ai = R + a 1 + a 2 +a 3 + …an i=1 R = value of the metadata record i= number of usages a = incremental increase in value n = maximum number of reuse
Author/Submitter | Curator 100 metadata instantiations • 8 of 12 metadata properties had reuse @ 50% or greater • 5 of 8 confirmed reuse at • 80% or higher. • Basic bib. vs. complex 27
Author Dcterms. spatial Subject Dw. C. Scientific. Name
Conclusion…other Valuation Approaches § Market cap of Facebook per user: $40 – $300 § Revenues per record per user: $4 – $7 per year • Facebook • Experian § Market prices of personal data: • • • $0. 50 for street address $2. 00 for date of birth $8 for social security number $3 for driver’s license number $35 for military record SOURCE: OECD. Exploring the Economics of Personal Data: A Survey of Methodologies for Measuring Monetary Value. OECD Digital Economy Papers. Office for Economic Cooperation and Development Publishing, 2013.
Concluding comments § Success story § Contribution, have to start somewhere… • Good timing, the right discipline § Confirmed use, reuse § Machine capabilities § An educative commons, intellectually engaging
http: //wiki. datadryad. org/Sample_Dryad_Content
Acknowledgments § Dryad Consortium Board, journal partners, and data authors § NESCent: Laura Wendell (Executive Director), Hilmar Lapp, Heather Piwowar, Peggy Schaeffer, Ryan Scherle, Todd Vision (PI) § **Drexel/UNC <Metadata Research Center>: Jose R. Pérez. Agüera, Sarah Carrier, Elena Feinstein, Lina Huang, Robert Losee, Hollie White, Craig Willis, Jane Smith, Shea Swuager, Liz Turner, Christine Mayo, Adrian Ogletree, Erin Clary § U British Columbia: Michael Whitlock § NCSU Digital Libraries: Kristin Antelman § HIVE: Library of Congress, USGS, and The Getty Research Institute; and workshop hosts § Yale/Tree. BASE: Youjun Guo, Bill Piel § Data. ONE: Rebecca Koskela, Bill Michener, Dave Veiglais, and many others § British Library: Lee-Ann Coleman, Adam Farquhar, Brian Hole § Oxford University: David Shotton 32
http: //datadryad. org http: //blog. datadryad. org http: //datadryad. org/wiki http: //code. google. com/p/dryad-users@nescent. org Facebook: Dryad Twitter: @datadryad http: //ils. unc. edu/mrc/hive/ http: //code. google. com/p/hive-mrc/ Metsdata Reserch Center: http: //cci. drexel. edu/mrc 33