PIDs in Data Infrastructures Peter Wittenburg CLARIN Research
PIDs in Data Infrastructures Peter Wittenburg CLARIN Research Infrastructure EUDAT Data Infrastructure The Language Archive – Max Planck Institute for Psycholinguistics Nijmegen, The Netherlands
Automatic Workflows • most data is created automatically as part of workflows manual operations are exceptions • at data creation time it is not obvious what their future life will be • later association with metadata and PIDs troublesome and costly • thus immediate generation of metadata and PIDs as part of automated workflows typically Handles via EPIC typically DOIs via Data. Cite • data resources need to be referable and often citable (published) • need a reliable and highly performing machinery (registration + resolution) based on stable standards
PID usage in our domain • assume that we have a recording of an extinct language and some annotations that tell us what someone said about medicine etc • researchers create relations that need to be preserved Video Recording from Repository A Recording Session Metadata Record Sound Recording How long, stable and persistent? are using Handles from EPIC service from Repository B from Repository C Annotations
PID usage in our domain Biological and cultural processes have evolved together, in a symbiotic spiral; they are now indissolubly linked, with human survival unlikely without such culturally produced aids as clothing, cooked food, and tools. The twelve original essays collected in this volume take an evolutionary perspective on human culture, examining the emergence of culture in evolution and the underlying role of brain and cognition. The essay authors, all internationally prominent researchers in their fields, draw on the cognitive sciences -- including linguistics, developmental psychology, and cognition -- to develop conceptual and methodological tools for understanding the interaction of culture and genome. They go beyond the "how" -- the questions of behavioral mechanisms -- to address the "why" -- the evolutionary origin of our psychological functioning. What was the "X-factor, " the magic ingredient of culture -- the element that took humans out of the general run of mammals and other highly social organisms? Several essays identify specific behavioral and functional factors that could account for human culture, including the capacity for "mind reading" that underlies social and cultural learning and the nature of morality and inhibitions, while others emphasize multiple partially independent factors -planning, technology, learning, and language. The Xfactor, these essays suggest, is a set of cognitive adaptations for culture. e. Publication e. Ressource Repository 1 Repository 2 How long, etc. ? Handles from EPIC
Data Object World • let‘s isolate external properties of our data objects and collections and ignore the content (structure, semantics, packaging, etc. ) for a moment handle generator receives disseminations via RAP requests originator depositor hands-over work ownership repository A deposits via RAP data metadata (Key-MD) PID access rights user stores maintains registered DO - data - metadata (Key-MD) - location PID property record access rights type (from central registry) ROR flag mutable flag transaction record replicates repository B goes back to a paper by Kahn & Wilensky, 2006
2 DO flavours in our domain DO immediate access ? access via metadata PID access via PID bit sequence (instance) MDO search/browse access metadata access via metadata PID access via PID bit sequence (instance) • way how we organize data • different other variants possible
collections in our domain (similar to MPEG 21 containers, items, sub-items) ISOcat Registry (ISO 12620, compl. ISO 11179) category 1 - assoc info category 2 - assoc info metadata (collection) - category 1 - category 2. . . - category N - PID 1 - PID 2. . . - PID K PID collection - assoc info PID 1 - assoc info PID 2 - assoc info PID Registry - grouping of related data - large variety of reasons - versions of a DO - presentations of a DO - same interview/experim. - many others - DO part of many collections metadata - category 1 - category 2. . . - category N - PID bit sequence
EUDAT - common services two major tracks: • understanding data organization & practices in communities • provide first common services after 12 months
PID Use V 1 in EUDAT Federation repository X repository Y repository Z DO 1 domain Y domain Z prefx PIDx URLy URLz CKSM Rights. . domain X
PID Use V 2 in EUDAT Federation repository X repository Y repository Z DO 1 prefx PIDx prefy URL Ro. R HDL CKSM Rights. . domain X PIDy prefz URL Ro. R HDL CKSM Rights. . domain Y PIDz URL Ro. R CKSM Rights. . domain Z
EUDAT relying on EPIC + Handles • EPIC (European PID Consortium: CSC, SARA, GWDG, more) • large data centers with national/organizational (MPS) support • applying redundancy schemes (persistence, availability) • reliability, robustness, performance (registration, resolution) • all the same API (agreement on information associated) • thus PID syntax not crucial but storing /finding information • feasible business model for science • security of administration DB for system • persistent and balanced governance for HS • need a worldwide registry of agreed information types to feed our „stupid“ machines
Information types in discussion • • • multiple links to resources checksum link to metadata citation metadata Ro. R statement mutability flag persistency statement pointers to presentation versions provenance statement collection statement pointer to rights • (support for parts/fragments) • (actionable PIDs) - need agreements - need standard APIs for EUDAT this is crucial
- Slides: 12