CRM Digital A Digital Provenance Ontology TPDL 2011

  • Slides: 38
Download presentation
CRM Digital A Digital Provenance Ontology TPDL 2011 Martin Doerr Center for Cultural Informatics,

CRM Digital A Digital Provenance Ontology TPDL 2011 Martin Doerr Center for Cultural Informatics, Institute of Computer Science Foundation for Research and Technology - Hellas Berlin, Germany September 25, 2011 ICS-FORTH September 21, 2011

CRM Digital ¡ ¡ ¡ Requirements Competitors CRM and Provenance Data example About Provenance-based

CRM Digital ¡ ¡ ¡ Requirements Competitors CRM and Provenance Data example About Provenance-based reasoning Conclusions ICS-FORTH September 21, 2011 Outline

CRM Digital Provenance Metadata Requirements Scientific data are empirical or synthetic. Scientific data cannot

CRM Digital Provenance Metadata Requirements Scientific data are empirical or synthetic. Scientific data cannot be understood without knowledge about the meaning of the data and the ways and circumstances of their creation We use Metadata to assess ¡ ¡ meaning (view, experimental setup, instrument settings), relevance (depicted things, their status, their conditions), quality (calibration, tolerances, errors, “artifacts”), possibilities of Improvement and Reprocessing. From generation to use, permanent storage, reuse (life-cycle) ICS-FORTH September 21, 2011

CRM Digital Requirements Acquisition: Reliable registration of the process and context conditions ¡ The

CRM Digital Requirements Acquisition: Reliable registration of the process and context conditions ¡ The experimental setup and environment (geometry, light sources, tools, obstacles, sources of noise/reflections etc. ) ¡ Capture device type, identity (individual behavior!) ¡ Hierarchical model: Inherit metadata common to series of “shots” ¡ The identity of the measured or depicted object n import identifiers, metadata n identity of location – GPS data import? ICS-FORTH September 21, 2011

CRM Digital Requirements Processing: Reliable registration of parameters ¡ ¡ Workflow logs, reliable identification

CRM Digital Requirements Processing: Reliable registration of parameters ¡ ¡ Workflow logs, reliable identification of outputs with inputs n input files (URIs!) n output files (URIs!), formats, warning and error reports. n S/W identifiers and parameters, manual adjustments! n process types for reasoning Reliable linking with captured data Use and Reuse: parts, wholes and annotation: ¡ ¡ ¡ Composition of final products, information packages (SIP, DIP, AIP) n composition of aggregates, selection of versions or parts for permanent storage, reuse or transfer between labs, to and from Digital Libraries. Migration to other formats (compatibility and obsoletion) Authenticity, rights ICS-FORTH September 21, 2011

CRM Digital Competitors There is no provenance data standard format. ¡ ¡ ¡ Too

CRM Digital Competitors There is no provenance data standard format. ¡ ¡ ¡ Too many application-oriented, partial, overspecialized solutions. Several stand-alone models, overgeneralizations No integrated ontology of activity context Competitors: ¡ ¡ “Open Provenance Model”, ”Provenance Vocabulary”, ”Provenir”, ”Premise” n no notion of acquisition (measurement, observation), place n Confuse agentive role with substance of actors, machines, S/W, context n No notion of temporal indeterminacy W 3 C Provenance WG n precondition: No use of a larger reference ontology => a dogmatic reinvention of the wheel…. ”antimodularity of ontologies? ” ICS-FORTH September 21, 2011

CRM Digital Competitors “Provenance Vocabulary” ICS-FORTH September 21, 2011

CRM Digital Competitors “Provenance Vocabulary” ICS-FORTH September 21, 2011

CRM Digital ICS-FORTH September 21, 2011 Competitors: “Provenir”

CRM Digital ICS-FORTH September 21, 2011 Competitors: “Provenir”

CRM Digital CRM and Provenance The Idea: ¡ ¡ ¡ First conceived by Stephen

CRM Digital CRM and Provenance The Idea: ¡ ¡ ¡ First conceived by Stephen Stead for CHI, San Francisco 2007 Scientific data and metadata are historical records! Scientific observation and machine-supported processing is initiated, on behalf of and controlled by human activity in physical space-time, not in cyber-space! Things, data, people, times and places are causally related by events. Other relations are either deductions from events or found by observation events. CRM Digital: Specialize the CIDOC CRM (ISO 21127)! ¡ Will allow for rich integrated reasoning (Christ – Ascension – Ivory panel) Innovations: ¡ ¡ The Digital Measurement Event transfers from physical to digital world. Machines “act” due to human initiative and responsibility. Humans use machines. No non-human actors! ICS-FORTH September 21, 2011

CRM Digital 3 D Model Creation as Meetings t 3 D model coherence volume

CRM Digital 3 D Model Creation as Meetings t 3 D model coherence volume of rendering coherence volume of mesh-creation mesh-data 2 nd Computer scanner museum object scan-data 1 st Computer operator coherence volume of acquisition Museum ICS-FORTH September 21, 2011 It-Lab S

CRM Digital 2. 5 http: //www. ics. forth. gr/isl/rdfs/3 D-COFORM_CRMdig_v 2. 5. rdfs ICS-FORTH

CRM Digital 2. 5 http: //www. ics. forth. gr/isl/rdfs/3 D-COFORM_CRMdig_v 2. 5. rdfs ICS-FORTH September 21, 2011

CRM Digital 2. 5 : Digital Events http: //www. ics. forth. gr/isl/rdfs/3 D-COFORM_CRMdig_v 2.

CRM Digital 2. 5 : Digital Events http: //www. ics. forth. gr/isl/rdfs/3 D-COFORM_CRMdig_v 2. 5. rdfs E 7 Activity E 65 Creation E 11 Modification E 16 Measurement D 7 Digital Machine Event D 10 Software Execution D 3 Formal Derivation ICS-FORTH September 21, 2011 D 12 Data Transfer Event D 27 Calibration Process D 11 Digital Measurement Event D 2 Digitization Process

CRM Digital 2. 5: Digital Things E 70 Thing E 22 Man-Made Object E

CRM Digital 2. 5: Digital Things E 70 Thing E 22 Man-Made Object E 73 Information Object E 84 Information Carrier D 1 Digital Object E 54 Dimension D 9 Data Object ICS-FORTH September 21, 2011 D 13 Digital Information Carrier D 14 Software D 35 Area D 8 Digital Device

CRM Digital 2. 5: Digitization = feature transfer from physical to digital E 16

CRM Digital 2. 5: Digitization = feature transfer from physical to digital E 16 Measurement E 65 Creation E 11 Modification P 31 has modified (was modified by) P 40 observed dimension (was observed in) P 39 measured (was measured by) E 24 Physical Man-Made Thing P 94 has created (was created by) E 1 CRM Entity D 13 Digital Information Carrier D 11 Digital Measurement Event E 54 Dimension E 28 Conceptual Object D 2 Digitization Process L 1 digitized (was digitized by) E 18 Physical Thing ICS-FORTH September 21, 2011 L 20 has created (was created by) L 19 stores (is stored on) D 1 Digital Object D 9 Data Object

CRM Digital 2. 5: Software Execution Formal Derivation = feature transfer from digital to

CRM Digital 2. 5: Software Execution Formal Derivation = feature transfer from digital to digital D 1 Digital Object L 10 had input (was input of) D 7 Digital Machine Event L 11 had output (was output of) D 1 Digital Object L 12 happened on device (was device for) D 1 Digital Object L 2 used as source (was source for) D 10 Software Execution L 18 has modified (was modified by) D 8 Digital Device D 13 Digital Information Carrier L 13 used parameters (parameters for) D 3 Formal Derivation D 1 Digital Object L 21 used as derivation source (was derivation source for) D 1 Digital Object ICS-FORTH September 21, 2011 P 2 has type (is type of) E 55 Type L 22 created derivative (was derivative created by) D 1 Digital Object

CRM Digital 2. 5: Data Transfer Event Unreliable transfer D 1 Digital Object L

CRM Digital 2. 5: Data Transfer Event Unreliable transfer D 1 Digital Object L 10 had input (was input of) D 1 Digital Object L 14 transferred (was transferred by) D 7 Digital Machine Event D 12 Data Transfer Event L 12 happened on device (was device for) ICS-FORTH September 21, 2011 D 1 Digital Object L 18 has modified (was modified by) D 13 Digital Information Carrier L 15 has sender (was sender for) D 8 Digital Device L 11 had output (was output of) D 8 Digital Device L 16 has receiver (was receiver for) D 8 Digital Device

CRM Digital n European IP CASPAR ¡ ¡ n Applications European Space Agency: satellite

CRM Digital n European IP CASPAR ¡ ¡ n Applications European Space Agency: satellite data IRCAM: Digital media performances FORTH: Art Object Digitization FORTH/ Metaware: Integrating Digital Rights with Provenance model. European IP 3 D-COFORM ¡ ¡ ¡ 3 D model acquisition by camera, manual or by camera array. Up to 20. 000 files per object. 3 D model acquisition by laser scan. Mesh processing, rendering Synthetic models and scene compositions. Provenance-based reasoning Scalable repositories, representative amounts of data. ICS-FORTH September 21, 2011

CRM Digital Example: 3 D Reconstruction from Photographs – The Gipsmuseum Campaign Sven Havemann,

CRM Digital Example: 3 D Reconstruction from Photographs – The Gipsmuseum Campaign Sven Havemann, CGV, TU Graz June 30, 2009 worst case for metadata capture: a complex manual process ICS-FORTH September 21, 2011 3 D Acquisition

CRM Digital Acquisition Workflow Hierarchy D 2 Digitization Process instantiation example Data Acquisition Event

CRM Digital Acquisition Workflow Hierarchy D 2 Digitization Process instantiation example Data Acquisition Event DAE 1 has part Object Acquisition Event OAE 1 Calibration Event CE 1 has part Calibration Event CE 2 has part Digital Documentation Event DDE 1 has part Sequence Event Sequence SE 1 Event SE 1 Digital Documentation Event DDE 2 has part Calibration Event CE 3 ICS-FORTH September 21, 2011 Capturing Event Capturing Cap. E 1 Event Cap. E 1

CRM Digital Modelling the Acquisition Process (AP) Register: ¡ ¡ ¡ Who, when, where.

CRM Digital Modelling the Acquisition Process (AP) Register: ¡ ¡ ¡ Who, when, where. equipment identifiers, equipment models, firmware Setup geometry and conditions. Assumptions: worst case, a completely manual process! ¡ ¡ ¡ Set of objects captured under common conditions. Each object captured by a sequence of “shots” Metadata are stored by “historical order” (like workflow logs) n n n ¡ step-by-step as executed, not as planned! concatenated by referring to identifiers of previously existing or created entities and initialized events. = robust against exceptions in the planned workflow Avoid redundancy of information n Hold common information as high as possible in a hierarchy of nested activities ICS-FORTH September 21, 2011

CRM Digital Example: The Kazafani Boat Found in 1963, during a salvage excavation in

CRM Digital Example: The Kazafani Boat Found in 1963, during a salvage excavation in the now Turkish occupied part of Cyprus (inaccessible and destroyed site). Tomb from the 12 th century B. C. Unique object, hand made pottery 40 x 20. 5 x 23 cm – canoe boat shape Permanently exhibited at the Nicosia Museum Workflow 3 D scanning – Next. Engine 3 D model creation – Meshlab Rapid prototyping Testing glue, stabilizers, colours Print final replica Colour final replica ICS-FORTH September 21, 2011 3 D Acquisition

CRM Digital (“operators”) Data Persons Acquisition Event - Schema Person: uuid: aeac 5200 -0138

CRM Digital (“operators”) Data Persons Acquisition Event - Schema Person: uuid: aeac 5200 -0138 -11 e 0 -a 976 -0800200 c 9 a 66 (E 21 Person) P 131 is identified by : D 21 Person Name L 51 has first name: Martin (Literal E 62 String) L 52 has last name: Doerr (Literal E 62 String) P 107 is current or former member: http: //www. ics. forth. gr/ (E 40 Legal Body) L 62 in the role of: http: //www. 3 d-coform. eu/Role. Type/researcher (E 55 Type) ICS-FORTH September 21, 2011

CRM Digital Legal Bodies Places Data Acquisition Event& - Schema Legal Body: http: //starc.

CRM Digital Legal Bodies Places Data Acquisition Event& - Schema Legal Body: http: //starc. cyi. ac. cy/ (E 40 Legal Body) L 4 has preferred label: STARC-The Cyprus Institute, Nicosia, Cyprus (Literal E 62 String) no address P 74 has current or former residence: http: //www. geonames. org/146268/ (E 53 Place) L 4 has preferred label: Nicosia (Literal E 62 String) P 3 has note: Cyprus (Literal E 62 String) exact address and the city where it is located P 74 has current or former residence: uuid: dbae 7 cd 0 -e 371 -11 e 0 -9572 -0800200 c 9 a 66 (E 53 Place) L 4 has preferred label: 15 Kypranoros Street (Literal E 62 String) P 89 falls within: http: //www. geonames. org/146268/ (E 53 Place) P 3 has note: 15 Kypranoros Street, Nicosia 1061, Cyprus (Literal E 62 String) just the address without details for city P 74 has current or former residence: uuid: dbae 7 cd 0 -e 371 -11 e 0 -9572 -0800200 c 9 a 66 (E 53 Place) L 4 has preferred label: 15 Kypranoros Street (Literal E 62 String) P 3 has note: 15 Kypranoros Street, Nicosia 1061, Cyprus (Literal E 62 String) ICS-FORTH September 21, 2011

CRM Digital Data Acquisition Event: uuid: 354 c 91 e 0 -b 3 fa-11

CRM Digital Data Acquisition Event: uuid: 354 c 91 e 0 -b 3 fa-11 de-98 c 6 -0002 a 5 d 5 c 30 a (D 2 Digitization Process) L 4 has preferred label: 2010 Laser scanning in Arch. Museum of Nicosia (Literal E 62 String) P 2 has type: http: //www. 3 d-coform. eu/Event. Type/laser_scanning (E 55 Type) P 2 has type: http: //www. 3 d-coform. eu/Event. Type/data_acquisition (E 55 Type) P 3 has note: “evening sun shines through the west window” (Literal E 62 String) SUPER-EVENTS: P 9 forms part of: uuid: 07 f 05 f 40 -b 415 -11 de-9 d 48 -0002 a 5 d 5 c 30 c (E 7 Activity) (Project) WHEN: L 31 has starting date-time: 2010 -05 -28 T 08: 00 Z (xs: date. Time E 61 Time Primitive) L 32 has ending date-time: 2010 -06 -02 T 18: 00 Z (xs: date. Time E 61 Time Primitive) WHERE: P 7 took place at: http: //starc. cyi. ac. cy/#Place/Arch. Museum. Nicosia/Conservation. Lab (E 53 Place) WHO: L 29 has responsible organisation: http: //starc. cyi. ac. cy/ (E 40 Legal Body) L 30 has operator: uuid: aeac 5200 -0138 -11 e 0 -a 976 -0800200 c 9 a 66 (E 21 Person) ICS-FORTH September 21, 2011

CRM Digital Data Acquisition Event: uuid: 354 c 91 e 0 -b 3 fa-11

CRM Digital Data Acquisition Event: uuid: 354 c 91 e 0 -b 3 fa-11 de-98 c 6 -0002 a 5 d 5 c 30 a (D 2 Digitization Process) WITH WHAT (camera): L 12 happened on device: http: //www. nextengine. com/. . . /E 4035623490 (D 8 Digital Device) L 59 has serial number: E 4035623490 (Literal E 62 String) L 4 has preferred label: “Next Engine Desktop 3 D scanner” (Literal E 62 String)(=Model) P 2 has type: http: //www. 3 d-coform. eu/Device. Type/laser_scanner (E 55 Type) L 33 has maker: http: //www. nextengine. com/ (E 39 Actor) P 3 has note: Next Engine Desktop 3 D scanner, Multi stripe laser (Literal E 62 String) L 23 used software or firmware: http: //www. nextengine. com/. . . /Scan_Studio (D 14 Software) WITH WHAT (additional devices): P 16 used specific object: http: //b 2 b. sony. com/. . . /SONVPLFE 4035623490 (E 22 Man Made Object) L 59 has serial number: 32526158 (Literal E 62 String) L 4 has preferred label: SONY PLFE 40 Projector (Literal E 62 String)(= Model) P 2 has type: http: //www. getty. edu/research/tools/vocabularies/aat/300022665 (E 55 Type) L 33 has maker: http: //www. nikon. com/ (E 39 Actor) P 16 used specific object: http: //www. cgv. tugraz. at/structure_slide_T 45 a (E 22 Man Made Object) ICS-FORTH September 21, 2011

CRM Digital Object Acquisition Event: uuid: 07 f 05 f 40 -b 415 -11

CRM Digital Object Acquisition Event: uuid: 07 f 05 f 40 -b 415 -11 de-9 d 48 -0002 a 5 d 5 c 30 b (D 2 Digitization Process) L 4 has preferred label: 2010 Laser scanning of Kazafani Boat 249. 377 in Archaeological Museum of Nicosia (Literal E 62 String) P 2 has type: http: //www. 3 d-coform. eu/Event. Type/object_acquisition (E 55 Type) L 10 had input: uuid: 3 d 066 a 90 -9 cb 1 -11 e 0 -aa 82 -0800200 c 9 a 66 (D 9 Data Object) (calibration file) L 10 had input: uuid: 46963500 -9 cce-11 e 0 -aa 82 -0800200 c 9 a 66 (D 9 Data Object) (configuration file) SUPER-EVENTS: P 9 forms part of: uuid: 354 c 91 e 0 -b 3 fa-11 de-98 c 6 -0002 a 5 d 5 c 30 a (D 2 Digitization Process) (Data Acquisition Event) ICS-FORTH September 21, 2011

CRM Digital Object Acquisition Event: uuid: 07 f 05 f 40 -b 415 -11

CRM Digital Object Acquisition Event: uuid: 07 f 05 f 40 -b 415 -11 de-9 d 48 -0002 a 5 d 5 c 30 b (D 2 Digitization Process) WHAT (acquired object): L 1 digitized: uuid: e 4761 f 00 -0 ce 7 -11 e 0 -81 e 0 -0800200 c 9 a 66 (E 22 Man-Made Object) P 1 is identified by: http: //www. mcw. gov. cy/mcw/DA/DA. nsf/Objects/249. 377 (E 42 Identifier) (all “known” URIs) L 4 has preferred label: Kazafani Boat, vase, 249. 377 (Literal E 62 String) L 53 is not uniquely identified by: Kazafani Boat (Literal E 62 String) L 53 is not uniquely identified by: Bronze Age model of a boat (Literal E 62 String) L 55 has inventory no: 249. 377 (Literal E 62 String) P 2 has type: http: //www. getty. edu/research/tools/vocabularies/aat/300132254 (E 55 Type) (vase) P 3 has note: “Deep hollow hull with in-curving flat-topped gunwale …. ” (Literal E 62 String) P 50 has current keeper: uuid: 6 f 2972 e 6 -ad 9 e-4 a 72 -930 d-263 f 01 e 75 d 8 c (E 40 Legal Body) (Archaeological Museum of Nicosia) ICS-FORTH September 21, 2011

CRM Digital Calibration Event: uuid: 07 f 05 f 40 -b 415 -11 de-9

CRM Digital Calibration Event: uuid: 07 f 05 f 40 -b 415 -11 de-9 d 48 -0002 a 5 d 5 c 30 c (D 2 Digitization Process) P 2 has type: http: //www. 3 d-coform. eu/Event. Type/calibration (E 55 Type) L 1 digitized: http: //cg. cs. uni-bonn. de/#Calibration/Bariumsulfate/Block 10 (E 18 Physical Thing) L 4 has preferred label: block of bariumsulfate (10 x 1 cm) (Literal E 62 String) P 2 has type: http: //www. 3 d-coform. eu/Information. Object. Type/Multiviewdome. Calibration. Data (E 55 Type) (color chart, ruler, greyscale) WHEN: L 31 has starting date-time: 2009 -07 -02 T 16: 04: 34 Z (xs: date. Time E 61 Time Primitive) L 32 has ending date-time: 2009 -07 -02 T 16: 04: 34 Z (xs: date. Time E 61 Time Primitive) OUTPUT: L 20 has created: uuid: 07 f 05 f 40 -b 415 -11 de-9 d 48 -0002 a 5 d 5 c 31 c (D 9 Data Object) ICS-FORTH September 21, 2011

CRM Digital Capturing Event: uuid: 07 f 05 f 40 -b 415 -11 de-9

CRM Digital Capturing Event: uuid: 07 f 05 f 40 -b 415 -11 de-9 d 48 -0002 a 5 d 5 c 30 n (D 2 Digitization Process) L 4 has preferred label: Capture 1_0 for Boat (Literal E 62 String) P 2 has type: http: //www. 3 d-coform. eu/Event. Type/capture (E 55 Type) SUPER-EVENTS: P 9 forms part of: uuid: 07 f 05 f 40 -b 415 -11 de-9 d 48 -0002 a 5 d 5 c 30 b (D 2 Digitization Process) (Object Acquisition Event) WHEN: L 31 has starting date-time: 2009 -07 -02 T 16: 07: 54 Z (xs: date. Time E 61 Time Primitive) L 32 has ending date-time: 2009 -07 -02 T 16: 07: 54 Z (xs: date. Time E 61 Time Primitive) ICS-FORTH September 21, 2011

CRM Digital Capturing Event: uuid: 07 f 05 f 40 -b 415 -11 de-9

CRM Digital Capturing Event: uuid: 07 f 05 f 40 -b 415 -11 de-9 d 48 -0002 a 5 d 5 c 30 n (D 2 Digitization Process) (cont’d) OUTPUT: L 20 has created: uuid: 07 f 05 f 40 -b 415 -11 de-9 d 48 -0002 a 5 d 5 c 31 g (D 9 Data Object) (image file, zip file. . . ) L 4 has preferred label: 1_0. ply (Literal E 62 String) P 2 has type: http: //www. 3 d-coform. eu/Object. Type/mesh (E 55 Type) P 2 has type: http: //www. 3 d-coform. eu/Mime. Type/ply (E 55 Type) P 43 has dimension: (E 54 Dimension) P 2 has type: http: //www. 3 d-coform. eu/Dimension. Type/mesh_vertices (E 55 Type) P 90 has value: 394302 (xs: integer E 60 Number) P 91 has unit: http: //www. 3 d-coform. eu/Unit. Type/vertices (E 58 Measurement Unit) P 43 has dimension: (E 54 Dimension) P 2 has type: http: //www. 3 d-coform. eu/Dimension. Type/mesh_faces (E 55 Type) P 90 has value: 782543 (xs: integer E 60 Number) P 91 has unit: http: //www. 3 d-coform. eu/Unit. Type/faces (E 58 Measurement Unit) ICS-FORTH September 21, 2011

CRM Digital ARC 3 D web service component · Perform the 3 D reconstruction

CRM Digital ARC 3 D web service component · Perform the 3 D reconstruction of an artefact from images retrieved from the RI · For an input sequence of images, ARC 3 D produces a calibration matrix and a depth map for each image identified as usable for the reconstruction. This output data is then ingested into the RI so that it can be retrieved and loaded into Mesh. Lab to perform the final reconstruction step (integration of the depth maps). · ARC 3 D component Images ICS-FORTH September 21, 2011 Used images + + Depth map for each used image + metadata

CRM Digital ARC 3 D Process Event: uuid: 2 f 7 d 22 db-1

CRM Digital ARC 3 D Process Event: uuid: 2 f 7 d 22 db-1 d 89 -11 e 0 -ac 64 -0800200 c 9 a 66 (D 3 Formal Derivation) L 4 has preferred label: Processing of Ivory Panel raw data with Arc 3 D (Literal E 62 String) P 2 has type: http: //www. 3 d-coform. eu/Event. Type/process_event (E 55 Type) P 2 has type: http: //www. 3 d-coform. eu/Event. Type/modeling_process (E 55 Type) WHO: L 29 has responsible organisation: http: //www. vam. ac. uk/ (E 40 Legal Body) L 30 has operator: uuid: 2 f 7 d 22 d 3 -1 d 89 -11 e 0 -ac 64 -0800200 c 9 a 66 (E 21 Person) WHEN: L 31 has starting date-time: 2010 -08 -07 T 08: 00 Z (xs: date. Time E 61 Time Primitive) L 32 has ending date-time: 2010 -12 -02 T 10: 00 Z (xs: date. Time E 61 Time Primitive) WHERE: P 7 took place at: http: //www. vam. ac. uk/#Place/Conservation. Laboratory (D 23 Room) ICS-FORTH September 21, 2011

CRM Digital ARC 3 D Process Event: uuid: 354 c 91 e 0 -b

CRM Digital ARC 3 D Process Event: uuid: 354 c 91 e 0 -b 3 fa-11 de-98 c 6 -0002 a 5 d 5 c 50 c (D 3 Formal Derivation) (cont’d) WITH WHAT (Software): L 2 used as source: http: //www. esat. kuleuven. be/psi/visics/ARC 3 D (D 14 Software) L 4 has preferred label: ARC 3 D (Literal E 62 String) P 2 has type: http: //www. esat. kuleuven. be/psi/visics/ARC 3 D/Version_1. 0. 0 (E 55 Type) P 2 has type: http: //www. 3 d-coform. eu/Software. Type/processing_software (E 55 Type) L 33 has maker: http: //www. esat. kuleuven. be/psi/visics (E 39 Actor) L 4 has preferred label: KULeuven PSI VISICS (Literal E 62 String) ICS-FORTH September 21, 2011

CRM Digital ARC 3 D Process Event: uuid: 354 c 91 e 0 -b

CRM Digital ARC 3 D Process Event: uuid: 354 c 91 e 0 -b 3 fa-11 de-98 c 6 -0002 a 5 d 5 c 50 c (D 3 Formal Derivation) (cont’d) WHAT (Input): L 21 used as derivation source: uuid: 2 f 7 d 22 d 2 -1 d 89 -11 e 0 -ac 64 -0800200 c 9 a 66 (D 9 Data Object) L 4 has preferred label: A. 15 -1955 -dome-out. zip (Literal E 62 String) WHAT (Derivative output): L 22 created derivative: uuid: 2 f 7 d 22 dc-1 d 89 -11 e 0 -ac 64 -0800200 c 9 a 66 (D 9 Data Object) L 4 has preferred label: Arc 3 D-A. 15 -1955_dmy. v 3 d (Literal E 62 String) P 2 has type: http: //www. 3 d-coform. eu/#Object. Type/mesh (E 55 Type) P 2 has type: http: //www. 3 d-coform. eu/#mimetype/v 3 d (E 55 Type) (calibration files, depth map files, CUN file and respective images) ICS-FORTH September 21, 2011

CRM Digital Reasoning: A Coherent Semantic Net software, algorithms devices, device models Processing metadata

CRM Digital Reasoning: A Coherent Semantic Net software, algorithms devices, device models Processing metadata params 2 nd Acquistion who, when, where, what , using what object metadata features, history Acquistion metadata Acquistion Processing metadata Acquistion who, when, where, metadata what , using what subevents Acquistion metadata subevents metadata subevents raw data objects who, when, how, what , using what params meshs raw data objects raw data objects Processing metadata who, when, how, what , using what meshs params …+ who - when - where ICS-FORTH September 21, 2011 models who, when, how, what , using what models meshs

CRM Digital Good Reasons for Reasoning (3 D-COFORM) The integrated semantic network of provenance

CRM Digital Good Reasons for Reasoning (3 D-COFORM) The integrated semantic network of provenance metadata allows for supporting data consistency, interpretation, reuse, preservation Management: ¡ ¡ garbage collection of all reproducible intermediate results (classify software!) export packages: collect all acquisition data and parameters used for one model. Preservation: ¡ monitor obsoletion of all processing tools, format viewers necessary to interprete or reprocess certain data. Property propagation to subevents and derivatives (economy & consistency): ¡ For instance, “Which object represents my mesh? ” result in long query paths: “Jesus Christ”. forms part of “Ascension” is carried by: “Ivory Panel”. was digitized by: “Mini. Dome. Event 2011934”. has created: “A. 15 -1955 model v 1. zip”. used as derivation source: ……. ICS-FORTH September 21, 2011

CRM Digital 3 D-COFORM: Concatenated Metadata A. 15 -1955_nxtng_5_degrees_ complete_bjbrown. ply A. 15 -1955

CRM Digital 3 D-COFORM: Concatenated Metadata A. 15 -1955_nxtng_5_degrees_ complete_bjbrown. ply A. 15 -1955 NXTENG whole model v 1. zip has_created_derivative forms_part_of 7 Ivory_NE_Mesh Lab. Proc. Event. rdf A. 15 -1955 NXTENG whole model v 1. rdf 4 Ivory. Panel_NE_ Det. Seq. Event. rdf A. 15 -1955 Degree scans. zip 9 Ivory_NE_Mesh Lab. Proc. Event. rdf 6 Ivory_NE_Mesh Lab. Proc. Event. rdf forms_part_of A. 15 -1955 corner scans. rdf used_as_derivation_source A. 15 -1955 Master. zip used_as_derivation_source A 15 -1955 Retouched. zip created_derivative has_created 3 Ivory. Panel_N E_Obj. Acq. Event. rdf used_as_derivation_source A. 15 -1955 corner scans. zip created_derivative 8 Ivory_NE_Mesh Lab. Proc. Event. rdf digitized used_as_derivation_source 3 Ivo. Pan_Legacy. Data. rdf used_as_derivation_source A. 15 -1955 -dome-out. zip 4 Ivory_Arc 3 DPro c. Event. rdf 5 Ivory_Mesh. La b. Proc. Event. rdf Arc 3 D-A. 15 -1955_dmy. v 3 d has_created digitized created_derivative forms_part_of A. 15 -1955 -domeout. rdf 1 Ivory. Panel_Ob j. Acq. Event. rdf 2009 CR 4851_0. rdf forms_part_of 2 Ivory. Panel_ Doc. Event. rdf ICS-FORTH September 21, 2011 forms_part_of created_derivative Legend Digitization_Process has_created … 2009 CR 4851_0. tif 2009 CA 5306_0. rdf forms_part_of 2009 CA 5307 v Coloured. ply … has_created 2009 CA 5306_0. tif Formal_Derivation Sub-events Data_Object Man_Made_Object

CRM Digital Conclusions CRMdig provides a good high-level model for empirical provenance of digital

CRM Digital Conclusions CRMdig provides a good high-level model for empirical provenance of digital data, open for further specialization, integrated with arbitrary context representations CRM-CRMDig outperforms competitors in expressive power and integration potential. Future work: Theory of property propagation to subevents and derivatives Needed: Theories of feature conservation by kinds of derivation processes. Links: http: //www. ics. forth. gr/isl/rdfs/3 D-COFORM_CRMdig_v 2. 5. rdfs ICS-FORTH September 21, 2011