MPEG7 based Multimedia Ontologies Interoperability Support or Interoperability

MPEG-7 based Multimedia Ontologies: Interoperability Support or Interoperability Issue? Raphaël Troncy Oscar Celma Suzanne Little Roberto Garcia Chrisa Tsinaraki Wednesday 5 th of December, 2007 Raphael. Troncy@cwi. nl

Motivation n Growing amount of digital multimedia content available on the Web n Content difficult to search and reuse Annotate multimedia content on the web

MPEG-7 and the Semantic Web n MPEG-7: ISO Standard in 2001: Hunter, MDS in RDFS l Later on, link to the ABC upper ontology n 2004: Tsinaraki et al. , DS-MIRF model in OWL-DL n 2005: Garcia and Celma, Rhizomik model l Fully automatic translation of the whole standard n 2007: Arndt et al. , COMM l Re-engineering MPEG-7 using DOLCE design patterns

MPEG-7 Based Ontologies Hunter DS-MIRF Rhizomik COMM Foundations ABC None DOLCE Complexity OWL-Full OWL-DL Coverage MDS+Visual MDS+CS All MDS+Visual Applications Digital Libraries Digital Right MM Analysis

Requirements [ace. Media, MMSEM XG] n MPEG-7 compliance l Support most descriptors (decomposition, visual, audio) n Syntactic and Semantic interoperability l Shared and formal semantics represented in a Web language (OWL, RDF/XML, RDFa, etc. ) n Separation of concerns l Domain knowledge versus multimedia specific information n Modularity l Enable customization of multimedia ontology n Extensibility l Enable inclusion of further descriptors (non MPEG-7)

Common Scenario Reg 1 The "Big Three" at the Yalta Conference (Wikipedia) n Localize a region (person) n Annotate the content (interpretation) Winston Churchill, UK Prime Minister, Allied Forces, WWII n Link to knowledge on the Web : Reg 1 foaf: depicts dbpedia: Winston. Churchill dbpedia: Churchill rdfs: label "Winston Churchill" dbpedia: Churchill rdf: type foaf: Person

Hunter's MPEG-7 Ontology

DS-MIRF MPEG-7 Ontology

Rhizomik MPEG-7 Ontology

COMM: Fragment Identification

COMM: Region Annotation

Comparison n Link with domain semantics l Hunter: ABC model + mpeg 7: depicts relationship l DS-MIRF: Domain ontologies needs to subclass the general MPEG-7 categories l Rhizomik: Use the mpeg 7: semantic relationship l COMM: Semantic Annotation pattern n MPEG-7 coverage l Hunter: extension of the MPEG-7 visual descriptors l COMM: 4 Formalization of the context of the annotation 4 Representation of the method (algorithm) that provides the annotation

Comparison n Modeling Decisions: l DS-MIRF and Rhizomik: 1 -to-1 translation from MPEG-7 to OWL/RDF l Hunter: Simplification and link to the ABC upper model l COMM: NO 1 -to-1 translation 4 Need for patterns: use DOLCE, a well designed foundational ontology as a modeling basis n Scalability: Hunter DS-MIRF Rhizomik COMM Triples 11 20 27 19

Conclusion n Advantages of having MPEG-7 based ontologies rather than plain XML Schema n Similarities and differences: l DS-MIRF and Rhizomik l Hunter and COMM n Towards an harmonization?