Linking Open Data Linking the world of data

  • Slides: 37
Download presentation
Linking Open Data Linking the world of data from LOD mailinglist Acknowledgement for Tom

Linking Open Data Linking the world of data from LOD mailinglist Acknowledgement for Tom Heath (Talis) Ying Ding (dingying@indiana. edu) http: //info. slis. indiana. edu/~dingying/

What is now l User generated content is growing tremendously l Isolated contents need

What is now l User generated content is growing tremendously l Isolated contents need deadly to get connected. l The world is connected, so do the data, information and knowledge

Old terms l Data -- sensing the world ¡ What you sense (see, hear,

Old terms l Data -- sensing the world ¡ What you sense (see, hear, smell, touch…) l Information – perceiving the world ¡ Perceive the sensed data l Knowledge – contextualizing information ¡ Comprehend the perceived information ¡ Add context Context ultimately determines what’s actually what.

What is our daily life l Access data l Manipulate data (add, delete, change)

What is our daily life l Access data l Manipulate data (add, delete, change) l Process data ¡Generate information (tables, forms) ¡Create knowledge (reports, papers. . )

Data is our life l Data is our daily bread l Do we have

Data is our life l Data is our daily bread l Do we have identifier for data? ¡ Not really important if data is small and individual ¡ Really important if data is huge and connected ? Should we need identifier for our data ? Why do we need our name, or social security number ? Can you refer to someone without identifier ? a person with good heart----

Make our busy life less messy l We just got 24 hours per day,

Make our busy life less messy l We just got 24 hours per day, not more l Add identifier to our data ¡ Give the everyone-agreed-unique-identifier to each data -- the perfect world of our dreamland l We will not have any integration problem, most of the IT departments can be closed ¡ Different groups give different identifiers to the same data – we can live with that, it is more real in our daily life, standardization bodies and IT guys are helping us. We are happy that we can refer to data

Where are our data l In computer l On the Web l In my

Where are our data l In computer l On the Web l In my paper notes l In printed books l… Data are being digitalized and are available online Web Data

Web data l Data on the Web ¡ Online journal ¡ Blog ¡ Wiki

Web data l Data on the Web ¡ Online journal ¡ Blog ¡ Wiki ¡… l Data in physical world ¡ Yourself ¡ Table ¡ Book in library ¡ Computer you are using ¡… l The boundary is blurring ¡ Paper is both in your hand on the Web

How to refer data l Web data ¡DOI (Digital Object Identifier) ¡Open. ID (people,

How to refer data l Web data ¡DOI (Digital Object Identifier) ¡Open. ID (people, …) ¡URI (blog, wiki, homepage, …) ¡…

URI (Uniform Resource Identifier) l To identify or name a resource on the Internet

URI (Uniform Resource Identifier) l To identify or name a resource on the Internet l The main purpose is to enable interaction with representations of the resource over a network, typically WWW, using specific protocols –from Wikipedia ¡ URN – like a person’s name l urn: isbn: 0 -486 -27557 -4 – Book of “Romeo and Juliet” ¡ URL – like a street address l http: //www. slis. indiana. edu

Linked Data l A term coined by Tim Berners-Lee l It describes HTTP-based Data

Linked Data l A term coined by Tim Berners-Lee l It describes HTTP-based Data Access by Reference for the Web l Current web is changing from hypertext links (link documents) to hyperdata links (linking data) ¡ Data are small components of the resources ¡ It drills deep to the details of the resources l Linked data provides a powerful mechanism for meshing disparate and heterogeneous data

Vision from Sir Berners-Lee l “The Semantic Web isn’t just about putting data on

Vision from Sir Berners-Lee l “The Semantic Web isn’t just about putting data on the web. It is about making links”. l Four Rules for linking data ¡ Use URIs as names for things ¡ Use HTTP URIs so that people can look up those names ¡ When someone looks up a URI, provide useful information (URI dereferencing) ¡ Include links to other URIs, so that they can discover more things l “Breaking them does not destroy anything, but misses an opportunity to make data interconnected. This in turn limits the ways it can later be reused in unexpected ways. It is the unexpected re-use of information which is the value added by the web”

W 3 C SWEO Linking Open Data Project l Project aims to ¡Publish existing

W 3 C SWEO Linking Open Data Project l Project aims to ¡Publish existing open license datasets as linked data on the web ¡Interlink things between different data sources ¡Develop clients and applications that consume linked data from the web

Bubbles in May 2007 Over 500 M RDF triples Around 120 K RDF links

Bubbles in May 2007 Over 500 M RDF triples Around 120 K RDF links between data sources

Bubbles in April 2008 >2 B RDF triples Around 3 M RDF links

Bubbles in April 2008 >2 B RDF triples Around 3 M RDF links

Bubble now

Bubble now

Organization participating in the LOD community l Academic ¡MIT, Univ Southampton, DERI, Open Univ,

Organization participating in the LOD community l Academic ¡MIT, Univ Southampton, DERI, Open Univ, Univ London, Univ Hannover, Penn State Univ, Univ Leipzig, Univ Karlsruhe, Joanneum (AT), Free Univ Berlin, Cyc, South. East Univ (CN), … l Commercial ¡BBC, Open. Link, Talis, Zitgist, Garlik, Mondeca, Renault, Boad Interactive

What are Linked Data? l Linked Data require RDF ¡Why not XML? l. Different

What are Linked Data? l Linked Data require RDF ¡Why not XML? l. Different model theory l But not all RDF data are linked data ¡You have to compliant your RDF data according to the four rules mentioned by Berners-Lee l What is RDF?

Basic Ideas behind RDF l RDF uses Web identifiers (URIs) to identify resources l

Basic Ideas behind RDF l RDF uses Web identifiers (URIs) to identify resources l RDF describes resources with properties and property values ¡Everything can be represented as triples l The essence of RDF is the (s, p, o) triple Resource (subject) Property (predicate) Value (object) Subject has a property with value “object ” (s, p, o)

RDF Triples l Triple ¡ A Resource (Subject) is anything that can have a

RDF Triples l Triple ¡ A Resource (Subject) is anything that can have a URI: URIs or blank nodes ¡ A Property (Predicate) is one of the features of the Resource: URIs ¡ A Property value (Object) is the value of a Property, which can be literal or another resource: URIs, literal, blank nodes Resource (subject) Property (predicate) Value (object) Literals can be the object of an RDF statement, but cannot be the subject or the predicate

Do you have linked data l Linked data are just RDF triples <rdf: Description

Do you have linked data l Linked data are just RDF triples <rdf: Description about=“http: //example. org/smith#albert”> <fam: has. Child rdf: Resource="http: //example. org/smith#brian"> <fam: has. Child rdf: Resource="http: //example. org/smith#carol"> </rdf: Description> l How can I get RDF triples ¡ Relational database: l D 2 R tools can convert them for you ¡ RDFizers from SIMILE: l Can convert JPEG, MARC/MODS, OAI-PMH, OCW(MIT Open Course), Email, Bib. Tex, Javadoc, etc. to RDF

Thumb of the rules l Understand your data ¡What do you want to have

Thumb of the rules l Understand your data ¡What do you want to have in your data ¡Do not reinvent – REUSE! l. Potential ontologies/vocabularies • FOAF, SIOC, Geo ¡URI Aliases l. Different URIs for the same non-information resource (Berlin, etc. ) lowl: same. As to link these URI aliases

More principles l Linked Data is simply about using the Web to create typed

More principles l Linked Data is simply about using the Web to create typed links between data from different sources. l The principle of Linked data is to: ¡Use the RDF data model to publish structured data on the web ¡Use RDF links to interlink data from different data sources. ¡Use HTTP URIs to identify resource l. To avoid other URI schemes (URNs or DOIs)

Power of Linked Data rdf: type ying foaf: Person foaf: name Ying Ding dblp:

Power of Linked Data rdf: type ying foaf: Person foaf: name Ying Ding dblp: publications foaf: publication foaf: knows Stefan foaf: based_near 72 K dp: population db: Galway dp: Dublin skos: subject dp: Cities_in_Ireland

How to become a bubble l Publishing your bubble l Are you ready? ¡Dereferencing

How to become a bubble l Publishing your bubble l Are you ready? ¡Dereferencing HTTP URIs l. Information resources (resources available on the web): • HTTP GET HTTP response code 200 OK l. Non-information resources (real-word objects that exist outside of the web): • HTTP GET HTTP 303 See Other (303 redirect) ¡You are not your homepage, but you can be dereferenced by your homepage

Publish your bubble l Step 1: Choosing URIs ¡ Use HTTP URIs for everything

Publish your bubble l Step 1: Choosing URIs ¡ Use HTTP URIs for everything (http: //) ¡ Make it dereferenable l Try to use the existing dereferencable URIs to represent common things (city, music, artist, etc. ): http: //esw. w 3. org/topic/Task. Forces/Community. Projects/Linking. O pen. Data/Common. Vocabularies l For instance: Geonames, DBpedia, Musicbrainz, dbtune, RDF Book Mashup ¡ Keep implementation info out of your URIs ¡ Keep your URIs stable and persistent

Publish your bubble l Step 1: Choosing URIs http: //dbpedia. org/resource/Berlin http: //dbpedia. org/page/Berlin

Publish your bubble l Step 1: Choosing URIs http: //dbpedia. org/resource/Berlin http: //dbpedia. org/page/Berlin http: //dbpedia. org/data/Berlin http: //id. dbpedia. org/Berlin http: //pages. dbpedia. org/Berlin http: //data. dbpedia. org/Berlin http: //dbpedia. org/Berlin. html http: //dbpedia. org/Berlin. rdf Reference: Sauermann et al. : Cool URIs for the Semantic Web (tutorial on URI dereferencing and content-negotiation)

Publish your bubble l Step 2: choose the vocabularies to represent information ¡ Reuse

Publish your bubble l Step 2: choose the vocabularies to represent information ¡ Reuse terms from well-known vocabularies wherever possible l Friend of a Friend (FOAF) l Dublin Core (DC) l Semantically-Interlinked Online Communities (SIOC) l Description of a Project (DOAP) l Simple Knowledge Organization System (SKOS) l Creative Commons (CC) l More: http: //esw. w 3. org/topic/Task. Forces/Community. Projects/Linking. Ope n. Data/Common. Vocabularies ¡ You should only define new terms yourself if you cannot find required terms in existing vocabularies

Publish your bubble l Step 2: choose the vocabularies to represent information ¡ If

Publish your bubble l Step 2: choose the vocabularies to represent information ¡ If you really have to define your own vocabularies: l Do not define new vocabularies from scratch l Provide for both humans and machines (rdf: comments, rdfs: label) l Make term URIs dereferenceable l Make use of other people’s terms l State all important information explicitly l Do not create over-constrained, brittle models, leave some flexibility for growth

Publish your bubble l Step 3: Link your bubble with other bubbles ¡RDF links

Publish your bubble l Step 3: Link your bubble with other bubbles ¡RDF links enable browsers and crawlers to navigate between data sources and to discover additional data. lfoaf: knows, foaf: based_near, foaf: topic_interest lowl: same. As (map different URI aliases)

Publish your bubble l Step 3: Link your bubble with other bubbles ¡Auto-generating RDF

Publish your bubble l Step 3: Link your bubble with other bubbles ¡Auto-generating RDF Links: l. ISBN for books (e. g. , RDF Book Mashup) <http: //dbpedia. org/resource/Harry_Potter_and_the_Half-Blood_Prince> owl: same. As <http: //www 4. wiwiss. fu-berlin. de/bookmashup/books/0747581088> ¡More complex property-based algorithms l. Interlinking DBpedia and Geonames l. Interlinking Jamendo and Music. Brainz

Publish your bubble l Recipes for publishing different information as Linked Data on the

Publish your bubble l Recipes for publishing different information as Linked Data on the Web ¡ Things must be identified with dereferenceable HTTP URIs ¡ If such a URI is dereferenced asking for the MIME-type application/rdf+xml, a data source must return an RDF/XML description of the identified resource ¡ URIs that identify non-information resources should return HTTP 303 redirect ¡ Besides RDF links to resources within the same data source, RDF descriptions should also contain other RDF links to link to other resources, so that you can browse the web of data.

Test your bubble l Step 4: test and debug linked data ¡Vapour linked validation

Test your bubble l Step 4: test and debug linked data ¡Vapour linked validation service: a linked data validator (http: //vapour. sourceforge. net/) ¡Use Linked browsers to see whether your information display correctly and your RDF links work l. Tabulator, Marbles, Open. Link RDF Browser, Disco

Welcome to the bubble world l Very excited! l Then what is my contribution

Welcome to the bubble world l Very excited! l Then what is my contribution and benefit? ¡Add more data to RDF data ¡Increase semantic content ¡… ¡… ¡Bring Web to its full potential!

What LOD can bring? l It will lift current document web up to a

What LOD can bring? l It will lift current document web up to a data web l LOD browsers can let you navigate between different data sources by following RDF links. l It can drill down to the lower granularity of the information ¡ allowing you for more fine search on the web ¡ making the question-answer search on the Web possible ¡ meshing up different data through RDF links ¡ Making the built-on-top application easier

Document Web vs. Data Web l Document Web ¡ Glued by hyperlinks ¡ Data

Document Web vs. Data Web l Document Web ¡ Glued by hyperlinks ¡ Data are HTML pages ¡ Query result is HTML pages, which can not be further processed ¡ Data are just interlinked, but not integrated ¡ Data access through different APIs l Data Web ¡ Glued by RDF links ¡ Data are RDF triples ¡ Query result is RDF triples which can be easily further processed (e. g. , web services) ¡ Data are interlinked and integrated, and links are typed ¡ Data access through a single and standardized access mechanism (maybe it will called in the future LOD API? )

More about LOD l LOD Wiki ¡ http: //esw. w 3. org/topic/Sweo. IG/Task. Forces/Community.

More about LOD l LOD Wiki ¡ http: //esw. w 3. org/topic/Sweo. IG/Task. Forces/Community. Projects/Linking Open. Data l Tutorial on how to publish LOD data ¡ http: //www 4. wiwiss. fu-berlin. de/bizer/pub/Linked. Data. Tutorial/ l Further readings and tools l W 3 C Track LOD WWW 2008 ¡ http: //www. w 3. org/2008/Talks/WWW 2008 -W 3 CTrack-LOD. pdf l Linked Data Planet in New York 2008 ¡ http: //linkeddata. org/slides/2008 -06 -nyc-ldp. pdf l LDOW 2008 workshop in WWW 2008 ¡ http: //sunsite. informatik. rwth-aachen. de/Publications/CEUR-WS/Vol 369/ l ISWC 2008 LOD tutorial ¡ http: //events. linkeddata. org/iswc 2008 tutorial l LOD mailinglist