Linked Open Data Current State and Future Trends

Linked Open Data Current State and Future Trends Martin Nečaský Faculty of Mathematics and Physics Charles University 1

Agenda ◦ What is Open Data ◦ Linked Open Data ◦ principles ◦ usage examples ◦ research challenges ◦ Open Data activities of Open. Data. cz ◦ Our contribution to Czech legislation 2

Open Data Definition Open data is data that can be freely used, re-used and redistributed by anyone - subject only, at most, to the requirement to attribute and sharealike. 3

5 levels of Open Data Zdroj : http: //5 stardata. info 4

Public Sector Open Data? National Statistics Food Inspections Environment Inspections ★★★ http: //www. czso. cz Geopolitical Regions ★★★ http: //www. cizp. cz http: //www. potravinynapranyri. cz/ http: //www. cuzk. cz Business Registers Public Sector Inspections Trade Inspections ★★★ http: //www. mfcr. cz ★★★ Code of Law http: //data. nku. cz http: //www. coi. cz http: //portal. gov. cz 5

What is Linked Data? ★★★★★ Check Actions ID SUBJECT START 2012/33 Peněžní prostředky určené … 2012/11 2012/34 Účetní závěrka a finanční. . . 2012/11 ? Inspected entities ENTITY ID DISTRICT ACTION Ministry of Defence 60162694 Prague 2012/33 Social Security Administration 6963 Prague 2012/34 Linked Open Data is a set of (technological) principles of publishing data on the Web. 6

st 1 Linked Data Principle Use URIs as names for things. Check Actions ID SUBJECT START 2012/33 Peněžní prostředky určené … 2012/11 2012/34 Účetní závěrka a finanční. . . 2012/11 http: //data. nku. cz/action/2012/33 http: //data. nku. cz/action/2012/34 Inspected entities http: //data. nku. cz/entity/60162694 ENTITY ID DISTRICT ACTION Ministry of Defence 60162694 Prague 2012/33 Social Security Administration 6963 Prague 2012/34 http: //data. nku. cz/entity/6963 http: //data. nku. cz/district/prague 7

nd 2 Linked Data Principle Use HTTP URIs so that people can look up those names. HTTP GET "http: //data. nku. cz/action/2012/33 WWW http: //data. nku. cz/action/2012/33 8

rd 3 Linked Data Principle When someone looks up a URI, provide useful information, using the W 3 C standards (RDF, SPARQL). Check Actions ID SUBJECT START 2012/33 Peněžní prostředky určené … 2012/11 "2012/11" "2012/33" nku: id RDF expression (Turtle) nku: start http: //data. nku. cz/action/2012/33 nku: subject "Peněžní prostředky určené …" <http: //data. nku. cz/action/2012/33> nku: id <http: //data. nku. cz/action/2012/33> nku: ubject <http: //data. nku. cz/action/2012/33> nku: start subject predicate "2012/33". "Peněžní prostředky určené …". "2012/11". object 9

rd 3 Linked Data Principle When someone looks up a URI, provide useful information, using the standards (RDF, SPARQL). HTTP GET SPARQL query SPARQL API (SPARQL endpoint) NKÚ RDF store HTTP GET "http: //data. nku. cz/. . . HTTP SERVER 10

SPARQL crash course ◦ Similar to SQL. ◦ Query expressed as a graph pattern. SELECT <result specification> WHERE <graph pattern> 11

SPARQL crash course ◦ Graph pattern consists of simple triple patterns. SELECT ? x "2012/11" WHERE { ? x nku: start "2012/11". nku: start ? x } 12

SPARQL crash course ◦ Graph pattern consists of simple triple patterns. SELECT ? x ? y "2012/11" WHERE { ? x nku: start "2012/11" ; nku: subject ? y. nku: start ? x nku: subject ? y } 13

SPARQL crash course ◦ Graph pattern consists of simple triple patterns. SELECT ? x ? y ? z "2012/11" WHERE { ? x nku: start "2012/11" ; ? z ? y. nku: start ? x ? z ? y } 14

SPARQL crash course ◦ Query may return a graph as well CONSTRUCT { "2012/11" ? x ? z ? y. } WHERE { ? x nku: start "2012/11" ; nku: start ? x ? z ? y. } 15

th 4 Linked Data Principle Include links to other URIs so that others can discover more things. "2012/33" <http: //data. nku. cz/action/2012/33> id "2012/33" ; subject "Peněžní prostředky určené …" ; start "2012/11" ; entity <http: //data. nku. cz/entity/60162694>. id start http: //data. nku. cz/action/2012/33 subject "Peněžní prostředky určené …" <http: //data. nku. cz/entity/60162694> title “Ministry of Defense" ; district <http: //data. nku. cz/district/prague>. entity http: //data. nku. cz/entity/60162694 “Ministry of Defense" <http: //data. nku. cz/district/prague> title "Prague". "2012/11" district http: //data. nku. cz/district/prague "Prague" 16

th 4 Linked Data Principle Include links to other URIs so that others can discover more things (including URIs of other publishers). http: //data. nku. cz/action/2012/33 entity http: //data. mfcr. cz/ares/entity/60162694 same as http: //data. nku. cz/entity/60162694 district http: //data. cuzk. cz/ruian/district/3100 http: //data. nku. cz/district/prague 17

th 4 Linked Data Principle Include links to other URIs so that others can discover more things (including URIs of other publishers). Gov Off Science and Research IS Business Entities Trade Inspection Soc Sec Public Sector Inspection Geopolitical Regions Statistics Nat Stats Demography 18

LOD usage examples http: //linked. opendata. cz/sparql http: //ruian. linked. opendata. cz/sparql http: //data. cssz. cz/sparql 19

Searching Datasets Where can I get some data about entities inspected by Supreme Audit Office (SAO)? SAO Entity linked. opendata. cz owl: same. As ? owl: same. As Organizace … owl: same. As SPARQL : https: //drive. google. com/open? id=0 Bw. P-Tf. UUfc. FTR 0 VYd 3 ZJa. TJub 3 c (try on http: //linked. opendata. cz/sparql endpoint) 20

Searching Datasets Public Agreements Registry - Agreements 61961 Registr Agreements Registry - Orders 27726 Database of Science, Research and Innovations 14286 Offices of Public Authorities Public Sector Inspections 763 6254 Agendas of Public Institutions 12112 Identification Numbers of Business Entities 60520 Trade Register 167376 Monitor of Public Budgets 104522 Registr Agreements Registry - Payments 5516 Trade Inspections 2576 Integrated Registry of Environmental Pollution 6658 Public Authorities 60007 Business Register 94881 21

Combining datasets Which public research institutions were inspected by SAO and what is their public research budget? Science and Research DB SAO Entity linked. opendata. cz owl: same. As Entity Project Participant Premise Budget owl: same. As Check. Action Research. Org SPARQL : https: //drive. google. com/open? id=0 Bw. P-Tf. UUfc. FTS 2 Vj. V 1 puakd. Ie. G 8 (try on http: //linked. opendata. cz/sparql endpoint) RESULT IN CSV : https: //drive. google. com/open? id=0 Bw. P-Tf. UUfc. FTN 2 Nz. Vlk 4 Zk 1 nc. GM 22

Combining datasets Sanctions for unfair trade practices in Czech regions and numbers of pensioners. Social Security Trade Inspections # pensioners Inspection owl: same. As Sanction RAMON EU Region NUTS owl: same. As Geopolitical regions Region SPARQL : https: //drive. google. com/open? id=0 Bw. P-Tf. UUfc. FTQz. BGZzdw. Yz. Fu. TUE (try on http: //linked. opendata. cz/sparql endpoint, note : this federated query also asks http: //ruian. linked. opendata. cz/sparql and http: //data. cssz. cz/sparql) RESULT IN CSV : https: //drive. google. com/open? id=0 Bw. P-Tf. UUfc. FTa. EVx. NF 84 Nl. Uw. TTg 23

Building Applications ◦ http: //lekovaencyklopedie. cz Each oval is a data source which exists (Me. SH, NDF-RT, NCI, Drug. Bank) as LOD or we have converted it to LOD. Links represent types of RDF links between datasets. LOD made us much faster in the development. RDF data updated periodically thanks to http: //etl. linkedpipes. com 24

Linked Open Data (LOD) Cloud 25

Knowledge Graphs as LOD ◦ DBPedia ◦ Wikipedia as LOD ◦ http: //dbpedia. org/sparql ◦ 402, 086, 316 triples about 17, 315, 785 entities ◦ Wikidata ◦ ◦ Emerging project of Wikimedia Foundation Structured data source for Wikipedia https: //query. wikidata. org 1, 373, 105, 652 triples about 24, 437, 040 entities 26

Two research challenges for near future “A data journalist writes an article about unfair trade practices on elderly people in Czech Republic. He needs to find datasets with an evidence for his article (unfair trade inspections, elderly people numbers, regions in Czech Republic). He also needs to preview the discovered datasets, create map visualizations and embed them to his article. ” ◦ Challenge 1: Dataset discovery ◦ Challenge 2: Dataset visualization 27

Dataset discovery ◦ Input : User’s intent ◦ How the intent should be expressed? ◦ How we can assist the user when expressing the intent? ◦ How the expression of the intent should be translated to a formal query language? ◦ Output : Combinations of datasets which fulfill the intent ◦ How datasets should be indexed? ◦ How the indexes should be kept up-to-date? ◦ How the user’s intent should be evaluated against the index? 28

Back to Open Data ◦ Open. Data. cz – a group of academicians supporting and boosting (Linked) Open Data in Czech public sector ◦ We have assisted several public institutions with opening their data ◦ ◦ ◦ http: //data. ctu. cz http: //data. nku. cz http: //data. cssz. cz http: //data. gov. cz Cooperation with ČSÚ, ČOI, MF ČR, MV ČR 29

Back to Open Data ◦ Under Ministry of Interior of Czech Republic, we have helped with making Open Data as one of the major e. Government topics ◦ position of National Coordinator for Open Data ◦ National Open Data Catalogue (http: //data. gov. cz) ◦ Standards for open data publication and cataloging (http: //opendata. gov. cz) ◦ Open Data in Czech legislation ◦ Educating public institutions ◦ Plan for National Linked Open Data Infrastructure 30

Our Journey to Czech Open Data Legislation ◦ October 2014 : Open Data must be part of Czech legislation ◦ Public bodies did not want to or could not open their data without legislation. ◦ October 2016 : The Czech president signed our amendment of Public Sector Information Act (106/1999) introducing Open Data ◦ Only data published according to given conditions can be called Open Data. ◦ Ministry of Interior must provide National Open Data Catalogue ◦ Czech Government instructs ministries and national authorities to mandatorily publish given datasets as Open Data since 1. 1. 2017. ◦ http: //www. lupa. cz/aktuality/jizdni-rady-ares-ci-volna-mista-vlada-naridila-uradum-ktera-datamaji-otevrit/ ◦ Defending our position ◦ ◦ Ministry of Interior (Oct 2014 – Aug 2015) Office of the Government (Sep 2015 – Mar 2016) Parliament (Apr 2016 – Aug 2016) Office of the Government (Oct 2016 – Dec 2016) 31

How you can help (Linked) Open Data? ◦ Develop applications which use open data. ◦ bachelor or diploma theses, student software projects ◦ If you need some data, ask for them. ◦ You can ask Open. Data. cz and we will try to help 32

Thank you MARTIN NEČASKÝ necasky@ksi. mff. cuni. cz 33