The OWL Reasoner Evaluation Goes Mobile Roberto Yus
The OWL Reasoner Evaluation Goes Mobile Roberto Yus, Fernando Bobillo, Carlos Bobed, Eduardo Mena University of Zaragoza, Spain 4 th OWL Reasoner Evaluation Workshop (ORE 2015) 6 th June, 2015, Athens, Greece
Outline n n n A Mobile World Previously A Mobile Competition What to Test n How to Test n n Competition
A Mobile World n Almost since always … But now more than ever …
A Mobile World n New opportunities
A Mobile World n New opportunities
Previous works n ORE’ 13 n n ORE’ 14 n n n “Android goes Semantic: DL Reasoners on Smartphones” “Android went Semantic: Time for Evaluation” An exhaustive performance study … Several mobile systems where we use different reasoners
What to test n Reasoning tasks to consider Consistency checking n Classification n Query Answering n Mobile oriented ones? n Context awareness n Stream reasoning n More Classical Ones
What to test n Parameters to measure n Robustness n Adapted to take into account the results in desktop computers (e. g. ports, optimizations, … might result in incorrect/incomplete reasoning) CPU Usage n Memory Usage (PSS/task) n Power Consumption (m. W/task) n
How to test n Ontology Set Same size classification as in ORE (#axioms) n Controlled subset of ORE competitions n File size (parsing memory): 128 MB limit n Offline vs Live competition n n 200 small / medium, and 50 large ontologies for the offline competition 50 small / medium, and 10 large ontologies for the live competition OWLAPI?
How to test n Mobile Devices Tablets and smartphones n n Two devices of each kind: medium and top range OS Android i. OS Windows Phone Black. Berry OS Others Q 1 2015 78. 0% 18. 3% 2. 7% 0. 3% 0. 7% Q 1 2014 81. 2% 15. 2% 2. 5% 0. 7% Q 1 2013 75. 5% 16. 9% 3. 2% 2. 9% 1. 5% Q 1 2012 59. 2% 22. 9% 2. 0% 6. 3% 9. 5% n Period International Data Corporation (IDC) https: //www. netmarketshare. com/
How to test n Mobile Devices n Tablets and smartphones n Two devices of each kind: medium and top range OS n Version Codename API Distribution 2. 2 Froyo 8 0. 3% 2. 3. 3 2. 3. 7 Gingerbread 10 5. 6% 4. 0. 3 4. 0. 4 Ice Cream Sandwich 15 5. 1% 4. 1. x Jelly Bean 16 14. 7% 4. 2. x 17 17. 5% 4. 3 18 5. 2% 4. 4 Kit. Kat 19 39. 2% 5. 0 Lollipop 21 11. 6% 22 0. 8% 5. 1
Competition Skeleton App Competing Reasoners Selected Devices Test App Android Reasoner . apk file Own Test Ontology Set Competition Ontology Set
Thank you for your attention!! (and your feedback) http: //sid. cps. unizar. es/Android. Semantic http: //modest. mobi
- Slides: 13