Improvement in the Geofencing Service Interface using Indoor

Improvement in the Geofencing Service Interface using Indoor Positioning Systems and Mobile Sensors Masafumi Nakagawa Shibaura Institute of Technology SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Introduction SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Location based service (LBS) - Mobile hardware development has improved the availability of positioning services - Positioning accuracy is one of the important issues in location-based services Many significant issues Mapping - Accuracy - Representation - Reliability Positioning - Accuracy - Availability - Integrity - Reliability Geofencing Information distribution - Usability - Availability - Reliability - Comfort - Security SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Mapping Accuracy, Representation, Reliability TIMMS Camera Li. DAR Point cloud IMU Encoder Trajectory 3 D scanned “indoor space” with Indoor mobile Li. DAR SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Positioning Accuracy, Availability, Integrity, Reliability Outdoor positioning Indoor positioning Wi-Fi GNSS GPS, GLONASS, Galileo, Compass, etc. QZSS RFID Outdoor Lighting tag Bluetooth IMES QR code Indoor Under trees Underground Boundary Mobile interface Network sensors Car navigation Autonomous robot Indoor-Outdoor seamless positioning SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Geofencing application Usability, Availability, Comfort Use user location and a predefined set of boundaries on a map - A geofence is generated on a map at a radius around a store or a point location - The geofencing application provides various services using the geofence ①Virtual parameter for a real-world geographic area - Download - Notification Navigation Geofence ②User with a location-aware device enters or exits the geofence SHIBAURA INSTITUTE OF TECHNOLOGY ③The mobile device receives notification such as location-based assistance or alerts via email or SMS (location-based burglar alarm, location-based schedule assistance, or cashless purchase applications) NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Information distribution (1) Usability, Reliability, Security Location data（ GPS, IMES, RFID, etc. ） Pull-based distribution - Active download Click a button (icon or link) Download a file or service Augmented reality applications using a camera mounted on a mobile interface have been proposed for use in shopping malls and museums for browsing spatial information Spatial contents Push-based distribution - Passive download Location based information distribution Download a file or service The service provider compels the user to download a file or service from a server Both types of distribution are performed using user location data in LBS SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Information distribution (2) Generally, “push-based” is more convenient than “pull-based” - User can enjoy automated delivery of spatial contents - However, “push-based” has a higher probability of including unexpected information - Unexpected information (Unnecessary, deceptive, or erroneous) - Sometimes, attractive information can be found in the unexpected information - However, the user usually receives unwanted information Fishing mails Conventional security software can prevent users from receiving risky mails Advertisements of no interest The software has difficulties in rejecting advertisements of no interest to the user - Timing for receiving notifications The conventional software also has difficulties in controlling the timing for receiving notifications These issues would reduce the usability of positioning services SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Location-based notification control Distribution of valid spatial contents to users Conventional approach ①Information selection for distribution using user position and stay time ②Classification between a walk and stop using a power spectrum of data taken from an acceleration sensor - Personal parameters are required to improve the accuracy of information selection (a schedule, personal preferences, daily pattern, walk pattern, gender, and age) - Many sensitive parameters need to be adjusted for individual users - Users should be protected against leakage of personal data - These limitations make such methods unsuitable for public and anonymous services (e. g. museum applications and asset management) Proposed approach - Location and behavior - Without Manual input parameters - Without Personal data (daily data, etc. ) SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Objective Propose a geofencing application as a push-based distribution paradigm in location-based services - LBS requires the achievement of higher usability and comfort with the filtering of unexpected information distribution - Focus on an improvement in spatial information distribution for mobile interfaces in indoor environments - Propose an approach to estimate user status using location and acceleration data taken from mobile interfaces, without personal data - Control information distribution (notifications) - Control the timing for receiving notifications SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Methodology SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Methodology User status estimation for the best notifications The user status - The local situation of the user Position data acquisition Acceleration data acquisition Location estimation Behavior estimation (walking or stopped in front of something) - The user status was estimated using location and behavior User status estimation - The user status was used to select the information required for the most useful notifications Notification control Notification SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Methodology Estimate walker status for notification delivery GPS IMES Receiver Location labeling Stop & Go RFID etc. Synchronization ①Behavior estimation Acceleration sensor Behavior labeling Status labeling ②Location estimation Position and acceleration data acquisition Notification Client Browser Download [3] the selected file is sent or distributed to the user or client to be browsed as notifications HTML file Selection [1] the user status is uploaded Upload User status ③User status estimation Data acquisition and real-time analysis SHIBAURA INSTITUTE OF TECHNOLOGY [2] the user status is matched with a file (a map, advertisement, and coupon) on the server Location DB Server ④Notification control NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Methodology Estimate user status for notifications ②Location estimation Stop ④Notification control Location 1 Location 2 Location 3 ・・・ ①Behavior estimation Out of geofence Move Notification 1 Notification 2 Notification 3 ・・・ Notification A ③User status estimation Out of Geofence Move Stop Behavior SHIBAURA INSTITUTE OF TECHNOLOGY In Geofence Location NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Experiment SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Methodology Estimate user status for notifications ②Location estimation Stop ④Notification control Location 1 Location 2 Location 3 ・・・ ①Behavior estimation Out of geofence Move Notification 1 Notification 2 Notification 3 ・・・ Notification A Targeted segment (User status) Out of Geofence Move Stop Behavior SHIBAURA INSTITUTE OF TECHNOLOGY In Geofence Location NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Indoor positioning Three types of RF positioning “Floor“ Wi-Fi, etc. “Area” IMES, RFID, etc. “Point” RFID, IR, etc. Type Features Floor Hard to estimate a detailed position Area Landmark based geofences Point Hard to find a service area SHIBAURA INSTITUTE OF TECHNOLOGY Spatial resolution (serviced area) Total cost Low High NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Indoor Messaging System - One of the indoor positioning systems developed by JAXA - IMES uses a signal compatible with GPS - IMES transmitters are identified using an assigned PRN (pseudo random number) IMES can share hardware (an antenna and receiver) with GPS Same device Short identification data from the IMES transmitters Multi GNSS positioning 3 m 10 m Focused on the advantage of seamless use in a mobile interface SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

GPS and IMES receiver and AHRS Combined the IMES receiver and the three-axis acceleration sensor On a wooden board a little larger than a smartphone Connected to a notebook PC (Local server) GPS and IMES receiver AHRS (Tokyo University of Marine Science and Technology, and JAXA) (MTi, Xsens) Sampling rate : 1 Hz SHIBAURA INSTITUTE OF TECHNOLOGY (Attitude and heading reference system) Sampling rate: 100 Hz NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Study area Five geofences in Outdoor-Indoor environment Information board Coffee shop (TULLY’s) Outdoor Convenience store (LAWSON) Bar (HUB) IMES transmitter and antenna Indoor Geofences were assigned PRNs between 173 and 176 SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

IMES transmitter arrangement Geofences were covered with directional antennae Antenna Directional antenna Transmission direction Route Antenna Transmitter and Battery Transmission direction Route SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Result SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Results User stops in geofences Distribute information User walks in geofences No actions “Position” SHIBAURA INSTITUTE OF TECHNOLOGY “Behavior” NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Notification control The user status (walk and stop) was recognized in selecting a web file for distribution to the user Behavior Stop / Move Location PRNs User status ID User stops in front of PRN 173 T 1[sec] (PRN 173) Map information User stops in front of PRN 174 T 2[sec] (PRN 174) TULLY’s SHIBAURA INSTITUTE OF TECHNOLOGY ①Context A combination of stop status and location data generated a context ②Delay ③HTML file selection Based on the context, suitable web files for the user were presented on a browser after time T 2 [s] as push -based information distribution. NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Discussions SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Discussions Expected three benefits from our approach ① The user can automatically receive only information of interests, based on dynamic information selection corresponding with their status - Unwanted information can be reduced for individual users Case 1 The user stops to look at an advertisement in front of a store We would receive a recommendation or coupon from the store Case 2 The user passes by the store The recommendation would be rejected as ineffective information Case 3 The store can send the user suitable advertisements according to their status ② Can detect a user’s status without personal parameters - Conventional LBS requires private information (schedules, preferences, genders, and ages) to improve accuracy of user status in personal use. - Proposed approach can achieve a precise information distribution using location and acceleration data ③ Can estimate user status using sensors mounted on mobile interfaces - Require the preparation of spatial infrastructure such as transmitters for indoor positioning - Our approach can improve the performance of user status estimation using low-cost sensors mounted on mobile interfaces without precise maps SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Discussions Indoor(-Outdoor) LBS Assistance in Facility management Inspection with tablet PC Hands-free inspection with wearable PC Autonomous robot services To achieve higher safety in traffic assistance and autonomous robot services, LBS should also reduce the distribution of unexpected information. SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Summary SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp

Summary Improvement in the Geofencing Service Interface using Indoor Positioning System and Mobile Sensors - Focused on an improvement in spatial information distribution for mobile interfaces in indoor environments - Proposed an approach to estimate user status using location and acceleration data taken from mobile interfaces, without personal data - Confirmed that our approach can achieve dynamic information selection based on a combination between the IMES and acceleration sensors in an indoor experiment Future works - A more suitable arrangement of IMES transmitters and antennae to avoid IMES signal multipath - Automated calibration of the IMES signal power in the arrangement of IMES transmitters for indoor seamless positioning SHIBAURA INSTITUTE OF TECHNOLOGY NAKAGAWA Masafumi : mnaka@shibaura-it. ac. jp