Our Data Ourselves HackDay Giles Greenway Tobias Blanke

Our Data, Ourselves Hack-Day Giles Greenway Tobias Blanke Jenifer Pybus Mark Cote Department of Digital Humanities

The Project: • • • What and how much data do smartphone apps collect? What can it say about us and how is it used? What do we think about this? Can we put it to better use? ~20 Young Rewired State coders issued with Android 'phones. Custom Mobile. Miner app reports on app usage. Sends data to a modified CKAN instance. CKAN is written in Python, based on the Pylons framework. Released by the Open Knowledge Foundation: http: //ckan. org/

The Data: Mobile. Miner App: http: //kingsbsd. github. io/Mobile. Miner . • • Poll /proc/<pid>/net/<tcp/udp> Look for sockets/ports. Count transmitted/received bytes. GSM cell ids. Mobile and wireless networks. App notifications. Periodically save data to an internal SQLite database that users can access. • Upload data to a CKAN instance.

GSM Cell Tower Locations: http: //opencellid. org • Full GPS is too invasive, and consumes power. • Avoid use of Google location API. • Open. Cell. Id provides locations of (many) cell towers. • Currently include UK database within the app. ● Next: Bridge Mobile. Miner to cell DB via CKAN API?

CKAN:

Processing The Data: • Aggregate app usage per user per day. • Cluster GSM cells by k-means using Sci. Kit. Learn Python library • Label clusters using Open. Street. Maps. • Gather app data by scraping the Play Store. (Beautiful. Soup, Phantom. JS & Selenium )

Docker: https: //www. docker. com/ • • • Docker Linux Containers: Dockerfile->Image->Container Installs CKAN, packages, libraries. Link to containers for Postgress and Solr. Create users and database tables. Provide access to the data via Ipython Notebooks. Provide tools like Numpy, Sci. Kit. Learn and NLTK. Allows users to experiment. Documents the software environment. Allows for easy deployment. Free public image hosting.

Questions: • • Can we link app usage to physical locations? Can we make use of cells whose locations are unknown? Can we cluster on a spatial AND temporal basis? Do apps with certain permissions use more data?

The Line!

Getting an. apk package: http: //apps. evozi. com/apk-downloader/

Fighting Back? • Grab the app's. apk package file from a rooted phone? • Decompress the package and examine Android. Manifest. xml. • Decompile the app and examine the source code.

Fighting back: Decompressing the. apk: http: //code. google. com/p/android-apktool/ apktool d com. onetouchgame. The. Line. apk

Android. Manifest. xml <receiver android: enabled="true" android: name="com. simplecreator. app. Remote. Notification. Receiver"> <intent-filter> <action android: name="cn. jpush. android. intent. REGISTRATION"/> <action android: name="cn. jpush. android. intent. UNREGISTRATION"/> <action android: name="cn. jpush. android. intent. MESSAGE_RECEIVED"/> <action android: name="cn. jpush. android. intent. NOTIFICATION_OPENED"/> <action android: name="cn. jpush. android. intent. ACTION_RICHPUSH_CALLBACK"/> <category android: name="com. onetouchgame. The. Line"/> </intent-filter> </receiver> <service android: name="com. umeng. update. net. Downloading. Service" android: process=": Downloading. Service"/> <activity android: name="com. umeng. update. Update. Dialog. Activity" android: theme="@android: style/Theme. Translucent. No. Title. Bar"/> • The app receives intents from the push notification service jpush. cn. There is a mobile analytics service. • Is that why it had open sockets on port 3000?

Fighting Back: Decompile the App http: //code. google. com/p/dex 2 jar/ dex 2 jar. sh com. onetouchgame. The. Line Decompile the. jar file:

Fighting Back: “The Usual Suspects” Look for Phone. State. Listeners and Location. Listeners: if (param. Location != null) { d 1 = param. Location. get. Latitude(); d 2 = param. Location. get. Longitude(); boolean bool 1 = d 1 < 29. 999998211860657 D; Classes provided by tencent. com (a mobile ad service) reference latitutude and longitude. Classes provided by jpush. cn and umeng. com also reference Location. Listeners.

Download our app: Follow us on Twitter: @Kings. BSD Read our blog: Slideshare: http: //www. slideshare. net/kings. BSD/