Android Phone and Arduino controlled Twoarm Pen CSE

Android Phone and Arduino controlled Two-arm Pen CSE 3461 Course Project Example (Project Setup and Mid-term Reporting) Group members: Shengkai Wang, and Dong Xuan Acknowledgement: Cheng Zhang and Yunqi Zhang March 3, 2020 1

Outline ❒ Project Setup ❒ Mid-term Reporting ❒ Final Presentation 2

Two Major Components ❒ Networking component: Android phone and Arduino communicate through USB ❒ Application component: human detection at Android phone and pen writing control at Arduino 3

Working Scenario Camera Frames Tensorflow Lite Visual Input Bob Is Bob? USB Serial Input Bob 4

Working Timeline ❒ Project Setup: Jan. 19 to Feb. 15, 4 weeks ❍ Topic Due: Feb. 6 ❍ Topic Presentation: Feb. 13 ❒ Project Development: Feb. 16 to March 28, 6 weeks ❒ Week 1 -3: ❍ Android phone and Arduino USB communication ❍ Android phone based human detection using tensor flow ❒ Week 4: 2 -Arm pen design and development ❒ Week 5: Integration and testing ❒ Week 6: Writing report ❒ Buffer time: March 29 to April 4 5

Outline ❒ Project Setup ❒ Mid-term Reporting ❒ Final Presentation 6

Completed Tasks ❒Android phone and Arduino USB communication ❍ Phone can send a simple message to Arduino via USB, informing a human presence ❒Android phone based human detection using tensor flow ❒ tensor flow has run on phone which is able to detect multiple objects including human, sofa and bench etc. 7

Difficulties ❒Android phone and Arduino USB communication ❍ Encoding and decoding messages ❍ Delayed response from Arduino ❍ Debugging ❒Android phone based human detection using tensor flow ❍ Limited computing power 8

Demo 9

Updated Working Timeline ❒ Project Setup: Jan. 19 to Feb. 15, 4 weeks ❍ Topic Due: Feb. 6 ❍ Topic Presentation: Feb. 13 ❒ Project Development: Feb. 16 to March 28, 6 weeks ❒ Week 1 -3: ❍ Android phone and Arduino USB communication (done) ❍ Android phone based human detection using tensor flow (done) ❒ Week 4: 2 -Arm pen design and development ❒ Week 5: Integration and testing ❒ Week 6: Writing report ❒ Buffer time: March 29 to April 4 10