SIXTHSENSE COMPUTING Kyle Rafferty Biomedical Engineering University of

SIXTHSENSE COMPUTING Kyle Rafferty Biomedical Engineering University of Rhode Island

Sixth. Sense Overview � Developed by Pranav Mistry � Research � � assistant/Ph. D candidate MIT Portable device that is worn around neck Consists of: � Camera � Colored Markers � Projector � *a smart phone

Components � � Camera: tracks the movement of the colored markers using movement algorithms. Colored Markers: Red, blue, green, and yellow tape worn on the users fingertips for tracking purposes. Projector: Projects stored data onto most any surface. Smart phone: needed for internet connection and computing power

Capabilities � � Recognizes hand movements Examples from online demonstrations: � Make frame with hands: camera takes picture � Google map onto wall � Draw circle on wrist: projects digital clock � Movement of text book/web info onto page � Airline ticket updates � Draw @ symbol: check email for you � Many more capabilities (it’s on youtube or TED website)

Pictures

Benefits � Cost: ~300$ � Software � will be open source Many possible medical applications using the technology � Surgical procedures (using tracking capabilities) � Rehabilitation techniques

Sources/Publications � � � � � Sources: “About (Pranav Mistry)” pranav: : mistry. 2010. Apr 1 2010. http: //www. pranavmistry. com/ Mistry, Pranav. “About (Sixth. Sense)”. 2010. Apr 2, 2010. http: //www. pranavmistry. com/projects/sixthsense/ “Pranav Mistry’s: The Thrilling Potential of Sixth. Sense Computing-Future of Interface”. Boxesandarrows. Feb 2010. Apr 1 2010. http: //www. boxesandarrows. com/idea/view/51321 Publications: P. Mistry, P. Maes. Sixth. Sense – A Wearable Gestural Interface. To be appeared in SIGGRAPH Asia 2009, Sketch. Yokohama, Japan. 2009 P. Mistry, P. Maes. Sixth. Sense – A Wearable Gestural Interface. To be appeared in SIGGRAPH Asia 2009, Emerging Technologies. Yokohama, Japan. 2009 P. Mistry. The thrilling potential of Sixth. Sense technology. TEDIndia 2009. Mysore, India 2009 P. Mistry, P. Maes, L. Chang. WUW - Wear Ur World - A Wearable Gestural Interface. In the CHI '09 extended abstracts on Human factors in computing systems. Boston, USA. 2009