SixthSense Technology

• Developed by Pranav Mistry

(Research assistant/PhD candidate MIT)
• Portable device that is worn around neck

• SixthSense is a wearable gestural interface that augments the

physical world around us with digital information and lets us use
natural hand gestures to interact with that information.
 Components
• Camera: tracks the movement of the colored markers using
movement algorithms.
• Colored Markers: Red, blue, green, and yellow tape worn on
the users fingertips for tracking purposes.
• Projector: Projects stored data onto most any surface.
• Smart phone: needed for internet connection and computing
power
 Working
• The SixthSense prototype is comprised of a pocket projector, a mirror
and a camera. The hardware components are coupled in a pendant
like mobile wearable device. Both the projector and the camera are
connected to the mobile computing device in the user’s pocket.
• The projector projects visual information enabling surfaces, walls and
physical objects around us to be used as interfaces; while the camera
recognizes and tracks user's hand gestures and physical objects using
computer-vision based techniques.
• The software program processes the video stream data captured by the
camera and tracks the locations of the coloured markers (visual tracking
fiducials) at the tip of the user’s fingers using simple computer-vision
techniques.
• The movements and arrangements of these fiducials are interpreted into
gestures that act as interaction instructions for the projected application
interfaces.
• The maximum number of tracked fingers is only constrained by the
number of unique fiducials, thus SixthSense also supports multi-touch
and multi-user interaction.
 Capabilities
• Recognizes hand movements
• Make frame with hands: camera takes picture

• The SixthSense system implements a gestural camera that

takes photos of the scene the user is looking at by detecting
the ‘framing’ gesture. The user can stop by any surface or wall
and flick through the photos he/she has taken.   
Google map onto wall
projects
digital clock
Movement of text book/web
info onto page
Airline ticket updates
Sixth sense phone
Gaming
A.V. news on newspaper
 Benefits
• Cost: ~350$
• Many possible medical applications using the technology
• Surgical procedures (using tracking capabilities)
• Time saving
• Decreases e-waste
• Multi-Tasking device
• Easily Portable
• User Friendly
 Conclusion
“Pranav Mistry’s major focus behind this
invention is to use less of the digital world and
stay more and more connected to our physical
world.”
 Sources

• “About (Pranav Mistry)” pranav::mistry. 2010. Apr 1 2010.

http://www.pranavmistry.com/
• Mistry, Pranav. “About (SixthSense)”. 2010. Apr 2, 2010.
http://www.pranavmistry.com/projects/sixthsense/
• “Pranav Mistry’s: The Thrilling Potential of SixthSense Computing-
Future of Interface”. Boxesandarrows. Feb 2010. Apr 1 2010.
http://www.boxesandarrows.com/idea/view/51321
Presented By –Dhruvin Bhalani
Harsh Desai
1st Year MBA-Tech
(Mechanical)