Sixth Sense Technology

~ Wear Ur World

By:

Anitesh John Saunders

08BTCSE004
objects ~ gestures
How can we leverage our knowledge
about everyday objects and how we
objects ~
use them tohow
digital world ?
we use them
our interaction with the
 Introduction
 A wearable, gestural interface that augments the
physical world around us with the digital information.

 Integrates the digital information into the physical world

and its objects, making the entire world your computer.

 Developed by Pranav Mistry, a PhD student in the

Fluid Interfaces Group at the MIT Media Lab.
 Bridges the gap between
the tangible
and the intangible world.

 It is a technology which
aims at causing computers and
other machines to adapt to
human needs.

 The current prototype costs

around $350.
 Genesis
 The first gesture interface device was created by
attaching some strings and pulleys to the rollers of
a scroll mouse.
 Another exploration was aimed
at helping the designers and
architects to imagine and draw
objects in 3- dimensions.

 The device was a pen that

could draw in 3- dimensions.
 Another big thing
was a “Physical
Google Map” which
supplies information
about the OBJECTS
placed on it.
 Human mind is interested in dynamic
information, rather than in computing.

 The next phase was to go the other

way round, to paint the real world with
the digital information

 The key idea behind it was to free the

pixels from the confines of digital
devices.

 Thus evolved the “Head-Mounted”

Projector.
 Components
 Wearable Camera
Captures an object in view, tracks the user’s
hand gestures and sends the data to the smart
phone.

 Mirror
The downward facing projector projects the image
on the mirror which reflects it on the desired
surface.

 Projector
Enables surfaces, walls and
physical objects to be used as
Interfaces and displays data sent from smart
phone on any surface in view.
  Smart Phone
o An internet enabled smart phone is
necessary to process the data.
o As the smart phone is the open source, a
program to process the data need to be
developed.
o The software searches the web and
interprets the hand gestures.

 Color Markers
o They are at the tips of the user’s
Fingers & help the camera to recognize the
hand gestures.
o The movements and arrangements of
these markers are interpreted and they act
as instructions for the projected
application interfaces.
Working
 Related Technologies
1. Augmented Reality: No more a Science Fiction

It is a term for a live direct or indirect view of a physical real world

environment whose elements are augmented by virtual computer
generated imagery.
2. Gesture Recognition

It is a topic in computer
science and language
technology with the goal of
interpreting human gestures
via., mathematical
algorithms.
3. Computer Vision
It is the science and
technology of machines
that “see”. It is
concerned with the
theory behind artificial
systems that extract
information from
images.
It is also used in
autonomous vehicle like
SUV’s.
4. RFID

Radio Frequency
Identification is basically
an electronic tagging
technology that allows
the detection, tracking of
tags and consequently the
objects that they are
affixed to.
 Applications
 Getting Information About products.

 Receiving LIVE NEWS stream on the

newspaper

 Receiving updated weather information on

the newspaper itself

 Playing games on a piece of paper

  Use your wrist as a touch interface

 Click images by hand gestures

 Display information about people

 Get flight details on the boarding pass itself

 The Way Forward
 Mouse less
 Playing with paper
 Why only computers, we can play with
papers.

 We can take a part of a document

putting
over another paper and we can even
modify the paper and print it.

So the work flow is more intuitive.

 In a more dynamic way you can pinch

the information on the paper to your
system.
 Third Eye
 Multiple viewers can see different
things on a same display screen at the
same time.

 A public sign board can display

information in different languages at
the same time.

 We need not have the split screen in

games now.

 A public display can show secret

messages or patterns.

 In the same movie theatre, people

can see different end of a suspense
movie.
 Advantages
 Portable

Support multi touch and multi user interaction

Cost effective

Connection between real world and digital world

Data access directly from the machines in real time

Mind map the idea anywhere

Open source software

 Limitations
 Requires high speed internet which is
costly for general use.

 Post processing can occur however.

 There exists hardware limitations of the

devices.
 Future Enhancements
To get rid of color markers.

 To incorporate camera and projector inside mobile computing devices.

 Whenever we place pendant- style wearable device on table, it should

allow us to use the table as a multi-touch user interface.

Applying this technology in various interest like gaming , education

systems etc.,

 To have 3-dimensional gesture tracking.

 To make sixth sense work as a fifth sense for the disabled person.
 Conclusion
 Imagination is the only limit for such technologies.

 It is a sense that would give seamless and easy access to the Meta
information.

 We can have our digital world with us wherever we go and we can

start using any surface around us as an interface.

 Actually ,the hardware is not that hard to manufacture. The open

source software is going to be made available.

So the technology can reach masses than staying to laboratories or

environments.