GESTURE BASED ROBOTIC

VEHICLE USING SIXTH SENSE

TECHNOLOGY

NAME OF STUDENT: VASU JAIN

ROLL NO. : 1609131176

Department Of Electronics & Communication

Engineering
JSS Academy of Technical Education, Noida
CONTENT:

• Introduction
• Components
• Functional Flowchart
• Working
• Conclusion
• Reference
 INTRODUCTION
 The way of interaction between human and robot has been
developing using various technologies.
 Controlling the robotic vehicle using gestures is a
predominant way of enhancing the interaction.
 The robotic vehicle is directed by identifying the real time
gesture commands from the user.
COMPONENTS REQUIRED:

• Camera
• Color Markers
• Projector
• Arduino
• MATLAB
• Zigbee
FUNCTIONAL FLOWCHART
 WORKING
A. Video From Webcam:
The user wears colored tapes to provide input gestures to the system. The inbuilt
webcam of the computer is used as a sensor to detect the hand movements of the
user. It captures the real time video at a fixed frame rate and resolution which is
determined by the hardware of the camera.

B. Color Detection:
Color plays an important role in image processing. Each image is composed of an
array of M*N pixels with M rows and N columns of pixels. Each pixel contains a
certain value for red, green and blue. Based on the threshold values RGB colors
can be differentiated . In color detection process the required color can be detected
from an image.
C. Gesture Recognition:
Gesture recognition can be seen as a way for computers to begin to understand
human body language, thus building a richer bridge between machines and humans
than primitive text user interfaces or even GUIs (Graphical User Interface). Gesture
recognition enables humans to interface with the robot and interact naturally without
any mechanical devices. In gesture recognition based on the color detected and its
position it is interpreted into gestures . Based on the corresponding gesture, robotic
movement is done.

D. Arduino And Zigbee:

In order to control the robotic vehicle according to the input gestures given by the
user arduino uno board is used . Serial communication between arduino and matlab is
established wirelessly through zigbee
 CONCLUSION :

The gesture controlled robot system gives an alternative way of controlling robots. It
makes the user to control smart environment by hand gesture interface.
This gesture recognition technique demonstrates the use of MATLAB image processing
tools . Since this technique makes use of gesture as input transmitted through zigbee, it
improves the operating range of robot.
It eliminates the use of external hardware supports like remote control in navigation of
robot in different direction and reduces the human efforts in risky environments.
REFERENCE :

• [1] Mukti Yadav, Mrinal Yadav and Hemant Sapra , “MATLAB based Gesture Controlled
Robot”, Journal of Basic and Applied Engineering Research ,Vol3, Issue 2; January-
March, 2016.
• [2] AdityaPurkayastha, Akhil Devi Prasad, Arunav Bora, Akshaykumar Gupta, Pankaj
Singh, “Hand Gestures Controlled Robotic Arm”, Journal of International Academic
Research For Multidisciplinary, Vol2, Issue-4, May 2014.
• [3] Paper Submitted by K.Dhinesh, G.Mahalakshmi, S.Sheeba, K.Mohanapriya
THANK YOU