SHANTILAL SHAH ENGINEERING COLLEGE

Human Computer Interaction Based

Hardware Control Using Image
Processing
Guided By :

Prof. Devang G. Jani

Prepared By :

Amit H. Huda
(110430111005)
Sanjaysinh P. Gohil(110430111006)

Definition : Human Computer Interaction Based

Hardware Control Using Image Processing.
Why this Definition ?
New era of Digital World.
What is Our Purpose ?
Control System with Human Gestures.
To make System more Intutive.

 Why Gestures ?
What is Gestures ?
The motion of the body intended to
communicate with other agents.
How We use Gestures ?
We are using Markers.
Detect Markers with Image Processing.
Configure Detection With Command.

 Requirements.

Software

Matlab

Image Processing tool.

Arduino-1.0.3

Hardware
Atmega32
Geared

Motor's

Web-Camera

Relay's

Adapter/Battery

(Power
Supply)

Software Description:

MATLAB

What is MATLAB?

MATLAB=Matrix Laboratory

MATLAB is a high-level language and interactive environment that enables you to perform computationally
intensive tasks faster than with traditional programming languages such as C,C++ and FORTRAN.

MATLAB is an interactive, interpreted language that is designed for fast numerical matrix calculations. MATLAB
is a high performance language for technical computing. It integrates computation, visualization, and programming
in an easy-to use environment where problems and solutions are expressed in familiar mathematical notation.

APPLICATIONS OF MATLAB

Math and computation.

Algorithm development.

Modeling, simulation.

Data analysis, exploration ,and visualization.

Scientific and engineering graphics.

Application development, including Graphical User Interface building.

IMAGE PROCESSING

Definition:- Image processing is study of any algorithm that takes an image as input and returns an image as
output.

Image Processing Levels:Computer Vision:

Object detection, recognition, shapeanalysis, tracking Use of Artificial

Intelligence and
Image Analysis:

Segmentation, Image registration, Matching.

Image

Processing:
Noise removal, restoration , feature detection , compression.

Applications of Image Processing

BIOLOGICAL: :automated systems for an analysis of samples.

DEFENSE/INTELLIGENCE: enhancement and interpretation of images to find and track targets.
DOCUMENT PROCESSING: scanning, archiving, transmission.

MATERIALS

TESTING: detection and quantification of cracks, impurities, etc.

MEDICAL: disease detection and monitoring, therapy/surgery planning.

HARDWARE DESCRIPTION
Arduino Due milanoveAtmega32:

The Arduino Due milanove("2009" ) is a microcontroller board based on the ATmega328. It has 14 digital
input/output pins (of which 6 can be used as PWM outputs), 6 analog inputs, a 16 MHz crystal oscillator, a USB
connection, a power jack, an ICS header, and are set button.

It contain severy thing needed to support the microcontroller; simply connect it to a computer with a USB cable
or power it with a AC-to-DC adapter or battery to get started.

DC Motor's

A DC Motor relies on the fact that like magnet poles repel and unlike magnetic poles attract each
other.

A coil of wire with current running through it generates an electromagnetic field aligned with the
center of the coil.

Motor having 4 elements in the circuit commonly known as corners: high side left, high side right,
low side right ,and low side left .By using combination we are able to start, stop and reverse the
current.

Fig. DC Motor

Fig1. Cross Sectional View of DC Motor

Web camera

Here we used 12 mega pixel web camera to detect the particular object.

Relay's

A relay is an electrically operated switch. Current flowing through the coil of there creates a magnetic
field which attracts a leverand changes the switch contacts. The coil current can be on or off so relays
have two switch positions and they are double throw (changeover) switches

Fig:-Block Diagram of the System

 Block Diagram

 Working
1.System starts and camera start to capturing
photo or video.
2.Program run on images and gets axis point
(x,y) and height and width of object.
3.Process Continue till condition for output
not satisfied.
4.As Condition for output Satisfied, Matlab
gives the output Value to controller.
5.controller gives input to the out put Device
and it will work Continue.

 Problems
1. Complexity of Programming Increase with Increase in
gesture movements and Hand Markers.
2. Other object with the same properties as Hand Markers
increase in Error.
3. Detecting Hand Markers in different situations like
with less light, shadow , more than enough light
4. To Use System have to wear Hand markers all Time

 Possible Solution
1. Other Objects can handle by using Proper Threshold value
for near as well as for far Objects.
Threshold value
2. different situation can handle by High Resolution Camera
or Compatible Environment and by using proper
Threshold value Algorithm.
3. Wearing Markers can be solved by using different gesture
or finger Combination.

 Advantages
1.Portable.
2.Cost Effective.
3.Data access directly from the machines
in real time.

 Applications

1.Switching of Household appliances

2.Industrial automated equipment carriers
3.Automated Cars
4.Security Systems based on Face Recognition.
5. Only the authorized user and administrator can access the application.
6.In an Industrial Area where the worker cant handle the harmful equipments.
7.To identify the unknown object.

 Reference
1. Matlab(Image Processing)
2. Sixth Sense Device
3. www.mathworks.com

Thank You