Professional Documents
Culture Documents
B4 Main
B4 Main
CHAPTER 1
INTRODUCTION TO PROJECT
1.1 INTRODUCTION
As for current scenario stepping out of your home have been a difficult
task so, the one who have to surveillance the condition outside or to enjoy the view of
any place is difficult not only that but also those who cannot travel to a place faces
problem to see that place. To solve this problem, we have designed a robot which can
travel wherever you want and can give a virtual view of the place where you want to
surveillance. The robot can move around the place and give a virtual experience of the
particular area by only letting you on a single place, it is not only convenient but also
an innovative way of experiencing the world.
The robot uses its camera to give output to your device by an IP address that
mobile runs the video of the camera captured at the same time by placing it in the VR
headset gives a virtual experience, additionally with the gesture sensor present on the
headset can control the movement of the camera to change viewing angles
automatically, and we can also control the movement of robot by using a remote
control to travel from one place to another with the help of motors.
This setup will give you a virtual telepresence of anywhere in the world by
only sitting on a place. A telepresence robot is nothing but it is a remote-controlled,
fixed with wheeled device with a display which is used to enable the video streaming
that enables the participants to view remote locations, as if they were there in the
environment where the robot is placed. This project consists of a virtual reality
headset, with a smartphone in dual screen used to experience the virtual reality fixed
with 4 wheeled robotic vehicles.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING VR
Systems:
Telepresence robot:
Telepresence requires that the users' senses be provided with such stimuli as to
give the feeling of being in that other location. Additionally, users may be given the
ability to affect the remote location. In this case, the user's position, movements,
actions, voice, etc. may be sensed, transmitted and duplicated in the remote location
to bring about this effect. Therefore, information may be traveling in both directions
between the user and the remote location.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING VR
possible level of videotelephony. Telepresence via video deploys greater technical
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING VR
sophistication and improved fidelity of both sight and sound than in traditional
videoconferencing. Technical advancements in mobile collaboration have also
extended the capabilities of videoconferencing beyond the boardroom for use
with hand-held mobile devices, enabling collaboration independent of location.
Telepresence robots can be also considered for social interactions during pandemic
crisis such as COVID-19.
Burn injury is a major public health issue in developing countries, with most
injuries being largely associated with the use of kitchen stoves. This study details the
development of a cost-effective gesture and voice recognition controlled (GVC)
system to be used by individuals with disabilities to reduce the likelihood of burn
injury and improve their quality of life. The device replaces conventional dial controls
with voice and hand gesture recognition sensors and software which are designed to
be easily implemented into a household kitchen. Preliminary evaluation of the GVC
system's performance in gesture and voice recognition, gas leak detection and ignition
control International Journal of Research in Advent Technology, Vol.6, No.8, August
2018 E-ISSN: 2321-9637 Available online at www.ijrat.org 1961 tests were
conducted using a Bunsen burner as a stove top surrogate. The voice and gesture
recognition tests yielded sensitivities of 88% and 100%, respectively. These results
suggest that the GVC system may be a promising solution for burn injury prevention
pending further work to improve its reliability and robustness.
1.3.2 ENTERTAINMENT
1.3.3. Defence
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING VR
1.3.4 Mining
During surgery a nurse or doctor may not be able to touch a screen or track
pad that controls a system, for health and safety reasons, but with gesture control
technology, hand or finger movements can be used as a virtual mouse to control the
device. Despite the opinions on how technology advances are creating a lazy, inert
society, gesture control technology is not something we should be criticizing. It is part
of a new wave of electronic innovations which are improving aspects of life in terms
of efficiency, safety and education
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING VR
By using this system, we can replace all the other present available telepresence
devices that only gives an experience at some point. By using this provides a enhance
experience with more exploration capacity to observe more of any place, it provides
all control of the system to the best of our ability for the user
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING VR
CHAPTER 2
PROPOSED WORK
The model proposed deals with a virtual telepresence robot which is also
known as remote-controlled, wheeled device with a camera to enable video
conferencing. In this model the rover is controlled by hand gestures from a distant
place. This proposed robot gives us a realization of being present at place other than
their true location with the help of telepresence. This can be made possible by
combining virtual reality and IOT using Raspberry pi. In the recent years hand
gestures is getting so much attention as it makes interaction between humans and
robot easy. Gesture controlling is very helpful for International Journal of Research in
Advent Technology, handicapped and physically disabled people to achieve certain
tasks, such as driving a vehicle. Gestures can be used to control interactions for
entertainment purposes such as gaming to make the game player's experience more
interactive or immersive. the proposed model thegesture-controlled robot works on
the principle of accelerometer where the hand movements are recorded and then it
transfers the data x, y, z antilog values to the Arduino which converts analogy to
digital and hence the information is then transferred to an encoder which makes it
ready for RF transmission. Finally, by using RF pair the information can be
communicated wirelessly. On the receiving end, the information is received wirelessly
with the help of RF, which is then decoded by the decoder and then passed onto the
motor driver. Also, to make a robot move in a specific direction, various decisions are
made by the motor driver based on the received information which triggers the motors
in different configurations. The hand gesture controlling directions are given from the
visuals available on the phone from the Picam which is interfaced with the Raspberry
pi 3. Here the live video is streamed by using raspberry pi 3 which acts as host and
YouTube acting as server. Here in this method of live streaming the video is possible
from anywhere provided there is Internet. Another method for video streaming can be
done on VLC player in mobile which is transmitted through Wi-Fi module the range
for this only method is within Wi-Fi range.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING VR
2.2 LIMITATIONS
2.3 ADVANTAGES
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING VR
CHAPTER 3
PROJECT DISCRIPTION:
VR BOX
(Smart phone)
The robot unit consists of an ESP32 camera with RF receiver and two servo motors
and a 4channel transmitter and receiver connected to a motor driver with two gear
motor.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING VR
ESP32 4
RF CHANNEL
RECEIV
ARDUINO UNO
UART SERVO
SERVO
MOTO
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
telepresence robots. Virtual reality can be used in various sectors like agriculture,
education, medicine. A remote controlled, wheeled telepresence robot with a display
to enable video streaming allows the participants to view remote locations, as if they
were there. In this case the movement of the robot is controlled by a remote
controller. The main challenge of existing telepresence robots is to provide the user
the experience of exploring the remote areas in the natural way i.e., to control the
motions of the robot in the remote environment while walking in the local
environment. This major challenge can be overcome by using a walking approach.
Virtual reality with telepresence robots can be used to create virtually inclusive
classrooms that provide better educational opportunities for homebound students with
disabilities. A robotic arm can be controlled by Raspberry Pi using an application
built in the android platform using Wi-Fi protocol. A signal generated from the
android app will be received by the Raspberry Pi board and the robotic arm works
according to the predefined program. In most of the existing VR telepresence robots,
the motion of the robot is controlled by using conventional controllers like joysticks,
remote controllers etc. This prevents the user from getting an immersive and natural
experience. This problem is overcome in the proposed system by mapping the robot’s
motion with that of the user’s natural motion.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
https://ssrn.com/abstract=3791104 Arduino Mega. The robot movement is made to
correspond to the user movement using data transmitted via HC-05 Bluetooth module.
The User Section consists of the wearable VR headset holding an android smartphone
running the dual screen app. The Android phone displays the camera footage received
from the camera module of the Raspberry Pi. The user head movement data is sent
from the Wireless IMU app in the smartphone to the Raspberry Pi via Wi-Fi. The
User Section also comprises a smartphone installed with the dabble application. Step
count is taken by manipulating the phone sensor values. This “step data” is then
transmitted to the Arduino Mega of the Robot wirelessly via Bluetooth.
The workflow is described as follows: The first stage of the work focuses on
the Arduino based four wheeled robots. The board that will be used is an Arduino
coupled to 4 geared motors which power the wheels. The Bluetooth module will also
be connected to the Arduino board. First stage of testing would involve controlling the
robot using a basic Bluetooth enabled controller. Building the pedometer comes in the
second stage. The values obtained from the accelerometer contain unwanted noise
signals. It may badly affect the step counting. The accelerometer values are
continuously monitored for each user and finally a threshold value is determined and
was set in the program code. If a user takes a step and if the filtered accelerometer
values cross the threshold, then it is counted as a step and the robot moves
accordingly. Since the determination of threshold experiment is conducted in many
peoples, the advantage is that even the minor movements in the legs or hands will not
result in step counting. The rotation of the robot according to the user's motion is
controlled using the magnetometer values from the smartphone worn by the user. All
the computations are performed with respect to the Earth’s magnetic field. The robot
is coded in such a way that when it is powered on, it initially checks the user direction
and changes its direction accordingly. For example, when the robot is powered on,
assume the user is standing in the north-east direction while the robot is facing the
north direction. The robot detects a mismatch in direction and in order to correct it
turns to the right by 45 degrees. After matching the directions, it will continue to
move like the user. After every movement the robot direction is compared with the
user direction to check whether the user has turned right or left and if any mismatch is
found the robot corrects its direction accordingly. Once the pedometer is tested for
accurate step counting, it is then connected to the robot via Bluetooth and the code is
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
modified to act as the controller. Third stage involves integrating Virtual Reality
using a Raspberry Pi board to which the camera module is connected. The camera
module is rotated by a servo motor arrangement. A camera mount with two servo
motors to enable both pan and tilt movement is attached at the top of the robot that
resembles the user's head.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
CHAPTER 4
HARDWARE REQUIREMENT
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Syste Syste
Rapid Hardwar
Targeting
Memory space – memory is limited on embedded systems, and you must make
the software and the data fit into whatever memory exists. Program installation – you
will need special tools to get your software into embedded system. Power
consumption – portable systems must run on battery power, and the software in these
systems must conserve power. Processor hogs – computing that requires large amount
if CPU time can complicate the response problem. Cost – reducing the cost of the
hardware is a concern in many embedded system projects; software often operates on
hardware that is barely adequate for the job. Embedded systems have a
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
microprocessor/ microcontroller and a memory. Some have a serial port or a network
connection. They usually do not have keyboards, screens or disk drives.
4.1.4. Applications
4.1.7 Peripherals
Embedded Systems talk with the outside world via peripherals, such as:
The word "Uno" means "one" in Italian and was chosen to mark the initial
release of Arduino Software the Uno board is the first in a series of USB-based
Arduino boards; it and version 1.0 of the Arduino IDE were the reference versions of
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Arduino, which have now evolved to newer releases. The ATmega328 on the board
comes preprogramed with a boot loader that allows uploading new code to it without
the use of an external hardware programmer.
While the Uno communicates using the original STK500 protocol, it differs
from all preceding boards in that it does not use the FTDI USB-to-serial driver chip.
Instead, it uses the Atmega16U2 (Atmega8U2 up to version R2) programmed as
a USB-to-serial converter
LED: There is a built-in LED driven by digital pin 13. When the pin is high
value, the LED is on, when the pin is low, it is off.
VIN: The input voltage to the Arduino board when it is using an external power
source (as opposed to 5 volts from the USB connection or other regulated power
source). You can supply voltage through this pin, or, if supplying voltage via the
power jack, access it through this pin.
5V: This pin outputs a regulated 5V from the regulator on the board. The board
can be supplied with power either from the DC power jack (7 - 20V), the USB
connector (5V), or the VIN pin of the board (7-20V). Supplying voltage via the
5V or 3.3V pins bypasses the regulator, and can damage the board.
3V3: A 3.3-volt supply generated by the on-board regulator. Maximum current
draw is 50 mA.
GND: Ground pins.
IOREF: This pin on the Arduino board provides the voltage reference with which
the microcontroller operates. A properly configured shield can read the IOREF
pin voltage and select the appropriate power source, or enable voltage translators
on the outputs to work with the 5V or 3.3V.
Reset: Typically used to add a reset button to shields that block the one on the
board
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
ICSP Header: Yes
Power Sources: DC Power Jack & USB Port
Figure 4.3:Arduinonano
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Arduino Nano has a total of 36 pins. Out of these 8 are analogy input pins and
14 digital input/output pins (of which 6 can be used as PWM outputs). Nano has a 16
MHz SMD crystal resonator, a mini-USB-B port, an ICSP header, 3 RESET pins and,
a RESET button.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
SRAM: 2 KB
EEPROM: 1 KB
Clock speed: 16 MHz
Length: 45 mm
Width: 18 mm
Mass: 7 g
USB: Micropubs Type-B
ICSP Header: Yes
DC Power Jack: No
4.4 BATTERY:
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
requirements. Gel-cells and absorbed glass-mat batteries are common in these roles,
collectively known as VRLA (valve-regulated lead-acid) batteries.
Lead–acid battery sales account for 40–45% of the value from batteries sold
worldwide (1999, not including China and Russia), a manufacturing market value of
about US$15 billion.
constituent parts.
The battery's open-circuit voltage can also be used to gauge the state of
charge. If the connections to the individual cells are accessible, then the state of
charge of each cell can be determined which can provide a guide as to the state of
health of the battery as a whole.
The lead–acid cell can be demonstrated using sheet lead plates for the two
electrodes. However, such a construction produces only around one ampere for
roughly postcard-sized plates, and for only a few minutes.
The positive plates are the chocolate-brown colour of lead dioxide, and the
negative are the slate-Gray of "spongy" lead at the time of manufacture. In this
charged state the plates are called "formed".
One of the problems with the plates is that the plates increase in size as
the active material absorbs sulphate from the acid during discharge and decrease as
they give up the sulphate during charging. This causes the plates to gradually shed the
paste. It is important that there is room underneath the plates to catch this shed
material. If it reaches the plates, the cell short-circuits.
The alloying element has a great effect on the life and water consumption of
the batteries. Antimony-alloyed plates provide longer life but calcium-alloyed plates
are much preferred over antimony for their eight times lower water consumption.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
In the absorbed glass mat design, or AGM for short, the spacer between the
cells is replaced by a glass fibre mat soaked in electrolyte. There are only enough
electrolytes in the mat to keep it wet, and if the battery is punctured the electrolyte
will not flow out of the mats. Likewise, the mat greatly reduces evaporation, to the
point that the batteries do not require periodic refilling of the water. This combination
of features allows the battery to be completely sealed, which makes them useful in
portable devices and similar roles.
Another advantage to the AGM design is that the electrolyte becomes the
separator material, and mechanically strong. This allows the plate stack to be
compressed together in the battery shell, slightly increasing energy density compared
to liquid or gel versions. AGM batteries often show a characteristic "bulging" in their
shells when built in common rectangular shapes.
The mat also prevents the vertical motion of the electrolyte within the battery.
When a normal wet cell is stored in a discharged state, the heavier acid molecules
tend to settle to the bottom of the battery, causing the electrolyte to stratify. When the
battery is then used, the majority of the current flows only in this area, and the bottom
of the plates tend to wear out rapidly. This is one of the reasons a conventional car
battery can be ruined by leaving it stored for a long period and then used and
recharged. The mat significantly prevents this stratification, eliminating the need to
periodically shake the batteries, boil them, or run an "equalization charge" through
them to mix the electrolyte. Stratification also causes the upper layers of the battery to
become almost completely water, which can freeze in cold weather, AGMs are
significantly less susceptible to damage due to low-temperature use.
During the 1970s researchers developed the sealed version or "gel battery",
which mixes a silica gelling agent into the electrolyte (Silica gel-based lead Acid
batteries used in Portable Radios from early 1930s were not fully sealed). This
converts the formerly liquid interior of the cells into a semi-stiff paste, providing
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
many of the same advantages of the AGM. Such designs are even less susceptible to
evaporation and are often used in situations where little or no periodic maintenance is
possible. Gel cells also have lower freezing and higher boiling points than the liquid
electrolytes used in conventional wet cells and AGMs, which makes them suitable for
use in extreme conditions.
Wet cell stand-by (stationary) batteries designed for deep discharge are
commonly used in large backup power supplies for telephone and computer
centres, grid energy storage, and off-grid household electric power systems. [13] Lead–
acid batteries are used in emergency lighting and to power sump pumps in case
of power failure.
Traction (propulsion) batteries are used in golf carts and other battery electric
vehicles. Large lead–acid batteries are also used to power the motors in diesel-
electric (conventional) submarines when submerged, and are used as emergency
power on nuclear submarines as well. Valve-regulated lead acid batteries cannot spill
their electrolyte. They are used in back-up power supplies for alarm and smaller
computer systems (particularly in uninterruptible power supplies ("UPS")) and
for electric scooters, electric wheelchairs, electrified bicycles, marine applications,
battery electric vehicles or micro hybrid vehicles, and motorcycles.
Lead–acid batteries were used to supply the filament (heater) voltage, with 2
V common in early vacuum tube (valve) radio receivers.
Portable batteries for miners' cap lamps headlamps typically have two or three cells.
Lead-acid batteries designed for starting automotive engines are not designed
for deep discharge. They have a large number of thin plates designed for maximum
surface area, and therefore maximum current output, but which can easily be damaged
by deep discharge. Repeated deep discharges will result in capacity loss and
ultimately in premature failure, as the electrodes disintegrate due to mechanical
stresses that arise from cycling. Starting batteries kept on continuous float charge will
have corrosion in the electrodes which will result in premature failure. Starting
batteries should be kept open circuit but charged regularly (at least once every two
weeks) to prevent sulphating.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Starting batteries are lighter weight than deep cycle batteries of the same
battery dimensions, because the cell plates do not extend all the way to the bottom of
the battery case. This allows loose disintegrated lead to fall off the plates and collect
under the cells, to prolong the service life of the battery. If this loose debris rises high
enough it can touch the plates and lead to failure of a cell, resulting in loss of battery
voltage and capacity.
The capacity of a lead–acid battery is not a fixed quantity but varies according
to how quickly it is discharged. An empirical relationship between discharge rate and
capacity is known as Peaker’s law.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
In a valve regulated lead acid battery (VRLA) the hydrogen and oxygen
produced in the cells largely recombine into water. Leakage is minimal, although
some electrolyte still escapes if the recombination cannot keep up with gas evolution.
Since VRLA batteries do not require (and make impossible) regular checking of the
electrolyte level, they have been called maintenance free batteries. However, this is
somewhat of a misnomer. VRLA cells do require maintenance. As electrolyte is lost,
VRLA cells "dry-out" and lose capacity. This can be detected by taking regular
internal resistance, conductance or impedance measurements. Regular testing reveals
whether more involved testing and maintenance is required. Recent maintenance
procedures have been developed allowing "rehydration", often restoring significant
amounts of lost capacity.
VRLA types became popular on motorcycles around 1983, because the acid
electrolyte is absorbed into the separator, so it cannot spill. The separator also helps
them better withstand vibration. They are also popular in stationary applications such
as telecommunications sites, due to their small footprint and installation flexibility.
Lead–acid batteries lose the ability to accept a charge when discharged for too
long due to sulphating, the crystallization of lead sulphate. They generate electricity
through a double sulphate chemical reaction. Lead and lead dioxide, the active
materials on the battery's plates, react with sulphuric acid in the electrolyte to
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
form lead sulphate. The lead sulphate first forms in a finely divided, amorphous state,
and easily reverts to lead, lead dioxide and sulphuric acid when the battery recharges.
As batteries cycle through numerous discharges and charges, some lead sulphate is
not recombined into electrolyte and slowly converts to a stable crystalline form that
no longer dissolves on recharging. Thus, not all the lead is returned to the battery
plates and the amount of usable active material necessary for electricity generation
declines over time.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Batteries which have sat unused for long periods of time can be prime
candidates for DE sulphation. A long period of self-discharge allows the sulphate
crystals to form and become very large. Some typical cases where lead acid batteries
are not used frequently enough are planes, boats (esp. sail boats), old cars, and home
power systems with battery banks that are underutilized.
SLI batteries (starting, lighting, ignition; i.e., car batteries) suffer most
deterioration because vehicles normally stand unused for relatively long periods of
time. Deep cycle and motive power batteries are subjected to regular controlled
overcharging, hence eventually succumb to corrosion of the positive plate grids, not to
sulphating.
Extreme weather can also cause sulphating in batteries. Extreme heat in the
summer increases the number of sulphates that come from batteries. Electronic
components putting a constant drain on a battery also increase the amount of
sulphating. Keeping a battery in a cool location and keeping it charged help prevent
this.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Accumulated hydrogen and oxygen sometimes ignite in an internal explosion.
The force can burst the plastic casing or blow the top off the battery, spraying acid
and casing fragments. An explosion in one cell may ignite the combustible gas
mixture in remaining cells. In a poorly ventilated area, connecting or disconnecting a
closed circuit (such as a load or an operating charger) directly to the battery terminals
may cause an explosion as the sparks produced ignite the gas mixtures vented from
the cells.
The cell walls of VRLA batteries typically swell when the internal pressure
rises. The deformation varies from cell to cell, and is greater at the ends where the
walls are unsupported by other cells. Such over-pressurized batteries should be
carefully isolated and discarded. Personnel working near batteries at risk for explosion
should protect their eyes and exposed skin from burns due to spraying acid and fire by
wearing a face shield, overalls, and gloves. Using goggles instead of a face
shield sacrifices safety by leaving one's face exposed to acid and heat from a potential
explosion.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Lead–acid battery recycling is one of the most successful recycling programs
in the world. In the United States 99% of all battery lead was recycled between 2009
and 2013. An effective pollution control system is a necessity to prevent lead
emission. Continuous improvement in battery recycling plants and furnace designs is
required to keep pace with emission standards for lead smelters.
Chemical additives have been used ever since the lead-acid battery became a
commercial item, to reduce lead sulphate build up on plates and improve battery
condition when added to the electrolyte of a vented lead–acid battery. Such treatments
are rarely, if ever, effective.
Two compounds used for such purposes are Epsom salts and EDTA. Epsom
salts reduces the internal resistance in a weak or damaged battery and may allow a
small amount of extended life. EDTA can be used to dissolve the sulphate deposits of
heavily discharged plates. However, the dissolved material is then no longer available
to participate in the normal charge/discharge cycle, so a battery temporarily revived
with EDTA will have a reduced life expectancy. Residual EDTA in the lead–acid cell
forms organic acids which will accelerate corrosion of the lead plates and internal
connectors.
Corrosion of the external metal parts of the lead–acid battery results from a
chemical reaction of the battery terminals, lugs and connectors.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
If the battery is over-filled with water and electrolyte, thermal expansion can
force some of the liquid out of the battery vents onto the top of the battery. This
solution can then react with the lead and other metals in the battery connector and
cause corrosion.
Ammonia can neutralize spilled battery acid. Surplus ammonia and water
evaporate, leaving an ammoniumsulphate residue. Sodium bicarbonate (baking soda)
is also commonly used for this purpose.
4.5 ESP32-CAM:
The ESP32-CAM is a very small camera module with the ESP32-S chip that
costs approximately $10. Besides the OV2640 camera, and several GPIOs to connect
peripherals, it also features a micro-SD card slot that can be useful to store images
taken with the camera or to store files to serve to clients.
The ESP-32CAM doesn’t come with a USB connector, so you need an FTDI
programmer to upload code through the U0R and U0T pins (serial pins).
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
4.5.1 Features:
During the chip’s system reset release (power-on-reset, RTC watchdog reset
and brownout reset), the latches of the strapping pins sample the voltage level
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
as strapping bits of ”0” or ”1”, and hold these bits until the chip is powered
down or shut down. The strapping bits configure the device’s boot mode, the
operating voltage of VDD_SDIO and other initial system settings. Each
strapping pin is connected to its internal pull-up/pull-down during the chip
reset. Consequently, if a strapping pin is unconnected or the connected
external circuit is high-impedance, the internal weak pull-up/pull-down will
determine the default input level of the strapping pins. To change the strapping
bit values, users can apply the external pull-down/pull-up resistances, or use
the host MCU’s GPIOs to control the voltage level of these pins when
powering on ESP32.
The following figure shows the ESP32-CAM pin out (AI-Thinker module).
There are three GND pins and two pins for power: either 3.3V or 5V.
GPIO 1 and GPIO 3 are the serial pins. You need these pins to upload code to your
board. Additionally, GPIO 0 also plays an important role, since it determines whether
the ESP32 is in flashing mode or not. When GPIO 0 is connected to , the ESP32 is in
flashing mode.
The following pins are internally connected to the microSD card reader:
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
GPIO 15: CMD
GPIO 2: Data 0
GPIO 4: Data 1 (also connected to the on-board LED)
GPIO 12: Data 2
GPIO 13: Data 3
Follow the next steps to build a video streaming web server with the ESP32-
CAM that you can access on your local network.
In this example, we use Arduino IDE to program the ESP32-CAM board. So, you
need to have Arduino IDE installed as well as the ESP32 add-on. Follow one of the
next tutorials to install the ESP32 add-on, if you haven’t already:
In your Arduino IDE, go to File > Examples > ESP32 > Camera and open the Camera
WebServer example.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Before uploading the code, you need to insert your network credentials in the
following variables:
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Many FTDI programmers have a jumper that allows you to select 3.3V or 5V. Make
sure the jumper is in the right place to select 5V.
4.6 MPU6050:
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
3 Serial Clock Used for providing clock pulse for I2C Communication
(SCL)
8 Interrupt (INT) Interrupt pin to indicate that data is available for MCU
to read.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Configurable IIC Address
In-built Temperature sensor
Once you have added this library to you Arduino IDE, follow the below
schematics to establish an IIC connection between your Arduino and MPU6050.
The library provides two example programs, which can be found at File ->
Examples -> MPU6050. In these two examples one will give raw values while the
other will give optimized values using the DMP. The following data values can be
obtained using this example program. Out of all these data, the Yaw, Pitch, roll us
commonly used.. Once the program is uploaded, open serial monitors and set it to
115200 baud rate and you should see the data being printed on the screen.
Applications
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
4.7 DC Motor:
Every DC motor has six basic parts -- axle, rotor (a.k.a., armature), stator,
commutate, field magnet(s), and brushes. In most common DC motors (and all that
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Beamers will see), the external magnetic field is produced by high-strength permanent
magnets. The stator is the stationary part of the motor -- this includes the motor
casing, as well as two or more permanent magnet pole pieces. The rotor (together with
the axle and attached commutate) rotates with respect to the stator. The rotor consists
of windings (generally on a core), the windings being electrically connected to the
commutator. The above diagram shows a common motor layout -- with the rotor
inside the stator (field) magnets.
The geometry of the brushes, commutator contacts, and rotor windings are
such that when power is applied, the polarities of the energized winding and the stator
magnet(s) are misaligned, and the rotor will rotate until it is almost aligned with the
stator's field magnets. As the rotor reaches alignment, the brushes move to the next
commutator contacts, and energize the next winding. Given our example two-pole
motor, the rotation reverses the direction of current through the rotor winding, leading
to a "flip" of the rotor's magnetic field, driving it to continue rotating.
In real life, though, DC motors will always have more than two poles (three is
a very common number). In particular, this avoids "dead spots" in the commutator.
You can imagine how with our example two-pole motor, if the rotor is exactly at the
middle of its rotation (perfectly aligned with the field magnets), it will get "stuck"
there. Meanwhile, with a two-pole motor, there is a moment where the commutator
shorts out the power supply (i.e., both brushes touch both commutator contacts
simultaneously). This would be bad for the power supply, waste energy, and damage
motor components as well. Yet another disadvantage of such a simple motor is that it
would exhibit a high amount of torque "ripple" (the amount of torque it could produce
is cyclic with the position of the rotor).
The use of an iron core armature (as in the Mabuchi, above) is quite common,
and has a number of advantages. First off, the iron core provides a strong, rigid
support for the windings -- a particularly important consideration for high-torque
motors. The core also conducts heat away from the rotor windings, allowing the
motor to be driven harder than might otherwise be the case. Iron core construction is
also relatively inexpensive compared with other construction types.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
But iron core construction also has several disadvantages. The iron armature has a
relatively high inertia which limits motor acceleration. This construction also results
in high winding inductances which limits brush and commutator life.
In small motors, an alternative design is often used which features a 'coreless'
armature winding. This design depends upon the coil wire itself for structural
integrity. As a result, the armature is hollow, and the permanent magnet can be
mounted inside the rotor coil. Coreless DC motors have much lower armature
inductance than iron-core motors of comparable size, extending brush and
commutator life.
4.8 RF MODULE:
Radio frequency (RF) is a frequency or rate of oscillation within the range of
about 3 Hz to 300 GHz. This range corresponds to frequency of alternating current
electrical signals used to produce and detect radio waves. Since most of this range is
beyond the vibration rate that most mechanical systems can respond to, RF usually
refers to oscillations in electrical circuits or electromagnetic radiation
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
4.8.1 PROPERTIES OF RF:
Electrical currents that oscillate at RF have special properties not shared by
direct current signals. One such property is the ease with which it can ionize air to
create a conductive path through air. This property is exploited by 'high frequency'
units used in electric arc welding. Another special property is an electromagnetic
force that drives the RF current to the surface of conductors, known as the skin effect.
Another property is the ability to appear to flow through paths that contain insulating
material, like the dielectric insulator of a capacitor. The degree of effect of these
properties depends on the frequency of the signals.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Shortwave, amateur radio, citizens' band
radio Very high frequency (VHF) 30 to 300
MHz 1 m to 10 m
FM broadcasting broadcast television, aviation, GPR
Ultra-high frequency ( UHF) 300 to 3000 MHz
10 cm to 100 cm
Broadcast television, mobile telephones, cordless telephones, wireless networking,
remote keyless entry for automobiles, microwave ovens, GPR.
Super high frequency ( SHF) 3 to 30 GHz
1 cm to 10 cm
Wireless networking, satellite links, microwave links, Satellite television, door
openers.
Extremely high frequency (EHF) 30 to 300 GHz
1 mm to 10 mm
Microwave data links, radio astronomy, remote sensing, advanced weapons systems,
advanced security scanning
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
the EM wavelengths measure approximately one millimetre (1 mm). As the frequency
is increased beyond that of the RF spectrum, EM energy takes the form of infrared
(IR), visible, ultraviolet (UV), X rays, and gamma rays.
Many types of wireless devices make use of RF fields. Cordless and cellular
telephone, radio and television broadcast stations, satellite communications systems,
and two-way radio services all operate in the RF spectrum. Some wireless devices
operate at IR or visible-light frequencies, whose electromagnetic wavelengths are
shorter than those of RF fields. Examples include most television-set remote-control
boxes some cordless computer keyboards and mice, and a few wireless hi-fi stereo
headsets.
The RF spectrum is divided into several ranges, or bands. With the exception
of the lowest-frequency segment, each band represents an increase of frequency
corresponding to an order of magnitude (power of 10). The table depicts the eight
bands in the RF spectrum, showing frequency and bandwidth ranges. The SHF and
EHF bands are often referred to as the microwave spectrum.
4.8.4 RF Advantages:
1. No line of sight is needed.
2. Not blocked by common materials: It can penetrate most solids and pass-
through walls.
3. Longer range.
4. It is not sensitive to the light;
5. It is not much sensitive to the environmental changes and weather conditions.
6. Highly portable – ideal for tour groups.
7. Easy to install/low installation cost.
8. Can cover large seating areas.
9. Several channels available for multiple systems installed in adjacent rooms as
well as for language translation and audio description for the blind.
10. Suitable for indoors and outdoors.
4.8.5 RF Disadvantages:
1. Interference: communication devices using similar frequencies - wireless phones,
scanners, wrist radios and personal locators can interfere with transmission
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
2. Lack of security: easier to "eavesdrop" on transmissions since signals are spread
out in space rather than confined to a wire
3. Higher cost than infrared
4. Federal Communications Commission (FCC) licenses required for some products
5. Lower speed: data rate transmission is lower than wired and infrared transmission
4.8.6 WHAT ARE THE MAIN REQUIREMENTS FOR THE
COMMUNICATION USING RF?
RF Transmitter
RF Receiver
Encoder and Decoder
4.8.7 RF Transmitter:
Figure4.20: RF transmitter
The STT-433 is ideal for remote control applications where low cost and
longer range is required.
The transmitter operates from a1.5-12V supply, making it ideal for battery-
powered applications.
The transmitter employs a SAW-stabilized oscillator, ensuring accurate
frequency control for best range performance.
The manufacturing-friendly SIP style package and low-cost make the STT-
433 suitable for high volume applications.
4.8.8 Features:
433.92 MHz Frequency
Low Cost
1.5-12V operation
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Small size
4.8.9 PIN DESCRIPTION:
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Heat sink for better performance
Power-On LED indicator
78M05 Voltage regulator will be enabled only when the jumper is placed. When
the power supply is less than or equal to 12V, then the internal circuitry will be
powered by the voltage regulator and the 5V pin can be used as an output pin to power
the microcontroller. The jumper should not be placed when the power supply is greater
than 12V and separate 5V should be given through 5V terminal to power the internal
circuitry.
ENA & ENB pins are speed control pins for Motor A and Motor B while IN1&
IN2 and IN3 & IN4 are direction control pins for Motor A and Motor B.
4.10.2 Features:
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Gear Type: Plastic
Rotation: 0°-180°
Weight of motor: 9gm
Package includes gear horns and screws
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
4.10.5 How to use a Servo Motor
After selecting the right Servo motor for the project, comes the question how
to use it. As we know there are three wires coming out of this motor. The description
of the same is given on top of this page. To make this motor rotate, we have to power
the motor with +5V using the Red and Brown wire and send PWM signals to the
Orange colour wire. Hence, we need something that could generate PWM signals to
make this motor work, this something could be anything like a 555 Timer or other
Microcontroller platforms like Arduino, PIC, ARM or even a microprocessor like
Raspberry Pie. Now, how to control the direction of the motor? To understand that let
us a look at the picture given in the datasheet.
From the picture we can understand that the PWM signal produced should
have a frequency of 50Hz that is the PWM period should be 20ms. Out of which the
On-Time can vary from 1ms to 2ms. So when the on-time is 1ms the motor will be in
0° and when 1.5ms the motor will be 90°, similarly when it is 2ms it will be 180°. So,
by varying the on-time from 1ms to 2ms the motor can be controlled from 0° to 180°
4.10.6 Applications:
Used as actuators in many robots like Biped Robot, Hexapod, robotic arm etc.
Commonly used for steering system in RC toys
Robots where position control is required without feedback
Less weight hence used in multi DOF robots like humanoid robot.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
CHAPTER 5
SOFTWARE REQUIREMENT
• Arduino software
• Proteus software
The X Game Station Small Edition was designed victimization PCB layout tools and
Proteus schematic entry.
ISIS Schematic Capture - a tool for getting into styles. PROSPICE Mixed
Mode SPICE Simulation – business normal SPICE3F5 machine combined with a
digital machine.
ARES PCB Layout – PCB style system with automatic part alluvial sediment, rip-up
and rehear auto-router and interactive style rule checking.
VSM – Virtual System Modelling lets co-simulate embedded computer code for
well-liked micro-controllers aboard hardware style.
System edges Integrated package with common interface and absolutely context
sensitive facilitate.
The PROTEUS product vary conjointly includes our revolutionary VSM technology
to perform the system desired task.
Product Features:
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
• ARES – layout designing in this tool
ISIS lies right at the guts of the PROTUES system and is way over simply another
schematic package. it's powerful setting to regulate most aspects of the drawing look.
whether or not your demand is that the speedy entry of complicated style for simulation
& PCB layout, Or the creation of engaging Schematic for publication ISIS is that the
right tool for the work Product.
Features:
• Full support for buses as well as sub- circuit ports and bus pins
Proteus VSM is associate degree extension of the PROSPICE machine that facilities
co-simulation of microchip primarily based style as well as all the associated
physical science. what is more, you'll move with the microcontroller computer code
through the employment of animated keypads, switches, buttons, LEDs, lamps and
even alphanumeric display displays.
Features:
•CPU models offered for several well-liked microcontrollers as well as PIC, AVR,
HC11 and Arduino.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
• Interactive device models embody semiconductor diode and alphanumeric
display displays, RS232 terminal, universal input device and a spread of switches,
buttons, pots.
• Source level debugging for elect development tools as well as IAR C-SPY and
• Includes support for 24-bit and 32-bit IEEE floating purpose and 32-bit long
information sorts
• Compatible - integrates into the MPLAB IDE, MPLAB ICD and most 3rd-
party development tools.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
substitution usually won’t to inscribe common short sequences of directions to run
inline rather than in an exceedingly subprogram.
speed:
Space:
Thanks to its simple and accessible user experience, Arduino has been used in
thousands of different projects and applications. The Arduino software is easy-to-use
for beginners, yet flexible enough for advanced users. It runs on Mac, Windows, and
Linux. Teachers and students use it to build low, cost scientific instruments, to prove
chemistry and physics principles, or to get started with programming and robotics.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
5.1.9 How to Download the Arduino Software (IDE):
Get the latest version from the download page. You can choose between the
Installer (.exe) and the Zip packages. We suggest you use the first one that installs
directly everything you need to use the Arduino Software (IDE), including the
drivers. With the Zip package you need to install the drivers manually.
When the Arduino Software (IDE) is properly installed you can go back to the
Getting Started Home and choose your board from the list on the right of the page.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
The Arduino Integrated Development Environment (IDE) is a cross-platform
application (for Windows, macOS, Linux) that is written in the programming
language Java. It is used to write and upload programs to Arduino compatible
boards, but also, with the help of 3rd party cores, other vendor development boards.
The source code for the IDE is released under the GNU General Public License,
version 2. The Arduino IDE supports the languages C and C++ using special rules of
code structuring. The Arduino IDE supplies a software library from the Wiring
project, which provides many common input and output procedures.
● Menu Bar
● Text Editor
● Output Pane
The bar appearing on the top is called Menu Bar that comes with five different
options as follows.
You can open a new window for writing the code or open an existing one.
Following table shows the number of further subdivisions the file option is
categorized into. Creating file descriptors. As you go to the preference section and
check the compilation section, the Output Pane will show the code compilation as
you click the upload button.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
As you go to the preference section and check the compilation section, the Output
Pane will show the code compilation as you click the upload button And at the end of
compilation, it will show you the hex file it has generated for the recent sketch that
will send to the Arduino Board for the specific task you aim to achieve.
Used for copying and pasting the code with further modification for font
Mainly used for testing projects. The Programmer section in this panel is
used for burning a boot loader to the new microcontroller.
In case you are feeling skeptical about software, complete help is available
from getting started to troubleshooting.
The Six Buttons appearing under the Menu tab are connected with the running
program as follows.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
• The check mark appearing in the circular button is used to verify the code. Click
this once you have written your code.
• The arrow key will upload and transfer the required code to the Arduino board.
• The button appearing on the top right corner is a Serial Monitor – A separate
pop-up window that acts as an independent terminal and plays a vital role for
sending and receiving the Serial Data.
\
Figure5.8 Connecting to board
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
The main screen below the Menu board is known as a simple text editor used for
writing the registrations.
The bottom of the main screen is described as an Output Pane that mainly highlights
the compilation status of the running code: the memory used by the code, and errors
occurred in the program. You need to fix those errors before you intend to upload
the hex file into your Arduino Module.
Fig.5.10 Outputwindow
More or less, Arduino C language works similar to the regular C language used for
any embedded system microcontroller, however, there are some dedicated libraries
used for calling and executing specific functions on the board.
5.1.17 Libraries:
Libraries are very useful for adding the extra functionality into the Arduino Module.
There is a list of libraries you can add by clicking the Sketch button in the menu bar
and going to Include Library. The Arduino environment can be extended through the
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
use of libraries, just like most programming platforms. Libraries provide extra
functionality for use in sketches, e.g., working with hardware or manipulating data.
To use a library in a sketch, select it from Sketch > Import Library.
A number of libraries come installed with the IDE, but you can also download or
create your own. See these instructions for details on installing libraries. There's also
a tutorial on writing your own libraries. See the API Style Guide for information on
making a good Arduino-style API for your library
As you click the Include Library and Add the respective library it will on the top
of the sketch with a #include sign. Suppose, I Include the EEPROM library, it will
appear on the text editor.
The digital Read and digital Write commands are used for addressing and
making the Arduino pins as an input and output respectively.
These commands are text sensitive i.e., you need to write them down the exact way
they are given like digital Write starting with small “d” and write with capital “W”.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Writing it down with Digital write or digital write won’t be calling or addressing any
function.
On the online IDE we are able to automatically detect the kind of board and
the port it is connected to without you having to individually select them. In, order to
upload sketch, you need to select the relevant board you are using and the ports for
that operating system.
As you click the Tools on the Menu it will open like the figure below. You'll need to
select the entry in the Tools > Board menu that corresponds to your Arduino board.
Select, the serial device of the board from the Tools | Serial Port menu. This is likely
to be COM3 or higher (COM1 and COM2 are usually reserved for hardware serial
ports). To find out, you can disconnect your board and re-open the menu; the entry
that disappears should be the Arduino board. Reconnect the board and select that
serial port.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Just go to the “Board” section and select the board you aim to work on. Similarly,
COM1, COM2, COM4, COM5, COM7 higher are reserved for the serial and USB
board. You can look for the USB serial device in the port section of the Windows
Device Manager.
Following figure shows the COM4 that I have used for my project, indicating the
Arduino Uno with COM4 port at the bottom right corner of the screen.
Fig.5.13: Example
● After correct selection of both Board and Serial Port, click the verify and then
upload button appearing in the upper left corner of the six-button section or you can
go to the Sketch section and press verify/compile and then upload.
● The sketch is written in the text editor and is then saved with the file extension
It is important to note that the recent Arduino Modules will reset automatically as
you compile and press the upload button the IDE software, however, older version
may require the physical reset on the board.
● Once you upload the code, TX and RX LEDs will blink on the board, indicating
the desired program is running successfully.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
Note: The port selection criteria mentioned above is dedicated for Windows
operating system only, you can check this Guide if you are using a MAC or Linux.
The amazing thing about this software is that no prior arrangement or bulk of mess
is required to install this software, you will be writing your first program within 2
minutes after the installation of the IDE environment.
The X Game Station Small Edition was designed victimization PCB layout tools
and Proteus schematic entry.
ARES PCB Layout – PCB style system with automatic part alluvial sediment, rip-
up and rehear auto-router and interactive style rule checking.
VSM – Virtual System Modelling lets co-simulate embedded computer code for
well-liked micro-controllers aboard hardware style.
System edges integrated package with common interface and absolutely context
sensitive facilitate.
Product Features:
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
• ARES – layout designing in this tool
ISIS lies right at the guts of the PROTUES system and is way over simply another
schematic package. it's powerful setting to regulate most aspects of the drawing look.
Whether or not your demand is that the speedy entry of complicated style for
simulation & PCB layout, Or the creation of engaging Schematic for publication ISIS
is that the right tool for the work Product
Features:
• Full support for buses as well as sub- circuit ports and bus pins
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
VSM (Virtual System Modeling):
Proteus VSM is associate degree extension of the PROSPICE machine that facilities
co-simulation of microchip primarily based style as well as all the associated
physical science. what is more, you'll move with the microcontroller computer code
through the employment of animated keypads, switches, buttons, LEDs, lamps and
even alphanumeric display displays.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
CHAPTER-6
PROJECT RESULTS
6.1Working:
Here is this project we successfully executed the output and the whole procedure is
working as per the results. The results of the project are shown below.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
CHAPTER 7
The work has scope in different applications like for office purposes,
industries, education, driver less automobiles, hospitals. Further the camera
movement can be with respect to the head movement of the operator by which again
the telepresence feel will be improve.
7.3 Limitations
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
7.4 Advantages
It can be used as instead of travelling any where
It takes less time to react on user gesture
It provides full overall control to the user
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
REFERENCES
[1] Elizabeth Cha, Samantha Chen, and Maja J Matric, “Designing Telepresence
Robots for K12 Education””,2017, 26th IEEE International Symposium on Robot and
Human Interactive Communication (RO-MAN) Lisbon, Portugal, Aug 28 - Sept 1,
2017
[2] K. M. Tsui and H. A. Yanko, “Design Challenges and Guidelines for Social
Interaction Using Mobile Telepresence Robots”, Reviews of Human Factors and
Ergonomics, 9(1):227–301, 2013. International Journal of Research in Advent
Technology, Vol.6, No.8, August 2018 E-ISSN: 2321-9637 Available online at
www.ijrat.org 1965
[3] Xiao, Y., J. Yuan, and D. Thalmann, “HumanVirtual Human Interaction by
Upper Body Gesture Understanding”, In Proceedings ofthe 19th Acm Symposium on
Virtual Reality Software and Technology”,2013, ACM: Singapore.
[4] Keng Peng Tee, Rui Yan, Yuanwei Chua, Zhiyong Huang, Somchaya
Liemhetcharat, “Gesture-Based Attention Direction for A Telepresence Robot:
Design And Experimental Study”, 2014 IEEE/RSJ International Conference on
Intelligent Robots and Systems (IROS 2014), September 14- 18, 2014, Chicago, IL,
USA.
[5] J. Imai T. Suwannathat and M. Kaneko, “OmniDirectional Audiovisual Speaker
Detection for Mobile Robot”, in Proc. IEEE Int. Conf. Robot and Human Interactive
Communication, 2007.
[6] Adalgeirsson, Sigurdur O. “MeBot: A robotic platform for socially embodied
telepresence” S.M. Thesis, Massachusetts Institute of Technology, School of
Architecture and Planning, Program in Media Arts and Sciences, 2009.
[7] D. Barber, “MANTRAN: A Symbolic Language for Supervisory Control of an
Intelligent Manipulator”, 1967, J. H. Black, Factorial Study of Remote Manipulation
with Transmission Delay, 1970.
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
APPENDIX
TRANSMITTER-
#include <SPI.h>
#include "RF24.h"
#include "Wire.h"
#include "I2Cdev.h"
#include "MPU6050.h"
MPU6050 mpu;
int16_t ax, ay, az;
int16_t gx, gy, gz;
int data [2];
RF24 radio(9,10);
const uint64_t pipe = 0xE8E8F0F0E1LL;
void setup(){
Wire.begin();
mpu.initialize();
Serial.begin(9600);
radio.begin();
radio.openWritingPipe(pipe);
}
void loop(){
mpu.getMotion6(&ax, &ay, &az, &gx, &gy, &gz);
data[0] = map(ax, 10, 17000, 2,178);
data[1] = map(ay, 10, 17000, 2,178);
radio.write(data,sizeof(data));
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
{
Serial.println(data[0]);
Serial.println(data[1]);
}
}
RECEIVER-
#include <Servo.h>
#include <SPI.h>
#include "RF24.h"
Servo Servo_motor_x,Servo_motor_y;
RF24 radio(9,10);
const uint64_t pipe = 0xE8E8F0F0E1LL;
int data[2];
void setup()
{
Serial.begin(9600);
Servo_motor_x.attach(5);
Servo_motor_y.attach(6);
radio.begin();
radio.openReadingPipe(1,pipe);
radio.startListening();
}
void loop()
{
if (radio.available())
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
{
bool done = false;
while (!done){
done = exit;
radio.read(data, sizeof(data));
Servo_motor_x.write (data[0]);
Servo_motor_y.write (data[1]);
}
{
Serial.println(data[0]);
Serial.println(data[1]);
}
}}
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
CAMERA ESP32-
#include "esp_camera.h"
#include <WiFi.h>
//
// WARNING!!! PSRAM IC required for UXGA resolution
and high JPEG quality
// Ensure ESP32 Wrover Module or other board with
PSRAM is selected
// Partial images will be transmitted if image exceeds
buffer size
//
#include "camera_pins.h"
void startCameraServer();
void setup() {
Serial.begin(115200);
Serial.setDebugOutput(true);
Serial.println();
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
camera_config_t config;
config.ledc_channel = LEDC_CHANNEL_0;
config.ledc_timer = LEDC_TIMER_0;
config.pin_d0 = Y2_GPIO_NUM;
config.pin_d1 = Y3_GPIO_NUM;
config.pin_d2 = Y4_GPIO_NUM;
config.pin_d3 = Y5_GPIO_NUM;
config.pin_d4 = Y6_GPIO_NUM;
config.pin_d5 = Y7_GPIO_NUM;
config.pin_d6 = Y8_GPIO_NUM;
config.pin_d7 = Y9_GPIO_NUM;
config.pin_xclk = XCLK_GPIO_NUM;
config.pin_pclk = PCLK_GPIO_NUM;
config.pin_vsync = VSYNC_GPIO_NUM;
config.pin_href = HREF_GPIO_NUM;
config.pin_sscb_sda = SIOD_GPIO_NUM;
config.pin_sscb_scl = SIOC_GPIO_NUM;
config.pin_pwdn = PWDN_GPIO_NUM;
config.pin_reset = RESET_GPIO_NUM;
config.xclk_freq_hz = 20000000;
config.pixel_format = PIXFORMAT_JPEG;
#if defined(CAMERA_MODEL_ESP_EYE)
pinMode(13, INPUT_PULLUP);
pinMode(14, INPUT_PULLUP);
#endif
// camera init
esp_err_t err = esp_camera_init(&config);
MIST- Page
VIRTUAL TELEPRESENCE ROBOT USING
if (err != ESP_OK) {
Serial.printf("Camera init failed with error 0x%x", err);
return;
}
sensor_t * s = esp_camera_sensor_get();
// initial sensors are flipped vertically and colors are a bit
saturated
if (s->id.PID == OV3660_PID) {
s->set_vflip(s, 1); // flip it back
s->set_brightness(s, 1); // up the brightness just a bit
s->set_saturation(s, -2); // lower the saturation
}
// drop down frame size for higher initial frame rate
s->set_framesize(s, FRAMESIZE_QVGA);
#if defined(CAMERA_MODEL_M5STACK_WIDE) ||
defined(CAMERA_MODEL_M5STACK_ESP32CAM)
s->set_vflip(s, 1);
s->set_hmirror(s, 1);
#endif
WiFi.begin(ssid, password);
startCameraServer();
void loop() {
// put your main code here, to run repeatedly:
delay(10000);
}
MIST- Page