Sang

You might also like

Download as docx, pdf, or txt
Download as docx, pdf, or txt
You are on page 1of 31

ML and IoT Embedded System Design and Development

Chapter1
Introduction

Indian Tech Keys is an Indian startup that provides services like;


Printed Circuit Board(PCBs) design and fabrication, 3-D printing
services, Embedded product development, industry interaction
programs, hands-on sessions or workshops, E-store supply and
innovation labs. It is headquartered in Baiyappanahalli extension
road, near swami vivekananda road metro, Bengaluru, Karnataka
560038. It was started in the year 2016 and is growing till date. There
are two major departments or wings in the company: R&D(Research
and Development) in the field of industrial automation and smart city
products and also has Service Sector (SS) in which the team is
involved in providing the technical support for small scale industries
along with educational institutions and different universities in
Karnataka.

HISTORY:
Indian Tech Keys is the brainchild of R.V.C.E, Bangalore alumni which
came up with an intention to make the students dear to technology. They
take students on a one-to one strategy and students will be disclosed to
various technologies used in the real time apart from syllabus. It will
help them bring up their hidden passion and decide their career. Hands
on practice technique what the team uses, will develop more interest
among converted into practical modules by following some innovative
steps. Hence they started with PCB designing, Embedded system
training, Embedded programming and robotics training. Through their
well structured sessions, workshops and other practical sessions, they
help students to understand current leading technology which will help
students to implement their innovative ideas. Their sessions are planned
to help students open-up their mind and begin to look at engineering in a
much broader perspective. Over a period of time, the company has
started to provide technical support to the industry

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

Chapter 2
OBJECTIVE OF INTERNSHIP

Indian Tech Keys mainly focuses on providing hands-on experience to


students of graduation and post-graduation cadre. The company’s
motive is to bridge the gap between student community and current
technologies by conducting workshops on recent technological
advancements like that of PCB, ARM, Arduino, Robotics, Copters and
Android tools. The training offered to interns here mainly focuses on the
R&D(Research and Development) side of the product design taken up
by the company. The training offered by Indian Tech Keys during
internship takes place on 2 different levels. In the first level of training,
the facilitators take you through the basics of product design and
fundamentals of Research and Development(R&D). The second level
being the implementation of the basics to club all the modules and work
on a project to convert it into a product. One-to-one session is organized
to understand the level of training imparted on each trainee. On
successful understanding of the concepts the interns undergo the next
level of training. Indian Tech Keys ensures that suitable trainers as per
their technical qualification train the interns. This ensures that the
interns are technically sound to handle the projects offered efficiently.
The R&D department concentrates on training interns in both hardware
and software. The hardware being the micro-controllers, sensors,
actuators, communication modules like DTMF, bluetooth etc. The
software including Arduino, Keil u-vision etc.

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

Chapter 3

SCHEDULE WEEK WISE

Week
DATE TOPICS
number

Segment 1.1: Introduction about internship

Segment 1.2: Introduction about embedded system


13/08/2023
Week 1 To Segment 1.3: Basics of embedded system
18/08/2023
Segment 1.4: introduction to embedded python

Segment 1.5: Creating basic programs

Segment 2.1: About Aurdino board

Segment 2.2: Types of Aurdino


20/08/2023
Week 2 To Segment 2.3: Introduction of sensors
25/08/2023
Segment 2.4: Types of sensors

Segment 2.5: Implementation of sensors in real life

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

Segment 3.1: Implementation of sensors in Arduino


board

28/08/2023 Segment 3.2: coding the Arduino.cc


To
Week 3 01/09/2023 Segment 3.3: connecting components to Aurdino board

Segment 3.4: Introduction to sensors

Segment 3.5: implementation of sensors

Segment 4.1: Introduction on motors

Segment 4.2: Implementation of motor with Arduino


04/09/2023
Segment4.3: Implementation of both sensors and motors
To
Week 4 Segment4.4: Over view of all the topics
09/09/2023
Segment4.5: Discussion about the projects

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

Segment 5.1: Assigning of projects

Segment 5.2: Selection of project


11/09/2023
To Segment 5.3: Researching of IEEE papers
16/09/2023
Week 5
Segment 5.4: Implementation of project in

software Segment 5.5: Working on project

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

CHAPTER 4
INTRODUCTION TO VOICE AND GESTURE CONTROLLED
ROBOT USING ARDUINO NANO

Introduction

The Voice and Gesture Controlled Robot Project represents an exciting


fusion of cutting-edge technologies and human-machine interaction. By
integrating Arduino-based hardware and a custom Android application
developed using MIT App Inventor, this project aims to create a
dynamic robotic system that responds intuitively to voice commands
and hand gestures. This fusion of hardware and software offers a
seamless, interactive experience that empowers users to control a mobile
robot effortlessly and opens the door to a wide range of practical
applications capabilities of Arduino microcontrollers, we can translate
user inputs into meaningful actions for the robot. Voice recognition
technology enables the robot to interpret spoken instructions, while
gesture recognition sensors allow it to respond to specific hand
movements. These features make the robot an adaptable and user-
friendly tool, as it can be customized to perform a wide array of tasks
based on user preferences and needs. Additionally, the development of a
dedicated Android application using MIT App Inventor serves as the
bridge between the user and the robot. This app provides a user-friendly
interface through which commands are transmitted wirelessly to the
robot via Bluetooth or Wi-Fi connectivity. This user interface is
designed to be intuitive and straightforward, ensuring that users of all
ages and backgrounds can effortlessly control the robot's movements
and actions. In summary, the Voice and Gesture Controlled Robot
Project represents an exciting fusion of technology and human
interaction, showcasing the potential for innovative solutions in robotics
and automation. This project offers a glimpse into the future of user-
friendly, interactive robotics and provides a platform for exploration and
creativity in the field of human-robot interaction.

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

Chapter 5
METHODOLOGY

Creating a gesture and voice-controlled robot with Arduino Nano involves


several steps:

1. Hardware Setup:

- Connect Arduino Nano to motor driver modules for controlling motors.

- Attach sensors like accelerometers or gyroscope for gesture recognition.

- Integrate a microphone for voice input.

2. Gesture Recognition:

- Program the Arduino to read data from the accelerometer or gyroscope.

- Implement algorithms to recognize specific gestures.

- Map gestures to corresponding robot movements or actions.

3. Voice Recognition:

- Use a suitable microphone module and connect it to Arduino.

- Integrate a voice recognition module or program to interpret voice


commands.

- Define actions corresponding to recognized voice commands.

4. Motor Control:

- Write code to control motors based on gesture and voice inputs.

- Utilize motor driver modules to drive the robot in different directions.

5. Bluetooth Communication (Optional):

- Implement Bluetooth communication if you want to control the robot


remotely.

- Connect a Bluetooth module to Arduino for wireless communication.

6. Testing and Refinement:

- Test the robot with different gestures and voice commands.

- Refine the code and adjust sensor thresholds for better performance.

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

7.Power Supply:
- Choose an appropriate power supply for the Arduino and motors.

- Ensure the power supply can sustain the robot's operation

8.Safety Measures:
- Implement safety features to avoid collisions or other hazards.

- Include emergency stop mechanisms if necessary.

9.Documentation:

- Document your hardware connections and code for future reference.

- Include comments in your code for clarity.

Optimization:

- Optimize the code for efficiency, considering the limited resources of


Arduino Nano.

5.1 BLOCK DIAGRAM

Block Diagram of our proposed system is given below:

7. Fig 5.1 Block Diagram of Gesture and Voice controlled robot

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

WORKING PRINCIPLE

A gesture and voice-controlled robot operates based on sensors and recognition


technology. Gesture control involves interpreting hand or body movements using
cameras or other sensors, while voice control utilizes speech recognition. These
inputs are processed by a microcontroller or a computer onboard the robot,
enabling it to execute commands corresponding to recognized gestures or voice
commands. The key components include sensors for gesture and voice
recognition, a processing unit, and actuators for movement or other actions. The
robot responds to user gestures or commands by translating them into specific
actions through the integrated control system.

A.voice controlled:

The android smart phone's microphone is used to recognise human


voices. Using the Android operating system and Artificial Intelligence
software, this voice is processed and transformed into English words.
Speech recognition is a multidisciplinary subfield of computational
linguistics that explores approaches and technology that allow
computers to recognise and convert spoken language into text.
Automatic speech recognition (ASR), computer voice recognition,
and speech to text are some of the other names for it (STT). It blends
languages, computer science, and electrical engineering expertise and
study. Speech recognition has a long history in terms of technology,
with multiple waves of key advancements. Advances in deep learning
and big data have recently improved the field. The improvements are
proven not only by the increasing number of academic articles
published in the subject, but also by the widespread industry
acceptance of a range of deep learning approaches in the design and
deployment of voice recognition systems around the world.
B.Gesture controlled:

A gesture-controlled robot using Arduino typically involves sensors,


such as accelerometers or gyroscopes, to detect hand movements.
Arduino processes the sensor data and translates it into specific
commands for the robot's motors. For instance, if the sensor detects a

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

forward motion gesture, the Arduino sends signals to move the robot
forward. This interaction relies on programming logic and sensor
calibration to accurately interpret gestures and control the robot
accordingly.
Gesture controlled robot moves according to hand movement as we
place transmitter in our hand. When we tilt hand in front side, robot
start to moving forward and continues moving forward until next
command is given. When we tilt hand in backward side, robot change
its state and start moving in backwards direction until other command
is given. When we tilt it in left side Robot get turn left till next
command. When we tilt hand in right side robot turned to right. And
for stopping robot we keeps hand in stable.

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

CHAPTER 6

HARDWARE COMPONENTS

HARDWARE REQUIREMENTS

• Arduino Nano
• Motor driver
• DC Motors
• Jumper wires and breadboard
• Robot wheels

6.1 ARDUINO NANO

Arduino is a Microcontroller Development Board with ATmega328p


Microcontroller works on 16 MHz, which helps to make the projects
work. this was invented for the nontechnical persons who want to
make their small and basic projects with the help of technology. even
Artists can also make art with the Arduino. it is like a brain that helps
to automate simple Arduino projects. like if I want to make a 3d artist
and I want to make the automatic movement in the art then I can do it
with it and a stepper or servo motor.

Various types of Arduino are:

▪ Arduino Uno

▪ Arduino Mega

▪ Arduino Nano

▪ Arduino Pico

▪ Arduino Due (84) MHz

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

Fig6.1ArduinoUNO

Hardware Specification

Arduino is an open-source development board with an Atmega328p


microcontroller chip. which also can be programmed by the Keil
Micro-Vision software The required minimum voltage is 5v. having
14 Digital GPIO pins and 6 analoge pins. 5v and 3.3v power pins
with 3 ground pins onboard. Another SMD microcontroller inbuilt for
boot the Arduino main chip. there is also two voltage regulator one is
for 5v and another is for 3.3v. for SPI protocol there is MISO, MOSI,
SCK, and SS pin which is pin 12, pin 11, pin 13 and pin 10
respectively. forI2C protocol there are SCL and SDA pins above the
pin 13 & V ref. and you can also Interface the device with the serial
communication by the pin Rx & Tx Which are given at pin 1 and pin
2.

1. Microcontroller: At the heart of the Arduino Uno is the ATmega328P


microcontroller. This microcontroller contains a central processing
unit (CPU), memory (both Flash memory for storing the program and
SRAM for variables), input/output pins, timers, analog-to-digital
converters (ADCs), and other peripherals.

2. Input/Output (I/O) Pins: The Arduino Uno features a set of digital and

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

analog I/O pins that can be used to interface with external


components such as sensors, actuators, LEDs, displays, and more.
These pins can be configured as either inputs or outputs in software.

3. Power Supply: The Arduino Uno can be powered via a USB


connection, an external DC power jack, or through Vin pin. It
regulates the input voltage to 5V and provides power to the
microcontroller and connected components.

4. USB Interface: The USB interface allows communication between the


Arduino Uno and a computer for programming and serial
communication. It also provides power to the board when connected
to a computer.

5. Integrated Development Environment (IDE): Arduino Uno


programming is done using the Arduino IDE, a user-friendly software
environment that simplifies code development, compilation, and
uploading to the board. The IDE uses a simplified version of C/C++
language, making it accessible Beginners and experienced developers
alike.

6. Sketches: Arduino programs are referred to as sketches. A sketch


consists of two main functions: setup and loop. The setup function
runs once when the Arduino board is powered on or reset and is
typically used for initialization tasks. The loop function runs
continuously after setup completes and is where the main program
logic resides.

7. Libraries: The Arduino community has developed a vast collection of


libraries that provide pre- written code for interfacing with various
sensors, actuators, communication protocols, and other hardware
peripherals. These libraries simplify programming tasks and
accelerate project development.

8. Serial Communication: Arduino Uno supports serial communication


via USB or hardware UART (Universal Asynchronous
Receiver/Transmitter). This allows the Arduino to communicate with
other devices such as computers, sensors, or other microcontrollers.

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

By leveraging these components and principles, users can program the


Arduino Uno to perform a wide range of tasks, from simple blinking
LED projects to complex IoT applications and robotics projects. Its
versatility, ease of use, and extensive community support make the
Arduino Uno a popular choice for hobbyists, educators, and
professionals alike.

6.2MOTOR DRIVER

A motor driver is an electronic device that controls the movement of


a motor by regulating the electrical power supplied to it. It interprets
signals from a microcontroller or other control sources to adjust the
motor's speed and direction.

1. Types of Motors Supported: Motor drivers are designed to work


with specific types of motors, such as DC motors, stepper motors, or
servo motors. Each type requires different control mechanisms.

2. PWM Control: Many motor drivers use Pulse Width Modulation


(PWM) to control the speed of the motor. By varying the duty cycle
of the PWM signal, you can adjust the average power delivered to the
motor and, consequently, its speed.

3. H-Bridge Configuration: For controlling the direction of a DC


motor, an H-bridge configuration is commonly used. This setup
allows the motor to rotate in both forward an reverse directions by
changing the polarity of the applied voltage.

4. Stepper Motor Control: Motor drivers for stepper motors facilitate


precise control over the motor's rotation by sending a sequence of pulses
to its coils. This is essential in applications where accurate positioning is
required.

5. Current Sensing: Advanced motor drivers often include current


sensing capabilities. This allows the system to monitor and regulate the
current flowing through the motor, providing protection against
overloading.

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

6. Microcontroller Interface: Motor drivers typically interface with


microcontrollers or other control systems. They interpret commands
from these devices to execute specific motor movements.

7. Voltage and Current Ratings: Motor drivers are rated for specific
voltage and current levels. It's crucial to match the motor driver
specifications with the requirements of the connected motor.

8. Applications: Motor drivers are widely used in robotics, CNC


machines, 3D printers, drones, electric vehicles, and various industrial
automation systems.

9. Integrated Circuits (ICs): Many motor drivers come in the form of


integrated circuits, simplifying the design and assembly of motor control
circuits.

Fig6.2: Motor Driver

6.3 DC Motors

This type of rotary electrical equipment that transforms direct current


into mechanical energy. All types of DC motors contain an internal

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

mechanism, either electronic or electromechanical, that allows it to


change the direction of current flow in the motor's path on a periodic
basis.
1. Brushed DC Motors:
- Use brushes and a commutator to reverse the current in the winding, causing
rotation.
- Simpler design and typically less expensive.
- Brushes may wear out over time, requiring maintenance.
2. Brushless DC Motors (BLDC):
- Utilize electronic commutation for more efficient and reliable operation.
- Longer lifespan due to the absence of brushes, reducing maintenance needs.
- Common in applications like drones, electric vehicles, and computer cooling
fans.
3. Operating Principles:
- Both types rely on the basic principle of Lorentz force, where a
current-carrying conductor in a magnetic field experiences a force.
4. DC Motor Components:
- Stator: The stationary part with magnetic fields.
- Rotor: The rotating part (armature) containing windings.
- Commutator (in brushed motors): Reverses current direction to maintain
rotation.
5. Speed Control:
- Speed can be controlled by adjusting the voltage applied to the motor.
- PWM (Pulse Width Modulation) is commonly used for precise speed
control.
6. Applications:
- Widely used in various applications, including power tools,
electric vehicles, robotics, and small household appliances.
7. Efficiency:
- Brushless DC motors are generally more efficient due to reduced friction
and wear.
8. Torque and Speed Characteristics:
- Torque and speed characteristics vary based on the motor type and design.
9. DC Motor Driver:
- Required for controlling the direction and speed of the motor,

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

especially in the case of brushless motors.


10. Advancements:
- Ongoing research and development continue to improve
efficiency, reduce size, and enhance performance in various
applications.

Fig6.4: DC Motor

6.5 JUMPER WIRES AND BREADBOARD

Jumper wires, also known simply as jumpers, are essential


components in electronics and prototyping projects. These wires are
typically made of flexible insulated conductive material, such as
copper, and come in various lengths, colours, and connector types.
The primary purpose of jumper wires is to establish electrical
connections between different points on a breadboard, printed circuit
board (PCB), or electronic components without the need for
soldering.
Jumper wires enable quick and temporary connections during prototyping,
testing, and
troubleshooting stages of electronic circuits. They are commonly used
to connect various components such as microcontrollers, sensors,
resistors, LEDs, and other electronic modules on breadboards or
development boards like Arduino or Raspberry Pi. By simply

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

plugging one end of the jumper wire into a component's pin or socket
and the other end into another component's pin or socket, engineers
and hobbyists can easily create electrical connections to design and
experiment with circuits. Moreover, jumper wires facilitate the
creation of complex circuit layouts and configurations by allowing for
flexible routing and organization of connections on a breadboard or
PCB. They also enable the quick modification of connections without
the need for desoldering or reworking, making them indispensable
tools in rapid prototyping.

Fig6.5: Jumper wires

Bread board:

A breadboard is a foundational tool in electronics prototyping,


serving as a versatile platform for building and testing circuits
without the need for soldering. It typically consists of a plastic board
with a grid of holes arranged in rows and columns. Within these holes
are metal clips or sockets that provide electrical connections between
components inserted into the breadboard. The rows are usually
labeled with numbers, while the columns are label with letters, aiding
in component placement and circuit organization. Breadboards
feature power rails along the edges, providing convenient access to
power and ground connections for components. Additionally, tie
strips and bus strips facilitate connections between components,
allowing for the creation of complex circuit layouts. Breadboards are

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

widely used by engineers, hobbyists, and students for prototyping


circuits, testing electronic components, and experimenting with
circuit designs. Their ease of use, reusability, and ability to quickly
iterate on designs make them indispensable tools in electronics
education and development.

Fig6.5: Breadboard

6.6 ROBOT WHEELS


This are simple devices that consist of a circular block of sturdy and
hard material that is put in an axil around which the wheel revolves
when a moment is imparted by torque or gravity. The wheel turning
on the horizontal axil allows huge loads to be transported when it is
positioned under a load-bearing platform.
Robot wheels come in various types, including omnidirectional and
standard wheels. Omnidirectional wheels allow movement in any
direction, wheels enable omnidirectional motion with added rotation,
while standard wheels move forward or backward. Wheel selection
depends on the robot's intended tasks, maneuverability, and control
requirements. Consider factors like traction, load capacity, and power
consumption when choosing wheels for a robotic system.

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

Fig6.6: Wheels

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

CHAPTER 7

SOFTWARE DESCRIPTION

SOFTWARE REQUIRED:

7.1 Arduino IDE:

The Arduino Integrated Development Environment (IDE) is a


software platform designed to simplify the process of programming
Arduino microcontroller boards. It provides an intuitive interface for
writing, compiling, and uploading code to Arduino boards, making it
accessible to both beginners and experienced developers. The IDE
supports a simplified version of the C and C++ programming
languages, allowing users to create sketches, which are the programs
that run on Arduino boards. The IDE offers features such as syntax
highlighting, automatic code formatting, and built-in examples to
assist users in writing and understanding code. Additionally, it
provides a Serial Monitor tool for debugging and monitoring serial
communication between the Arduino board and a connected
computer. The Arduino IDE is open-source and cross-platform,
compatible with Windows, macOS, and Linux operating systems,
making it widely accessible to users worldwide. Its user-friendly
interface, extensive documentation, and active community support
contribute to its popularity among hobbyists, educators, and
professionals for prototyping, experimenting, and developing a wide
range of electronic projects and applications.

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

Fig 7.1: software of Arduino IDE

Embedded software used: Arduino.cc

7.1 MIT AI2 COMPANION APP

MIT App Inventor 2 (AI2) Companion is an app developed by the Massachusetts


Institute of Technology (MIT) for use with their App Inventor platform. It allows users
to test and debug the apps they create using MIT App Inventor on their Android

devices. The companion app facilitates real-time testing and interaction with the apps
as they are being developed on the App Inventor platform.

Fig7.2: MIT AI2 Companion app

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

CHAPTETR 8

FLOW CHART
The flow chart includes how the system works. The program flowchart is given below:

Fig 8.1: Flowchart for Gesture control

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

CHAPTER 9

RESULT
The result of a gesture and voice-controlled robot is increased user
interaction and intuitive control. Users can command the robot
through gestures and vocal commands, providing a more natural and
hands-free experience. This technology enhances accessibility and
convenience in controlling robotic devices.
The android smart phone's microphone is used to recognize human
voices. Using the Android operating system and Artificial
Intelligence software, this voice is processed and transformed into
English words. Speech recognition is a multidisciplinary subfield of
computational linguistics that explores approaches and technology
that allow computers to recognize and convert spoken language into
text. Automatic speech recognition (ASR), computer voice
recognition, and speech to text are some of the other names for it
(STT). It blends languages, computer science, and electrical
engineering expertise and study. Speech recognition has a long
history in terms of technology, with multiple waves of key
advancements. Advances in deep learning and big data have recently
improved the field. The improvements are proven not only by the
increasing number of academic articles published in the subject, but
also by the widespread industry acceptance of a range of deep
learning approaches in the design and deployment of voice
recognition systems around the world.

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

Fig9.1: Assembled Image

CHAPTER 10

APPLICATIONS

APPLICATION:

1. Home Automation: Control various smart devices like lights,


thermostats, and appliances using gestures or voice commands.

2. Healthcare Assistance: Enable hands-free control for medical


robots, aiding in tasks like delivering medications or monitoring
patients.

3. Assistive Technology: Assist individuals with disabilities by


developing robots that respond to gestures or vocal commands for
daily tasks.

4. Warehouse Automation: Streamline inventory management and


logistics by employing robots that understand and execute
commands through gestures or voice.

5. Education: Create interactive learning experiences with robots that


respond to students' gestures or verbal cues, enhancing engagement.

6. Entertainment: Develop entertaining robots for gaming or


interactive experiences where users control the robot's actions
through gestures or voice.

7. Customer Service: Implement robots in public spaces or retail


environments to provide information or assistance based on user

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

gestures or voice prompts.

8. Security Systems: Integrate gesture and voice control for


surveillance robots, enhancing security measures and responsiveness.

9. Industrial Manufacturing: Improve efficiency and safety in


manufacturing processes by using robots that can be controlled
through gestures or voice commands.

10. Search and Rescue: Develop robots equipped with sensors that
respond to gestures or voice instructions, aiding in locating and
assisting people in emergency situations.

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

CONCLUSION:

On the whole, this internship was a useful experience. We have


gained new knowledge, skills and met many new people. We
achieved several of our learning goals. We got insight into
professional practice currently advocated in the industry. We
learnt the different facets of working within the well-established
industry. Related to our study we learnt more about Embedded
systems. Furthermore, we have experienced that it is of
importance that education is objective and that we have to be
aware of the industrial aspects of the topics we studied. This
internship program was not one sided, but it was a way of sharing
knowledge, ideas and opinions. The internship was also good to
find out what our strengths and weaknesses are. This helped us to
design what skills and knowledge we have to improve in future.
We can confidently assert that the knowledge we gained through
this internship is sufficient to contribute towards our future
endeavors.

FUTURE SCOPE:

The future scope for a voice and gesture-controlled robot using


Arduino is promising. Advancements in natural language
processing and computer vision technologies will likely enhance
the robot's capabilities. Integration with smart home systems,
healthcare applications, and industry automation can be explored,
opening up diverse opportunities for innovation. Additionally,
improvements in hardware, such as more powerful
microcontrollers and sensors, will contribute to the development
of more sophisticated and responsive robotic systems. Keep an

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

eye on emerging technologies to stay at the forefront of this


evolving field.

CHAPTER 12

REFERENCES

[1] M. Meghana et al,2020, Hand gesture recognition and voice


controlled robot, Materials Today: Proceedings,2214-7853

[2] Dyah Ayu Anggreini Tuasikal, Hanif Fakhrurroja,


Carmadi Machbub,2018, Voice Activation
Using Speaker Recognition for Controlling Humanoid Robot”,
International Conference on System

[3] T. Thivagar, A. Sriram,2020, Hand Gesture,2020,Voice


Controlled Smart Vehicle, International Journal of Modern
Science and Technology, ISSN: 2456-0235.

[4] Shruthi B. N, Shivraj, Sumathi S, “Hand Gesture Based


Direction Control Of Robocar Using Arduino Microcontroller”,
International Journal Of Recent Technology And
Engineering(IJRTE), Volume-3, Issue-3,PP.-32- 35, July 2014.

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

Department of ECE, CMRIT, Bengaluru 2023-24


ML and IoT Embedded System Design and Development

APPENDIX A

Department of ECE, CMRIT, Bengaluru 2022-23

You might also like