Professional Documents
Culture Documents
Documentation Final Thesis Report267
Documentation Final Thesis Report267
BY
Sidra Asghar
2015-GCWUF-2502
Faiza
2015-GCWUF-2563
BECHLOR OF SCIENCE
IN
COMPUTER
July 2019
DECLARATION
I hereby declare that the contents of the thesis, “VIP’s Audible Helpmate” is product
of my own research and no part has been copied from any published source (except the
references, standard mathematical and genetic models/ equations/ formula/ protocols
etc.). I further declare that this work has not been submitted for award of any diploma/
degree. The university may take action if the information provided is found inaccurate
at any stage (in case of default the scholar will be proceeded against as per HEC
plagiarism policy).
_________________ _________________
I
The Controller of Examinations,
The members of the Supervisory Committee find the thesis submitted by Sidra Asghar
(2015-GCWUF-2502), Faiza Pervaiz (2015-GCWUF-2563) satisfactory and
recommend that it be processed for evaluation by the External Examiner(s) for the
award of degree.
II
Acknowledgement
I indebted to Almighty Allah, the propitious, the benevolent and sovereign whose
blessing and glory flourished my thoughts and thrived my ambitions. I always believed
that, Allah never spoils anyone’s efforts. Every piece of work is rewarded according to
nature of devotion in it. Trembling lips and wet eyes praise for the greatest reformer of
the universe, the last messenger of Allah, Holly Prophet Muhammad (S.A.W) for
enlightening our conscious with the essence of faith in Allah, converging all His
kindness and mercy upon Him.
I would like to pay my sincere gratitude to my parents who always supported and
encouraged me in all barriers, who always gave financial, moral support and valuable
assistance in my academic pursuits.
Finally, I thank all those who assisted, encouraged and supported me during this project
period, be assured that Allah will bless you all for the contributions you made. May
Allah bless all these people with long, happy and peaceful life (Ameen).
III
Acronyms and Abbreviations
OOP Object Oriented Programming
SDK Software Development Kit
XML Extensible Markup Language
VCD Voice Command Device
STT Speech to Text
TTS Text to Speech
VIM Voice Input Manager
GUI Graphical User Interface
IV
Abstract
The group of visually impaired persons are facing trouble in their daily life without the
assistance from their family or friends. The growing number of visually impaired
people has brought attention of many researchers. Researchers are working on
understanding visually impaired people characteristics, needs, and protecting them
against risks that they may face in their daily living activities. With advances in artificial
intelligence and mobile computing, the mobile devices have grown popularity to
become one of the most usual and popular user devices. VIPs Audible Helpmate is an
android base application. Product will have sufficient features for VIPs (Visually
Impaired Persons). This idea is originated with the purpose of providing combined
features in single product. VIPs Audible Helpmate will have embedded three modules
that is essential need for a person using mobile phone. This product is useful for VIPs
as well as normal persons that is used that wishes to control android through voice. This
system is a voice recognizing application for mobile phones that allow access to most
of the functionalities of the phone and will make it possible for visually impaired people
to connect with the society. It will provide barrier free user interface to guarantee
autonomous usage of mobile phone by a blind user. It performs basic functions such as
calling, messaging and Event. Previously visually impaired people need to operate the
phone keys manually by remembering the position of keys. But in case of this
application they just have to operate the phone by voice command.
V
Table of Contents
Chapter 1........................................................................................................................... 1
Introduction ........................................................................................................................ 1
1.1 Introduction ................................................................................................................ 1
1.2 Project Background/Overview ................................................................................... 2
1.3 Objectives .................................................................................................................. 3
1.4 Problem Description .................................................................................................. 4
1.5 Project scope .............................................................................................................. 6
Chapter 2........................................................................................................................... 8
Literature Review ............................................................................................................... 8
2.1 Literature Review....................................................................................................... 8
Chapter 3......................................................................................................................... 14
Requirement Specifications.............................................................................................. 14
3.1 Existing System ....................................................................................................... 14
3.2 Proposed System ...................................................................................................... 16
3.3 Requirement Specifications ..................................................................................... 17
3.3.1 Functional Requirements ................................................................................. 18
3.3.2 Non-Functional Requirements ......................................................................... 19
3.4 Use case ................................................................................................................... 20
Chapter 4......................................................................................................................... 28
Design .............................................................................................................................. 28
4.1 Design ...................................................................................................................... 28
4.1 System Architecture ................................................................................................. 28
4.2 Design Constraints ................................................................................................... 29
4.3 Design Methodology ................................................................................................ 29
4.4 High Level Design ................................................................................................... 30
4.4.1 Conceptual or Logical: ..................................................................................... 30
4.4.2 Process: ............................................................................................................ 32
4.4.3 Physical ............................................................................................................ 33
4.4.4 Module: ............................................................................................................ 33
4.5 Low Level Design .................................................................................................... 35
4.5.1 Entities ............................................................................................................. 36
4.5.2 Entity Diagrams ............................................................................................... 37
4.6 GUI Design .............................................................................................................. 39
Chapter 5......................................................................................................................... 45
System Implementation .................................................................................................... 46
VI
5.1 System Architecture ................................................................................................. 46
5.1.1 Setting Application Permissions and Libraries ................................................ 48
5.1.2 Consuming speech to text ................................................................................ 49
5.1.3 Consuming text to speech ................................................................................ 51
5.1.4 Speech Notifications ........................................................................................ 52
5.1.5 Make Call ......................................................................................................... 53
5.1.6 Send Message................................................................................................... 54
5.1.7 Receive Message .............................................................................................. 55
5.1.8 Check Weather ................................................................................................. 56
Chapter 6......................................................................................................................... 59
System Testing and Evaluation ........................................................................................ 59
6.1 Testing .......................................................................................................................... 59
6.1.1 System Testing ........................................................................................................ 59
6.1.2 Unit Testing ............................................................................................................ 60
6.1.3 Integration Testing .................................................................................................. 60
6.1.4 Regression Testing .................................................................................................. 60
6.1.5 Black box Testing ................................................................................................... 60
6.1.6 White box Testing ................................................................................................... 61
6.2 Test Cases ..................................................................................................................... 61
6.3 Application rating .................................................................................................... 67
6.4 Initial Setup .............................................................................................................. 67
6.4.1 Message and Call Permissions ......................................................................... 68
6.4.2 Calendar and Location Permission .................................................................. 68
6.5 System Processing ................................................................................................... 69
6.5.1 Call Testing Results ......................................................................................... 69
6.5.2 Message Testing Results .................................................................................. 70
6.5.3 Event Testing Results ...................................................................................... 71
6.5.4 Weather Testing Results .................................................................................. 72
Chapter 7......................................................................................................................... 73
Conclusion........................................................................................................................ 73
References ....................................................................................................................... 74
VII
List of Figures
Figure 3.1: Use case diagram of project ............................................................................. 24
Figure 3.2: Start Application............................................................................................... 25
Figure 3.3:Entering Pre-requisite Section ........................................................................... 26
Figure 3.4: Phone Section ................................................................................................... 27
Figure 3.5: Weather Section ............................................................................................... 28
Figure 3.6: Message Section ............................................................................................... 29
Figure 3.7: Event Section.................................................................................................... 30
Figure 4.1: System Architecture ......................................................................................... 31
Figure 4.2: Data Flow diagram ........................................................................................... 34
Figure 4.3: Data Flow diagram ........................................................................................... 34
Figure 4.4: Activity Diagram .............................................................................................. 35
Figure 4.5: Sequence diagram............................................................................................. 36
Figure 4.6: Class diagram ................................................................................................... 38
Figure 4.7: Home Screen .................................................................................................... 40
Figure 4.8: Main Menu ....................................................................................................... 40
Figure 4.9: Call Activity ..................................................................................................... 40
Figure 4.10: Message Activity ............................................................................................ 41
Figure 4.11: Weather Activity ............................................................................................ 41
Figure 4.12: Event Activity................................................................................................. 41
Figure 4.13: Splash Screen ................................................................................................. 42
Figure 4.14: Home Screen .................................................................................................. 43
Figure 4.15: Message Screen .............................................................................................. 44
Figure 4.16: Message Sending Screen ................................................................................ 44
Figure 4.17: Call Screen ..................................................................................................... 45
Figure 4.18: Weather Screen............................................................................................... 46
Figure 4.19: Event Screen ................................................................................................... 47
Figure 5.1: Android System Architecture .......................................................................... 49
Figure 5.2: Permission ....................................................................................................... 50
Figure 5.3: Speech Recognition .......................................................................................... 51
Figure 5.4: Command Matching ......................................................................................... 52
Figure 5.5: Text to Speech .................................................................................................. 53
Figure 5.6 Speech Notification ........................................................................................... 54
Figure 5.7: Implementing make-call ................................................................................... 55
Figure 5.8: Implementing message-sending ....................................................................... 56
Figure 5.9: Implementing message-receive Activity .......................................................... 57
VIII
Figure 5.10: Checking Phone Number ................................................................................ 57
Figure 5.11: Implementing Weather Activity ..................................................................... 58
Figure 5.12: Event Setting Commands ............................................................................... 59
Figure 5.13: Implementing Event Creation......................................................................... 60
Figure 6.1: Application Permissions ................................................................................... 69
Figure 6.2: Call and Message Access permissions ............................................................. 70
Figure 6.3: Calendar and Location Access permissions ..................................................... 70
Figure 6.4: Outgoing Call setting........................................................................................ 71
Figure 6.5: Incomming Call setting .................................................................................... 71
Figure 6.6: Sending Message testing .................................................................................. 72
Figure 6.7: Receive Message Testing ................................................................................. 72
Figure 6.8: Create Event Testing ........................................................................................ 73
Figure 6.9: Weather Testing ............................................................................................... 74
IX
List of Tables
Table 1 ................................................................................................................................ 25
Table 2 ................................................................................................................................ 26
Table 3 ................................................................................................................................ 27
Table 4 ................................................................................................................................ 28
Table 5 ................................................................................................................................ 29
Table 6 ................................................................................................................................ 30
Table 6.1 Tc-1 ..................................................................................................................... 64
Table 6.2 Tc-2 ..................................................................................................................... 65
Table 6.3 Tc-3 ..................................................................................................................... 66
Table 6.4 Tc-4 ..................................................................................................................... 67
Table 6.5 Tc-5 ..................................................................................................................... 68
X
XI
1
Chapter 1
Introduction
1.1 Introduction
It is estimated that there are about 253 million people with vision impairment in the
world. The group of visually impaired persons are facing trouble in their daily life
without the assistance from their family or friends. The growing number of visually
impaired people has brought attention of many researchers. Researchers are working
on understanding visually impaired people characteristics, needs, and protecting them
against risks that they may face in their daily living activities. With advances in artificial
intelligence and mobile computing, the mobile devices have grown popularity to
become one of the most usual and popular user devices. The technology has brought
more convenient to the blind and visually impaired people with a friendly interface.
With advances in new technologies, mobile devices have grown in popularity to
become one of the most common consumer devices. Cell phones are very important
part of modern life. Many of us need to make a call or send a message at anytime from
anywhere. For blind and motion-impaired people this issue is more obvious, but other
people also often face this problem, e.g., when driving or using a smart-phone under
bright sunshine. Sighted users often find them inevitably placed under situations where
non-visual interaction is required.
There is a need for visually impaired people to get to know about the life outside their
home and they desire to have access to Internet and mobile services as normal one. This
application is more focused to support visually impaired people with their daily mobile
needs. “Visually Impaired person’s Audible Helpmate” is an android application which
supports voice commands. The application is developed for visually impaired people.
After unlocking the mobile phone, the application will be launched without any voice
command. The systems accept voice command and perform the operations according
to it. For performing the further task, it first translates the voice into text and then
produces output in the form of voice.
It performs basic functions such as calling, messaging and operations of Event (such as
add, delete). Previously visually impaired people need to operate the phone keys
1
manually by remembering the position of keys. But in case of this application they just
have to operate the phone by voice command.
2
The visually impaired persons audible assistant will help them to perform basic
functions of phone without being dependent on anyone. This application also avoids
them from clicking of buttons or remembering button position.
1.3 Objectives
The objective of this project is to develop software application which is user
friendly, simple, fast, and cost effective.
The main objective of this project is to develop a user-friendly application to
facilitate visually impaired persons by which they can control their smart phone
by just their voice.
The target of this venture is to create programming application which is easy to
understand, straightforward, quick, and savvy.
The fundamental goal of this undertaking is to build up an easy to understand
application to encourage outwardly weakened people.
The app will provide step-by-step instruction with voice feedback to get user
from a location to selected destination.
The principle target of this android application is to give correspondence
framework to the blinds in a successful route by exploring the forces of the stage
to the most extreme.
They just order their phone to perform activity which they want.
This application handles incoming as well as outgoing call using voice
command
This application handles incoming as well as outgoing SMS using voice
command.
All the features in the application are guided through voice-based commands,
so that it would be easier for visually impaired people to use the application.
User can start the speech recognition process by clicking anywhere on screen of
application.
The user can set event by just speaking date and time or can delete previously
created event.
This application is also beneficial for busy persons.
In this Project physically disable person or the person having less knowledge
about smart phone or how to access the smart phone can easily access the phone
with their voice or speech command.
3
The objective of this project to develop an Android application which will
interact user with voice command to perform some emergency option.
4
graphical user interfaces (GUI), objects, such as buttons, menus and documents, are
presented for users to manipulate in ways that are similar to the way they are
manipulated in the real work space, only that they are displayed on the screen as icons.
The first and most essential step of interaction with GUI is target locating, sighted
people can intuitively and the target object with a quick visual scan. But without visual
access to the screen, this simple task is often very hard to finish, which is the main cause
of difficulties in non-visual interaction. A Voice Command Device (VCD) is a device
controlled by means of the human voice. Google created a speech recognition engine
called Pico TTS. These also apply to anyone unable to look at and touch their device,
leaving voice commands their only option.
Why:
In this project we are going to explore automation capabilities and planning capabilities
of the agent and micro-controller. It highlighted the requirements on external data and
knowledge sources. The motivation behind this exploration venture is to make an
application that would empower the outwardly tested to utilize some fundamental
highlights of cell phones along these lines making their life somewhat less complex.
Through this application the visually challenged user can always be connected with the
world around.
Hence, introducing a smart personal assistant that is smart in a way that it provides
audible assistance. Visually impaired persons audible helpmate can be used as an
interface to the digital world to make the consumption of this information timely and
efficient for the user’s specific tasks. Goal of the project is to design personal assistant
that understands the semantics of the task, is able to identify the task correctly and make
appropriate decision without much HCI.
Our application has all the basic functionalities of phone like call, SMS, contacts, alarm
and events. we build this app with the purpose of providing combined features in single
product. This system is a voice recognizing application for mobile phones that allow
access to most of the functionalities of the phone and will make it possible for visually
impaired people to connect with the society. It will provide barrier free user interface
to guarantee autonomous usage of mobile phone by a blind user.
The motivation behind this exploration venture is to make an application that would
empower the outwardly tested to utilize some fundamental highlights of cell phones
therefore making their life somewhat less difficult. The examination is dedicated to
discover a calculation which would require less time for example acknowledgment and
5
that would be effective. Utilizing different calculations can help improve productivity.
The purpose behind utilizing Android working framework-based cell phones is that
Android is an open source innovation now a days. This venture is committed to those a
huge number of differentially-abled individuals who the world has wrongly marked as
crippled. This venture would ideally contribute something to the general public and
help make the lives of a large number of outwardly tested individuals simpler.
This app will help blind in a way that they just speak message and message app will be
open then app will ask the user to whom he wants to send message and ask the user to
speak the name or number of persons and the message will easily be send to that person.
Similarly, all other activities of call, contacts and alarm will be done by just their voice.
6
possible for visually impaired people to connect with the society. The sighted user’s
people with limited reading ability can also use this application if they are involved in
activities that prevent reading (e.g.: driving or other eyes occupied situations).
This application underpins voice directions. The application is produced for outwardly
hindered individuals. Subsequent to opening the cell phone, the application will be
propelled with no voice order. The frameworks acknowledge voice direction and play
out the activities as indicated by it. For playing out the further errand, it initially makes
an interpretation of the voice into content and after that produces yield as voice.
In this application user is able to access the services of smart phone with their voice
command. User can easily send a message to the recipient available in their contact list
as well as to the mobile number by voice command. In this Project physically disable
person or the person having less knowledge about smart phone or how to access the
smart phone can easily access the phone with their voice or speech command.
The visually impaired individuals face difficulties day by day in speaking with their
general surroundings. They need to rely upon their located associates for making a
telephone call and getting to other portable functionalities. This framework is a voice
perceiving application for cell phones that enable access to the vast majority of the
functionalities of the telephone and will make it workable for outwardly debilitated
individuals to associate with the general public. The located client's kin with restricted
perusing capacity can likewise utilize this application on the off chance that they are
engaged with exercises that avoid perusing (e.g.: driving or different eyes involved
circumstances).
In this application client can get to the administrations of PDA with their voice
direction. Client can without much of a stretch make an impression on the beneficiary
accessible in their contact list just as to the versatile number by voice order. In this
Project physically impair individual or the individual having less learning about
advanced cell or how to get to the PDA can without much of a stretch access the
telephone with their voice or discourse order.
7
Chapter 2
Literature Review
2.1 Literature Review
Requirements analysis is a software engineering task that bridges that gap between
system level requirement engineering and & software design. Requirements analysis
provides the software designer with a representation of information, interface, function
and behavior that can be translated to data & information, architectural, interface and
component level designs.
With respect to extend this undertaking is exceptionally useful for the outwardly
impeded people. The goal of this venture is to create programming application which
is easy to understand, straightforward, quick, and practical. The fundamental goal of
this venture is to build up an easy to use application to encourage tie people so they can
undoubtedly utilize cell phone without somebody's assistance.
The other related applications and their author’s reviews and their work are as follows.
Just Speak Enabling Universal Voice Control
[T.V. Raman, 2008] Just Speak Enabling Universal Voice Control is an android
application. In this application authors have, designed and implemented voice user
interfaces in the form of voice navigation, commands and launching other applications
using C and C++ programs. The voice application was written in C++ supported by
CodeWarrior 9.1 and designed in common Palm Operating System applications. The
important feature of Just Speak was implementation of multiple commands in single
speech. It was more time to combine multiple commands into one sentence than
repeating the whole dialog. The interaction to launch applications via voice commands
is simple and fully accessible for non-visual use. It has been released on Google Play
Store for free downloads. This application provides limited functionalities and unable
to handle extra voice commands in noisy environment. But our application will handle
different commands even in noisy environment and give the user better results.
Visually impaired
[Jawahar, 2017] Visually impaired is an android application based on voice commands.
The application was developed by Jawahar in Nov 6, 2017. The features of this
application are the user can call to any contact and can check recently used applications.
Other features include Bluetooth, WIFI on or off. But this application uses shacking of
8
phone. Even if the mobile screen is off this application gets activated without user’s
permission. This application does not have the basic facilities like contacts, message,
alarm etc. Our application has all basic facilities that user of mobile wants and the user
does not have to shake phone in order to start the application, because shaking of phone
activate application each time and the user of application gets irritated.
Blind communicator
[Leounardo Javier] Blind communicator is opensource launcher for blind people for
using smartphones and tablets. The launcher has a voice guide that tells the user
everything that it's happening in the device (screen off/on, screen rotation, incoming
call, etc. This launcher is compatible with Talkback. The major feature of this
application is it uses speech commands. This application uses gestures of fingers to
slide up, down, left or right to perform different functions that is the big drawback of
this application as the blind persons gets confused when to slide left or right. Our
application not uses gestures of fingers it just uses voice commands to perform different
functions.
Voice Based System in Desktop and Mobile Devices for Blind People
Voice Based System in Desktop and Mobile Devices for Blind People. This application
specified the use of ASR (automatic speech recognizer) and TTS (Text-to Speech) get
used for converting speech to text and vice versa. This included development of text
Braille systems, screen magnifiers and screen readers. Web browser for blind were the
two-web browser framework that were used by blind people to access the internet
including email Gmail- System read messages on recipient mailbox. RSS- Real simple
syndication for news Song- listen songs Book reader-system read book Drive browser-
To search drives and folders. Voice mail architecture helped blind people to access
email and other multimedia function of operating system. This application, described
the voice mail architecture used by blind people to access email and multimedia
function of operating system easily and efficiently. This system mainly focuses on just
mailing system and has less features for visually impaired persons.
Google Now and Siri
The voice control systems are the applications or devices controllable by commands of
a human voice. There are various levels of voice control supported in mobile and
computing devices. The most popularly used applications are Google Now and Siri.
The Google Now is a google product that supports a dialogue interaction of the android
and a user. It supports various functionalities, mostly controlling the Google products
9
on phone – Gmail, Google drive, YouTube, Google Photos, Google Books, Play store,
etc. Apple has introduced Siri as a voice assistant app into iOS and later partnered with
Nuance to launch a more intelligent model of Siri in iOS 3. Google Now and Siri are
both constrained and are restricted by the way they handle commands. Every Siri input
is divided into words to check for the presence of a function keyword. An example of
function keyword is Calendar. If a function keyword is present, the required function is
carried out; otherwise a google search is initiated by considering a web search query as
input. Hence, it becomes difficult for them to integrate the applications from third party.
Further, if there are multiple instructions for a task, the user has to repeat it several
times. For instance, a task like Send email and disable internet connection will not be
recognized. It has to be broken into two instructions: send email and disable internet
connection.
Voice Assistant for Visually Impaired
[Nevon projects] Voice Assistant for Visually Impaired in Android is an innovative system
for visually impaired people and acts as a voice assistant for them. This system is used to help
the visually impaired to have access to the most important features of the phone enhancing the
quality of the system making use of different custom layouts and using speech to text. The
system has custom messaging features also. It also has dialer options as well. There is an
important thing is to know about the current time and location. The user also read the contents
of the message for checking purpose. Since the system doesn’t use internet, the data is
saved offline and is phone dependent. If the phone is formatted or lost the data is lost.
This application doesn’t allow the addition of any contact in phone as our application
does. Our voice assistant application gives better solution for visually impaired people.
Google TalkBack
[Google, 2017] TalkBack is an application that is a part of Google’s Android
Accessibility Service. It is developed to assist visually impaired people to use their cell
phones easily. The application also reads out the texts loud, while the movements of
the user are carefully evaluated and spoken by the app. In order to enable this app, go
to Settings, Accessibility, and enable TalkBack service. By using this application lot of
repetitive work, like continuous tapping and speaking, speed up the consumption of
devices’ battery level. But our app will work continuously on normal battery
consumption.
10
Vlingo
[Nuance Communication, 2012] A free download application that is designed to
recognize the user’s voice, Vlingo can be commanded to perform various functions on
the phone. The User needs to hold down the voice key on the phone or other mobile
device and wait for the tone before speaking their command or tap it once to start and
once to stop. From there the app can place a call, send a text, or connect with other
applications on the phone. The speech recognition only works in English and can only
connect with a limited number of apps. For the visually impaired, there are still a
number of touch movements needed that may make it difficult to use for visually
impaired person. But our application just needs users voice and did not require more
clicks.
Dragon-go
[Nuance Communication, 2013] Dragon-go is the voice recognition application the
voice recognition of Dragon Go! is more sophisticated than with Vlingo. It can be slow
at following commands and not all of iOS devices are supported but its command
recognition is excellent. In addition, the carousel tabs it uses cannot be customized to
suit you but it does function more efficiently than Vlingo does. Only available in US
English, Dragon Go! is very capable when it comes to interacting with dozens of other
apps, but is missing that element of being able to talk back to you. This makes it a
difficult voice recognition device to use for the visually impaired who will still need to
be able to read the screen on the phone. For the visually impaired, Dragon Go! is a
viable solution for voice dialing from a cell phone but not much else as our application.
The interface is user friendly, but without the ability to translate text to voice, this
feature would be of no use for someone who is blind.
Android based voice assistant for blind people
[Marcos Brata, 2015] Android based voice assistant for blind people gives a simple
access of an android gadget to daze individuals and individuals with low vision,
just as access to library assets with gadgets that have been introduced with this
application. This office can improve the library availability to the visually impaired
and outwardly tested network. The application still has confinements in infiltration
to the client, and the application is just constructed utilizing Android as its stage.
Also, the reliance on libraries from Google has caused challenges in executing this
application with nearby vernacular, which is just comprehended by the
neighborhood network.
11
Voice Over
[Junar Arciete Landicho, 2016] Voice Over is an android application dependent on
voice directions. The highlights of this application are the client can call to any
contact and can check as of late utilized applications. Different highlights
incorporate Bluetooth, WIFI on or off. However, this application utilizes shacking
of telephone. Regardless of whether the versatile screen is off this application gets
actuated without client's authorization. This application does not have the essential
offices like contacts, message, alert and so on. Our application has every single
fundamental office that client of portable needs and the client does not need to
shake telephone so as to begin the application, since shaking of telephone actuate
application each time and the client of use gets aggravated.
Ideal Accessibility Installer
[Ideal Group, Inc. Android Development Team, 2013] This application is also called
Platform Access Installer. It contains different packages such as KickBack, TalkBack,
and SoundBack (TKS) applications for visually impaired and blind people. These
applications add audible, vibration and spoken feedback to Android devices. But this
application just compatible with some of the devices and didn’t work many other
mobiles.
Voice Message Sender
[Mega Phone Apps, 2018] Voice Massage Sender write message by voice and convert
voice into text. The main feature of send message by voice through is to create a secure
environment for user in which they handle multitasking such as driving and texting.
Another feature of this application is it can work without internet and this application
support multiple languages. But the drawback of this application is, it does not delete
previous messages.
Voice Call Dialer
[Delux App Zone, Dec 16, 2017] Voice Call Dialer is easy and smart contacts dialer
who helps in voice dialing and making calls. Voice Call / Dialer is a simple application
which enables voice dialing / calls on Android Smartphone. It performs function like
directly send a message or add a number to contacts and search contacts. But the user
interface of this application is very complex and difficult to understand especially for
visually impaired persons.
In any case, these applications are not specifically intended for outwardly disabled
individuals. Not every one of the highlights in these applications are helpful for
12
outwardly debilitated individuals and it requires some investment and aptitudes to
figure out the highlights of these applications. It is very difficult for the outwardly
hindered individuals to utilize the previously mentioned applications, as they don't offer
voice helped approach in any of the previously mentioned applications.
The present personal assistants are incapable of providing adequate assistance to
visually impaired people. There's a need to develop a smart personal assistant that is
equally assistive for them. Small computing devices has really replaced those big
computers required for doing some large and smart computations. These mini
computers are portable, can support lots of sensors, can connect to internet, can provide
cloud support too and many more services. Implementing extra intelligence to the
system and will dramatically hide/reduce human computer interaction (HCI).
In this venture we will investigate computerization capacities and arranging abilities of
the operator and smaller scale controller. It featured the prerequisites on outside
information and learning sources. Thus, presenting a savvy individual colleague that is
brilliant such that it gives capable of being heard help. Outwardly hindered people
capable of being heard partner can be utilized as an interface to the computerized world
to make the utilization of this data opportune and productive for the user's particular
undertakings. Objective of the undertaking is to structure individual partner that
comprehends the semantics of the errand, can recognize the assignment effectively and
settle on fitting choice absent much human computer association.
13
Chapter 3
Requirement Specifications
This undertaking is connected with the propelled arrangement of voice
acknowledgment as we know the use of cell phones has expanded in the previous years.
Today, out of the 6 billion cell phones on the planet consistently observes an expansion
of around 6 million clients. We have concocted better approaches to encourage the
outwardly disabled people so they can utilize cell phones by their own without
depending anybody. Every one of the highlights in the application are guided through
voice-based directions, with the goal that it would be simpler for outwardly impeded
individuals to utilize the application. Client can begin the discourse acknowledgment
process by clicking anyplace on screen of utilization. To improve outwardly impeded
individuals' independency, this Android application is created to assist outwardly
hindered individuals with their day by day life portable exercises. To list, an Android
application is created with numerous highlights which will facilitate the outwardly
weakened client to utilize the highlights through voice.
There are many applications built in android for the visually challenged, but maximum
do not address the basic problems faced by them. The applications, though really good
in their approach do not cater for the basic needs of a blind person. After the analysis
of the various applications available for the visually challenged, the following
conclusions can be drawn:
1. Most Of the applications available are built for navigation purposes for example”
Walky-talky Explorer and Intersection. But these applications are not able to help the
user with basic mobile phone features such as calling and messaging.
2. There are some other applications which have calling and messaging features
example” Mobile Accessibility” but these take voice as input and are not very efficient
for Pakistani English accent. The applications like “Vlingo Virtual assistant” and
14
“speaktoit” are based on voice support which makes it difficult for the application to
understand the accent of many users.
3.Application like “VOICe for Android”, which is also meant for visually challenged,
is a universal translator for mapping images to sounds.
But these applications are not specifically designed for visually impaired people. Not
all the features in these applications are useful for visually impaired people and it takes
some time and skills to figure out the features of these applications. It is very difficult
for the visually impaired people to use the above-mentioned applications, as they do
not offer voice assisted approach in any of the above-mentioned applications.
All the above-mentioned reasons are the primary motivation to develop a dedicate
application for visually impaired people to help them in their daily mobile usage needs.
All the projects and applications mentioned above, do not address the connectivity
problem faced by the visually challenged and thus the visually challenged are unable to
do basic mobile operations such as calling and messaging. Thus, this provokes the need
for a new application that would enable people to use the basic operations of mobile
and which would also keep in mind the needs of the vocally and the visually challenged.
This research is motivated by prior attempts to create accessible touch screen user
interfaces for blind people. The basic objective of this project is to overcome the
limitations of the applications stated above and to help the visually challenged user to
be connected with the world. To achieve this objective the following features have been
implemented _ Speed-Dial Calling, Messaging, Location Retrieving, Alert for Battery,
Current Time and Date.
The present individual collaborators are unequipped for giving sufficient help to
outwardly hindered individuals. There's a need to build up a keen individual
collaborator that is similarly assistive for them. Little registering gadgets has truly
traded those huge PCs required for doing some extensive and shrewd calculations.
These small PCs are versatile, can bolster loads of sensors, can associate with web, can
give cloud support as well and a lot more administrations. Actualizing additional insight
to the framework and will significantly stow away/lessen human PC communication
(HCI).
15
and learning sources. Hence, introducing a sagacious individual partner that is splendid
with the end goal that it gives equipped for being heard assistance. Apparently blocked
individuals equipped for being heard accomplice can be used as an interface to the
mechanized world to make the usage of this information ideal and profitable for the
client's specific endeavors. Target of the endeavor is to structure singular accomplice
that understands the semantics of the errand, can perceive the task viably and settle on
fitting decision missing much human PC affiliation.
But this application provides a very easy to interface with all basic features. The
application just has one centered button, the user has to click on the center of the mobile
and voice system will guide the user to perform further steps. The main objective of
this project is to develop a user-friendly application to facilitate the Visually impaired
persons. It will help to improve their confidence in using smart phones without
depending on anyone.
This project demonstrates the idea of messaging and calling system for visually
impaired people. It allows environmental barriers to be removed for people with a wide
range of disabilities. In this project we have presented the system designs and use cases
of the application “Visually Impaired Audible Helpmate”. It is a universal voice control
assistant on Android operating system. The application provides enhancements to all
applications running on mobile system. Visually Impaired Audible Helpmate can
benefit large number of users with universal eyes-free and hands-free voice control of
their mobile devices.
It performs basic functions such as calling, messaging and operations of contact (such
as add, show, delete). Previously visually impaired people need to operate the phone
keys manually by remembering the position of keys. But in case of this application they
just have to operate the phone by voice command. The visually impaired persons
16
audible assistant will help them to perform basic functions of phone without being
dependent on anyone. This application also avoids them from clicking of buttons or
remembering button position.
The purpose of this research project is to create an application that would enable the
visually challenged to use some basic features of mobile phones thus making their life
a bit simpler. The research is devoted to find an algorithm which would require less
time for pattern recognition and that would be efficient. Using multiple algorithms can
help improve efficiency. The reason for using Android operating system based mobile
phones is that Android is an open source technology now a days. This project is
dedicated to those millions of differentially-abled people who the world has wrongly
labeled as disabled. This project would hopefully contribute something to the society
and help make the lives of millions of visually challenged people easier. Through this
application dialing of any of the ten presaved phone numbers is implemented. The user
can also send to these numbers any of the ten pre-saved message templates. To use the
feature of calling and messaging the user has to enter the calling/messaging module by
giving voice commands on the main screen, subsequently he/she has to click in center
on his smart phone touch screen and ask the user to speak number to performing some
activity. The application then recognizes this number, asks the user if he wants to make
a call or send a message. To make a Call the user has to give voice command on his
phone. The application would ask the user for confirmation by asking him to shake the
mobile (Call button) else he has to press right button (End button). To send a message
the user has to say some keywords related messages. The device then responds via
Audio with the current date time of the device. Similarly, the user can also access the
alarm module of mobile phone and can set alarm.
17
recognition process by clicking anywhere on screen of application. To enhance
visually impaired people’s independency, this Android application is developed to
help visually impaired people with their daily life mobile activities. To enumerate,
an Android application is developed with multiple features which will ease the
visually impaired user to make use of the features through voice. The functional and
nonfunctional requirements of the application are described below:
18
The system should be designed to give the weather of any required city and read
the weather for user.
The system should give voice message when message received.
The system should make call by just speaking phone number.
The system should give voice message when someone calls.
The system should be compact, lightweight and highly reliable and robust in
design with inbuilt redundancy.
19
The rule focus of this android application is to give correspondence structure to
the blinds in a fruitful course by investigating the powers of the phase to the
most outrageous.
All the highlights in the application are guided through voice-based directions,
with the goal that it would be simpler for outwardly disabled individuals to
utilize the application.
Safety Requirements
Backup of the database must be a regular process. This process will be executed on
daily basis or before and recovery or update process.
Security Requirements
All the features of the product are secured only privileged users are allowed to make
changes in the existing data. Critical type of entries like return of new items, changing
the sections of the system users, opening of new Heads, Categories, Items are assigned
to privileged users. Auto backup of the database is carried out in two different ways
like incremental and complete backup. This is achieved by privileged users. An item
which is required to be deleted is first copied into the backup database or table and then
removed from the database. An item which is deleted by a user, modified, returned, its
log information is stored i.e. name of the user, time and date of the manipulation from
which point of section.
20
3.4.1 Use cases and domain processes
A use case describes a process. A process describes from start to finish, all the events
in a sequence, actions, responses, transactions required to produce or complete
something by an actor.
Make Call
Call
Receive Call
Send SMS
Receive SMS
Message
Read SMS
Create Event
Event
Delete Event
User
Find Weather
Weather
Read Weather
21
Use Case: Start Application
Actors: Application Manager/Developer
Purpose: Start Application
To enter give information, category, items, sections.
TYPICAL COURSE OF EVENTS
2. The User starts the application. 3. A splash screen will be displayed with
animation and after that a main menu
screen.
4. The user speaks to open the sections 5. Menu Screen will be displayed from as
and sub sections. selected by the user appeared for the new
selected section in the application.
Start Application
User Fade in
Splash
22
Use Case: Entering Pre-Requisite Sections
1. This use case begins when a user wants 5. The user clicks one of the available
to enter in any section of the application. sections of application like phone,
contact, message, alarm, event and
weather.
3. The user speaks by clicking the mic in 6. A screen will be displayed with main
the center to enter the any specific menu sections.
or section.
4. User entered the new Section as per 7. Section will be displayed from as
click. selected by the user appeared for the new
selected section in the application.
Phone Section
Message
User
Weather
Event Section
23
USE CASE: PHONE SECTION
Actors: User
Purpose: Phone section will contain call log, make Call, receive call, end call
3. The user click on mic. 4. The user speak in mic to reach one
of the available sections as provided
by the application.
5.User makes the selection. Different 6. A menu appeared with call log,
types of more sections are available for make call, receive call, end call.
different selection to enter.
Phone Section
Make Call
24
Use Case: Weather
Actor: User
3. The user click the mic and speak 4. The user clicks Weather section
Weather to open Weather section. as provided by the application.
5. User is prompted to enter the next 6. Section will display the options to
part of the application if he wanted user weather he wants to know
to move and to learn more about the weather of current city or any other
application. city
Weather
Section
Find Weather
Section
User
Weather
25
Use Case: Message Section
Actor: User
Purpose: In message section the user can read message, send message,
delete message.
5. The user clicks Message section 6. The user can send new message,
as provided by the application. delete any previous message or the
application reads a message for user
on receiving.
Message Section
Send Message
User
Receive Message
26
Use Case: Event Section
Actor: User
3. The user click on the mic and 4. The user enters events section as
speak calendar. provided by the application.
5. User is prompted to enter the next 6. User save new event with song,
part of the application if he wanted delete any previously created event
to move and to learn more about the
application.
Event Section
Delete Event
27
Chapter 4
Design
4.1 Design
In systems design the design functions and operations are described in detail, including
screen layouts, process diagrams and other documentation. The output of this stage will
describe the new system as a collection of modules or subsystems.
Design elements describe the desired system features in detail, and generally include
functional hierarchy diagrams, screen layout diagrams, tables of process diagrams,
pseudo-code, and a complete entity-relationship diagram with a full data dictionary.
These design elements are intended to describe the system in sufficient detail, such that
skilled developers and engineers may develop and deliver the system with minimal
additional input design.
28
4.2 Design Constraints
We prefer this android studio framework 3.1.4 because everything is clear and it is easy
to use. Everyone can create any application on it easily, it is user friendly tool for
development of applications.
Android Studio is the official Integrated Development Environment (IDE) for Android
app development, based on IntelliJ IDEA [4]. Many features are available like fast and
feature rich emulator i.e. providing virtual devices for testing applications without the
need of an actual Android mobile device, flexible gradle based build system, instant run
function for pushing the new changes without creating new APK file, GitLab
integration, etc.
29
2. Calling service: The application should allow the users to make a call to the person
in the contacts or by saying mobile number of the person to whom user wants to call.
By giving a correct command with the calling request to a stored person, the Android
phone should successfully direct to the number of the person requested.[21]
Security:
Every one of the highlights of the item are verified just advantaged clients are permitted
to make changes in the current information. Basic sort of passages like return of new
things, changing the segments of the framework clients, opening of new Heads,
Categories, Items are doled out to special clients. Auto reinforcement of the database is
done in two unique ways like gradual and complete reinforcement. This is
accomplished by favored clients. A thing which is required to be erased is first
duplicated into the reinforcement database or table and afterward expelled from the
database. A thing which is erased by a client, adjusted, restored, its log data is put away
for example name of the client, time and date of the control from which purpose of
segment.
30
User gives the input into the form of voice; this voice command is recognized by the
application. Then action is performed as per the command given. Command given is
compared with the database.
Input is given by user in the form of voice. Using microphone, voice is converted in
binary. GoogleVoiceAPI will convert this voice data in text form and then the action is
performed according to the command given by the user by comparing with the database.
31
4.4.2 Process:
As activity diagram shows that user views this app then he/she must do follows as;
32
4.4.3 Physical
After the successful launch of application, the mic starts and it waits for user to speak,
when the mic receives the data it converts the data into the text format. The text is then
matched with the action which is to be performed. Action is performed.
4.4.4 Module:
Code is a group of characters and or digits that identify and describe something online
application. Codes serve many useful purposes. Because codes often are shorter than
the data they represent, they save storage space and costs, reduce transmission time,
and decrease data entry time. Finally, codes can reduce data input errors in situations
when the coded data is easier to remember and enter than the original source data, when
only certain valid codes are allowed, and when something within the code itself can
provide immediate verification then code is correct.
Because users must deal with the coded data, the coding methods must be acceptable
to them. Application analysts are frequently charge with analyzing and defining coding
schemes.
There are some major modules that are used in this application.
33
Graphical User Interface: It is utilized to connect with the client. GUI mirrors the
fundamental appearance of the application.
Voice Recognition: For astute voice right hand application is finished utilizing Google
Server. This procedure includes the transformation of acoustic discourse into a lot of
words and is performed by programming segment. Precision of discourse
acknowledgment frameworks vary in vocabulary size and confusability, methodology
of discourse (disengaged, spasmodic, or ceaseless discourse, read or unconstrained
discourse), assignment and language imperatives. The framework comprises of five
modules: include extraction, telephone model preparing, lexicon readiness, language
structure estimation, and sentence disentangling.
Text-To-Speech Engine: A content to-discourse (TTS) framework changes over
typical language content into discourse. Blended discourse can be made by linking bits
of recorded discourse that are put away in a database. The yield is given as discourse
Voice Input Manager: It deals with the order given by client. It sends the Input given
by client to the database director, Database Manager: It looks at Input given by client
that is as voice with the database which contains vocabulary of words. It sends reaction
to the activity entertainer.
Activity Performer: It takes reaction from the database administrator as Input and
chooses which activity ought to be performed. Activity can be as instant message or
call.
1. Instant message: Users can send the SMS to a particular individual in the phonebook
also by giving a right order which contains the informing demand catchphrases. The
message ought to be sent to the goal right away.
2. Calling administration: The application ought to enable the clients to make a call to
the individual in the contacts or by saying portable number of the individual to whom
client needs to call. By giving a right order with the calling solicitation to a put away
individual, the Android telephone ought to effectively direct to the quantity of the
individual mentioned.
34
4.5 Low Level Design
A class diagram is a static structure, it is used to give the structure of the system. The
structure of the whole system is described using different classes. The components of a
class are attributes, methods and the relationship between among them. A class diagram
is a box with three sections.
Figure 4.6 is the class diagram of the visually Impaired Audible Helpmate application.
The class diagram consists of all the major functionalities in its classes. The major
classes present in this application are: User class, message class, speech input class.
VIAH app
The above figure is the class outline of the Visually Impaired Audible Helpmate
application. The class chart comprises of all the significant functionalities in its classes.
The real classes present in this application are: User class, message class, discourse
input class. All these are reached out from the Base Activity which is given by Android
OS as a matter of course.
35
4.5.1 Entities
Call, Message, Weather and Events. It is also helpful for blind person to make a call,
send message, set an event.
All of these articles are categorized in various sections like: -
Sr.# Head Sections Sections Category Section Item
Sub-menus
36
4.5.2 Entity Diagrams
37
FIGURE 4.10: MESSAGE ACTIVITY
38
4.6 GUI Design
It is utilized to connect with the client. GUI mirrors the fundamental appearance of the
application. The following section gives the overview of the application’s user
interface. A user interface is where the user interacts with the application. It is used to
interact with the user. GUI reflects the basic appearance of the application. The overall
flow of the application and the modules will be explained in this section.
4.6.1 Splash Screen
The first screen that appears just after launching application is splash screen. This
splash screen appears for few seconds and then direct toward Home Screen.
39
4.6.2 Home Screen
The home screen is the second screen that the user visits upon opening of the
application. In this screen, the application features are provided as list of options to the
user. After opening the application, the speech recognition feature runs in the
background to hear the user’s voice about the option that has been selected.
40
4.6.3 Message
This message feature invoked when the user responds to speech recognition with the
word “Message” which runs in the background of home screen. In the below screen
user first say message in home screen then the message activity will open and ask the
user to speak phone number and message to be sent.
When the user speaks the number and message, it will be written in above screen, now
the application asks the user to click the screen and message will be sent to the receiver.
41
4.6.4 Call Service
The application should allow the users to make a call to the person in the contacts or by
saying mobile number of the person to whom user wants to call. By giving a correct
command with the calling request to a stored person, the Android phone should
successfully direct to the number of the person requested.
This Call feature invoked when the user responds to speech recognition with the word
“call” which runs in the background of home screen.
In the below screen user first say call in home screen then the call activity will open
and ask the user to speak phone number to make call.
42
4.6.5 Weather Service
This Weather feature invoked when the user responds to speech recognition with the
word “Weather” which runs in the background of home screen.
In the below screen user first say Weather in home screen then the Weather activity will
open and ask the user to speak city name to find weather and the user can listen the of
weather of any city.
43
4.6.6 Event Service
This Event feature invoked when the user responds to speech recognition with the word
“Event” which runs in the background of home screen.
In the below screen user first say Event in home screen then the Event activity will open
and ask the user to speak date and time to set event and event will set by user’s voice
command.
44
4.6.7 Event Delete Service
This Event feature invoked when the user responds to speech recognition with the word
“Delete Event” which runs in the background of home screen.
In the below screen user first say Event in home screen then the Event activity will open
and ask the user to speak date and time to delete event and event is deleted by user’s
voice command.
45
Chapter 5
System Implementation
5.1 System Architecture
Building of visual impaired audible helpmate Application Using Linux piece,
framework libraries, Android run time, application outline work, etc. five sections.
A. Linux Kernel
Android relies on Linux 2.6 version. It provides core services: security, memory management,
process management, network group, driven model. The core part is equivalent to a abstract
level between the hardware layer and other software in the systems. The center part is
comparable to a theoretical dimension between the equipment layer and other programming in
the frameworks. It gives center administrations: security, memory the executives, process the
board, organize gathering, driven model. The center part is comparable to a dynamic dimension
between the equipment layer and other programming in the frameworks. The middle part is
equivalent to a hypothetical measurement between the gear layer and other programming in the
systems.
B. Library and Android Runtime
Android includes a set of C/C++ libraries. Various components of Android system are us
functions are exposed to developers through the Android application framework. Android's
core libraries provide most of the function to the Java class libraries. Every Android application
runs in its own process, and enjoys the proprietary instance distributed by Dalvik virtual
machine, and support multiple virtual machines efficiently run on the same device. Android
incorporates a lot of C/C++ libraries. Different parts of Android framework are us capacities
are presented to designers through the Android application structure. Android's center libraries
give the vast majority of the capacity to the Java class libraries.
C. Application Framework
Upper core application program of Android system is on frame arrangement API development,
application Architecture can simplify component reuse mechanism. Any application can
publish its own features. These functions can be used to any other application (of course, it is
restricted from the framework constraints safety standards); and the same to reuse mechanism,
the framework supports component replacement. Upper center application program of Android
framework is on edge plan API improvement, application Architecture can rearrange part reuse
instrument. Any application can distribute its very own highlights. These capacities can be
utilized to some other application (obviously, it is confined from the structure imperatives
46
wellbeing principles); and the equivalent to reuse system, the structure underpins part
substitution.
D. Applications
Android applications are written in Java programming language. The Android SDK tools
compile the code along with any data and resource files—into an archive file with an .apk
suffix. All the code in a single .apk file is considered to be one application and is the file that
Android-powered devices use to install the application. The Android platform default includes
a set of core applications. It includes home, browser, communication services, contacts and
other applications. These applications are written by the Java programming language.
47
5.1.1 Setting Application Permissions and Libraries
Figure 5.2 shows the permissions that are set in the Android Manifest file. The
application needs permission of call phone, send message, create event. The application
also requires permission to read contacts, read message, and also read phone state.[20]
48
5.1.2 Consuming speech to text
Figure 5.3. shows the speech to Text method which is useful for fetching the data from
user and open activity that user wants. This method converts user’s voice into text
The below method is called right after the speech recognizer to send back the
recognized voice in string.
49
After recognizing user’s speech, conditions are used to match the voice commands from
user with our defined commands. These conditions are used to open any activity that
user wants to open. For example, if user say call, the call command converted into text
and then matched by application’s defined commands and then call activity will open.
50
5.1.3 Consuming text to speech
Text to speech uses OnInitListener and it has two methods onInit and onDestroy. Here only one
method is used as shown in figure.
Text to speech method is used to convert text into voice, we have used this method to
guide the user for performing different activities.
51
5.1.4 Speech Notifications
The speak method is used to provide notifications to the user through voice.
Figure 5.6 shows the speech commands notified to the user while saving the contact.
52
5.1.5 Make Call
The voice recognition method is used to provide the facility to make call to user
through voice. Figure 5.7 shows to make call through voice with this code.
53
5.1.6 Send Message
The voice recognition method is used to provide the facility to send message to user
through voice.
Figure 5.8 shows to send message through voice with this code.
54
5.1.7 Receive Message
In this method we receive the message from user and also listen that message which we
receive from the user with voice.
With this feature of “visual impaired audible helpmate Application” application
response us.
Figure 5.9 shows to send message through voice with this code.
After this listener a new method is called to check the phone number of the receiver to
check whether it is in contact list or not.
55
5.1.8 Check Weather
The voice recognition method is used to provide the facility to “check weather” to user
through voice.
Figure 5.11 shows to set weather through voice with this code.
56
5.1.9 Create Event
The voice recognition method is used to provide the facility to “Create Event” to user
through voice by using calendar.
Figure 5.12 shows to create event through voice with this code.
Firstly numbers i.e. date and year are matched and then months are matched with
applications defined commands.
57
After commands matching the event is created. Event is inserted into calendar
according time and date spoken by user. If any command speak by user is incorrect it
generates message “invalid Command”.
58
Chapter 6
6.1 Testing
Testing Software Testing is the process used to identify the completeness, correctness,
security and quality of the product being developed. Testing involves technical
investigation which is performed on behalf of end users. This is intended to reveal
quality related information about the product in a context in which it is intended to
operate. This is just not limited to the process of executing a program or application
with the intent of finding errors. Quality is not an absolute and never completely
establishes the correctness of computer software. The software testing is usually
performed for the following objectives: -
Software Quality improvement: - The computer and the software are mainly used for
complex and critical applications and a bug or fault in software causes severe losses.
So, a great consideration is required for checking for quality of software.
Verification and Validation: -Verification means to test that we are building the
product in right wayside. are we using the correct procedure for the development of
software so that it can meet the user requirements? Validation means to check whether
we are building the right product or not.
Software Reliability Estimation: - The objective is to discover the residual designing
errors before delivery to the customer. The failure data during process are taken down
in order to estimate the software reliability.
59
Audible Helpmate” system has been undergone system testing very carefully and the
system meets the desired outcome and performs well without effecting the operating
environment.
60
can be applied to virtually every level of software testing: unit, integration, system and
acceptance. It typically comprises most if not all higher-level testing, but can also
dominate unit testing as well. Specific knowledge of the application's code/internal
structure and programming knowledge in general is not required. The tester is aware of
what the software is supposed to do but is not aware of how it does it. For instance, the
tester is aware that a particular input returns a certain, invariable output but is not aware
of how the software produces the output in the first place.
61
Test Case
6.2.1 TC 1: SMS
TestCase
Test Case#:
#:1System: Designed by: Executed by: Test Case Name: SMS Send
Pre-conditions
The user has installed application.
The System displays main menu.
Post-conditions
The message sends to the receiver.
62
6.2.2 TC 2: Call
TestCase
Test Case#:
#:2System: Designed by: Executed by: Test Case Name: Make Call
Pre-conditions
The user has installed application.
The System displays main menu.
Post-conditions
The system make call to person the user wants.
63
6.2.3 TC 3: Create Event
TestCase
Test Case#:
#:3System: Designed by: Executed by:
Test Case Name: Create Event
Pre-conditions
The System displays main menu.
Post-conditions
The system create event on the date the user wants.
64
6.2.3 TC 4: Delete Event
TestCase
Test Case#:
#:4System: Designed by: Executed by:
Test Case Name: Delete Event
Pre-conditions
The System displays main menu.
Post-conditions
The system deletes previously created event.
65
6.2.3 TC 5: Weather
TestCase
Test Case#:
#:5System: Designed by: Executed by:
Test Case Name: Weather
Pre-conditions
The System displays main menu.
Post-conditions
The system display and speak weather of the city that user wants.
66
6.3 Application rating
The application developed is tested by five users. Figure shows the ratings that are
collected for the features such as: text extraction accuracy, ease of application usage
and voice recognition accuracy.
Application rating
67
6.4.1 Message and Call Permissions
When the user first clicks on microphone it requests user Call and Message permissions
for the first time to use the call and message features of phone as shown in figure 6.2.
68
6.5 System Processing
The following actions discusses the testing results of the application
69
6.5.2 Message Testing Results
To test the Message feature of application SMS actions are performed. Firstly, user say
in microphone Message and SMS activity will open then the user touch on screen and
a voice say to user that speak phone number and then message and then user speaks
phone number and message thus the user performs SMS activity. Similarly, when
someone sends message to the user a voice message reads message for user.
70
6.5.3 Event Testing Results
To test the Event feature of application Event actions are performed. Firstly, user say
in microphone Event and Event activity will open then the user touch on screen and a
voice say to user that speak date to create event and then user speaks date and title thus
the user performs Event activity.
71
6.5.4 Weather Testing Results
To test the Weather feature of application weather actions are performed. Firstly, user
say in microphone weather and weather activity will open then the user speaks city
name, the user listens the weather of required city.
72
Chapter 7
Conclusion
Conclusion
VIPs Audible Helpmate is an android application developed for visually impaired
people to assist them in their daily life mobile activities. The application is developed
with multiple features which can ease the visually impaired user to make use of the
features through voice commands. This project demonstrates the idea of messaging and
calling system for visually impaired people. It allows environmental barriers to be
removed for people with a wide range of disabilities. In this project we have presented
the system designs and use cases of the application “VIPs Audible Helpmate”. It is a
universal voice control assistant on Android operating system. The application provides
enhancements to all applications running on mobile system. VIPs Audible Helpmate
can benefit large number of users with universal eyes-free and hands-free voice control
of their mobile devices. it is the voice control application that provides enhancements
to all applications running on a mobile system by synthesizing commands set from on-
screen context. Secondly, it supports chaining of multiple commands in the same
utterance which enables more natural and seamless interaction experience. VIPs
Audible Helpmate can benefit large number of users with universal eyes free and
handsfree voice control of their mobile devices. Its framework may help to shape future
voice control devices. Speech recognition technology is a key technology which will
provide a new way of human interaction with machine or tools. The advantage of voice
commands over multi-touch when interacting with a screen non-visually is that it does
not require targets to be located and thus avoids the problems with pointing. It saves
time. This system provides the blind people with a function text to speech if they want
to receive contents of the document stored in a mobile. Android operating system-based
robot platform and smart phone operated control and monitoring system are introduced.
This provides ease of operation. As the system uses Smart phone so that the accuracy
is increased. The Reading of SMS can be possible by the blind people also.
73
References
1. Ahmed, I., and Singh, S. (2015) Aiml based voice enabled artificial intelligent
chatterbot. International Journal of u-and e-Service, Science and Technology.
2. Delux App Zone (2017, Dec), “VOICE CALL DIALER” android application.
https://play.google.com/store/apps.
3. E.S. Halpern (2001, Jun), “Human Factors and Voice Applications,”
VoiceXML Review.
4. Google Open Source Project. Talkback: An Open Source Screenreader for
android.https://partheniumprojects.com/voice-assistant-for-visually-impaired-
system/
5. Ideal Group, Inc. Android Development Team (2013), “Ideal Accessibility
Installer with platform access installer.
6. Jae Sung Cha, Dong Kyun Lim (2013, Jun),” Design and implementation of a
voice-based navigation for visually Impaired
peoples.https://neonprojects.com/voice-based-navigation-for-visually-
impaired/
7. Jagtap Nilesh, Bendre M.R(2014, Feb) “COEP Voice Based System in Desktop
and Mobile. https://www.emerald.com/insight/coep-voice-based-system-
desktop-content
8. J.A. Larson (2003, Oct), VoiceXML: Introduction to Developing Speech
Applications. https://www.researchgate.net/voice-speech-application-
publication
9. Jawahar (2017, Nov) Visually Impaired Application APIs for blind persons.
https://www.ijraset.com/-APIs-blind-person-fileserve
10. Kwang B. Lee (2006, Jul), “The Design and Development of User Interfaces
for Voice Application in Mobile Devices”.
11. M. A. Maziddi, (2008) AVR micro controller and Embedded Systems.
12. Marcos Brata, “Android based voice assistant for blind people” a simple
access to android gadget.
13. Mahendra K. Nivagune (2013, Feb), “Android Text Messaging application for
visually impaired people.
14. Nuance Communication (2013, Nov) “Dragon-Go” a voice recognition
application.
74
15. Raman T.V., Charles L. Chen (2011, May) Leveraging Android Accessibility
APIs to create an accessible experience.
16. Ryuichi Nisimura Jumpei Miyake (2008, Oct), “Speech-to-Text” input method
for web system Using Java script.
17. RT. World Health Organization. (2017). ‘Vision impairment and
blindness’2018 (accessed July 17, 2018).
18. RT. (2018, July) Coin Market API for crypto currency feature.
19. T.V. Raman, Casey Burkhardt (2014, April),” JustSpeak: Enabling Universal
Voice Control on Android.
20. Ravi Teja Neela (2018, Jun) Smart Assistant for VIP Android
Application.https://partcsimportprojects.com/smart-assistant-for-vip-android/
21. International Research Journal of Engineering and Technology (2017, Jan)
Smart Voice Assistant: a universal voice control solution for non-visual access
to the Android operating system.
22. Richard Diphode (2017, April) Be My Eyes android application.
https://www.researchgate.net/publication/315830657_Be_My_EyesAndroid_
App_for_visually_impaired_people
75