International Journal of

Information Technology,
Research and Applications
(IJITRA)

Rabin Joshi, Supriyo Kar, Abenezer Wondimu Bamud and Mahesh T R, (2023).
Personal A.I. Desktop Assistant, 2(2), 54-60.

ISSN: 2583 5343

DOI: 10.59461/ijitra.v2i2.58

The online version of this article can be found at:

https://www.ijitra.com/index.php/ijitra/issue/archive

Published by:
PRISMA Publications

IJITRA is an Open Access publication. It may be read, copied, and distributed free of charge according to the
conditions of the Creative Commons Attribution 4.0 International license.

International Journal of Information Technology, Research and Applications (IJITRA) is a journal that
publishes articles which contribute new theoretical results in all the areas of Computer Science,
Communication Network and Information Technology. Research paper and articles on Big Data, Machine
Learning, IOT, Blockchain, Network Security, Optical Integrated Circuits, and Artificial Intelligence are in
prime position.

https://www.prismapublications.com/

Journal homepage: https://ijitra.com

ISSN: 2583 5343 Int. J. of IT, Res. & App, Vol. 2, No. 2, June 2023: 54-60

Personal A.I. Desktop Assistant

Rabin Joshi, Supriyo Kar, Abenezer Wondimu Bamud and Mahesh T R
Department of Computer Science and Engineering, JAIN (Deemed-to-be University), Bengaluru, India

Article Info ABSTRACT

Early As we all know, how life is interlinked with the technology and the use
Article history: of AI. AI-powered voice assistants have become an integral part of our lives,
Received: May 31, 2023 intertwining technology and daily tasks. A Personal Virtual Assistant allows
a user to command or ask questions in the same manner that they would do
Accepted: June 03, 2023
with another human and are even capable of doing some basic tasks like
Published: June 22, 2023 opening apps, doing Wikipedia searches without opening a browser, playing
music etc, with just a voice command. This project presents the development
of a personal desktop assistant using Python, aiming to provide convenience,
automation, and assistance to users in their computer-related activities. The
Keywords: assistant incorporates features such as voice recognition, natural language
Voice assistant processing, and integration with external APIs to enhance its functionality and
Audio user experience.
The assistant differentiates itself from existing solutions by offering a highly
Voice recognition
customizable and extensible platform. Users can tailor the assistant's behavior
Web-browser and functionality to their specific needs, while also benefiting from integration
with popular tools and services. The user interface is designed to be intuitive
and user-friendly, providing a seamless experience for both novice and
experienced users. By creating a personal desktop assistant that combines
convenience, automation, and personalized features, this project aims to
enhance users' productivity and efficiency in their day-to-day computer tasks.
This is an open access article under the CC BY-SA license.

Corresponding Author:
Mahesh T R
Department of Computer Science and Engineering,
JAIN (Deemed-to-be University), Bengaluru, India

1. INTRODUCTION

As the A virtual assistant is a type of software program designed to understand and execute voice
commands given by users in natural language. This technology has become increasingly popular as it can
perform a wide range of tasks on your computer, such as checking the date and time, searching the web,
opening specific applications, and greeting you. These days, virtual assistant is being very useful to human
beings as it helps us to work on or operate a laptop or a PC on voice commands only and we can do a lot of
other computer-based things by the use of assistant. Virtual assistant helps us save our time. Virtual assistant
provides us the flexibility for a user to modify us functionalities. For creating virtual assistant for your
computer has to go from basics python to complex programming, accordingly. Virtual assistant has an ability
to understand and perform requests. Overall, virtual assistants offer a useful tool to streamline and enhance
computer-based activities, making it easier for individuals to interact with technology and achieve their daily
goals in a more efficient and natural way.

2. LITERATURE SURVEY

[1] Moustafa Elshafei believes that Virtual Personal Assistants (VPAs) represent the next step in
mobile and smart user network services. VPAs are designed to provide a wide range of information in
response to user requests, making it easier for users to manage their tasks and appointments, as well as control
phone calls using voice commands. One of the key features of VPAs is the task manager, which can be

Rabin Joshi, Supriyo Kar, Abenezer Wondimu Bamud and Mahesh T R. Personal A.I. Desktop Assistant 54
ISSN: 2583 5343 Int. J. of IT, Res. & App, Vol. 2, No. 2, June 2023: 54-60

accessed via voice interaction or logging in. This enables users to optimize their time management and
improve their overall performance by reducing distractions.

Overall, VPAs are a convenient and time-saving tool that enable users to access information and
complete tasks quickly and easily using only their voice. As technology continues to evolve, VPAs are
expected to become even more advanced and useful for a variety of tasks and applications.

[2] The article "On the track of Artificial Intelligence: Learning with Intelligent Personal Assistants"
by Nil Goksel and Mehmet Emin Mutlu explores how intelligent personal assistants (IPAs) can revolutionize
the way we learn and interact with information. They highlight the advanced computing technologies and
natural language processing (NLP) capabilities of IPAs that enable personalized and collaborative learning
experiences. The authors make a compelling case for the use of IPAs in education and training, emphasizing
their potential to transform how we acquire and interact with information.

[3-6] J.B. Allen et al have emphasized the significance of language and speech as a means of
communication, and the importance of speech technology in enabling machines to understand human speech.
Their study focuses on the identification of speech, its basic model, applications, and techniques for the
speech recognition system. The research highlights that speech recognition technology is growing in
importance and has diverse applications in different fields.

[6-10] B.S. Atal and L.R. Rabiner have conducted research on speech analysis, which involves a
pattern recognition technique for determining whether the voice input is voiced speech, unvoiced, or silence
based on signal dimensions. However, the system has limitations, such as the need for the algorithm to be
trained on the specific set of dimensions selected and for the recording conditions to be consistent.

3. METHODOLOGY

The proposed concept involves creating a personal voice assistant that can be easily implemented using a
speech recognition library. This library has many built-in functions that enable the voice assistant to
understand user commands and respond with voice output using Text-to-Speech functions [11-14]. When a
user gives a voice command, the voice assistant captures it and utilizes underlying algorithms to convert the
spoken words into text. By identifying keywords contained in the text, the assistant can determine the
appropriate action to take. This is made possible by the libraries and modules incorporated into the system.
In addition, the wizard can achieve all functionality using certain APIs [15-18]. We've used these APIs for
features like running calculations, getting news from web sources, and for other things. We will send the
request and through the API we will get the corresponding output.

Fig:3.1 Data Flow Diagram

3.1 Proposed Architecture

The system design includes:

-It will take input in the form of speech patterns using a microphone.
-It will recognize and convert the audio data into text format.
-It will compare the input with pre-defined commands.
-Finally, it will provide the desired output based on the input.

Rabin Joshi, Supriyo Kar, Abenezer Wondimu Bamud and Mahesh T R. Personal A.I. Desktop Assistant 55
ISSN: 2583 5343 Int. J. of IT, Res. & App, Vol. 2, No. 2, June 2023: 54-60

Fig 3.2: Processing in proposed system

3.2 Proposed Approach

The proposed system will have the functionalities mentioned below:

- The system will continuously listen for commands, and the duration for which it listens
can be adjusted based on the user's preferences and requirements [19-21]. The system provides
flexibility in changing the listening time to accommodate different user needs.
- The system can have either a male or female voice based on the user's preference [22-25].
- The current version of the system supports various features, including playing music,
accessing emails and texts, searching for information on Wikipedia and reading it loud, launching
applications installed on the system, opening web browsers, and more.

3.3 Working Model

The complexity of building a virtual assistant in Python can vary depending on the desired
functionality and level of detail. To create a simple virtual assistant with Python, certain libraries and modules
will be required.
- PYTTSX3: Pyttsx3 is a cross-platform text to speech library which is independent of
platforms. The main advantage of using this library is to convert text-to-speech which works offline
as well.
- Speech Recognition: The Speech Recognition feature in Python enables easy recognition
of speech from a microphone. It also allows the transcription of audio files and saving audio data
into a file.
- Web browser: The web browser module in Python provides a high-level interface for
controlling a web browser [26-32]. It allows users to display web-based documents conveniently
and interact with them programmatically.
- OS: The OS module in python gives you access to interfere with your OS such as opening
some desktop apps or playing music or movies from the pc.

4. EXECUTION

Fig 3.3: Execution

These elements play important roles in building a personal desktop assistant that can understand
voice input, make API calls, and generate spoken responses using text-to-speech conversion.

Rabin Joshi, Supriyo Kar, Abenezer Wondimu Bamud and Mahesh T R. Personal A.I. Desktop Assistant 56
ISSN: 2583 5343 Int. J. of IT, Res. & App, Vol. 2, No. 2, June 2023: 54-60

- Speech Recognition: This element involves capturing spoken words through a

microphone, converting them into digital data, and using speech recognition models to transcribe
the audio into text.
- Python Backend: The personal desktop assistant's entire program is implemented using
Python on the backend. Python provides a range of libraries and modules for speech recognition,
natural language processing, API calls, and more.
- API Calls: API calls allow the personal desktop assistant to interact with external services
or platforms. These calls can be made to fetch information, perform actions, or access data from
APIs of various services, such as weather data, news updates, or social media platforms.
- Google Text-to-Speech: Text-to-Speech (TTS) technology converts written text into
spoken words. Google Text-to-Speech, provided by Google, is a widely used service for generating
spoken output from text. It takes written text as input, synthesizes it into phonemic representation,
and produces sound in the form of waveform data.

By integrating these elements into your personal desktop assistant, you can enable voice input,
interact with external services through API calls, and generate spoken responses using text-to-speech
conversion

5. SCOPE

The goal of our project is to create a voice assistant that can help users efficiently perform various
tasks on their personal computers. The assistant will operate through voice commands, minimizing the need
for physical hardware. It will be able to open applications and websites, play media, tell the time and date,
and even greet users based on the current time. We are also working on integrating AI technology to make
the assistant more interactive and engaging for users. With a wide range of possible tasks that can be
programmed, the potential uses for the assistant are virtually limitless. As we continue to develop and improve
the system, we hope to make it a valuable tool for users to streamline their computer use and maximize
productivity.

6. CONCLUSION

Our virtual assistant is designed to fulfill a wide range of user commands, from opening specific
files on the system to browsing the web and gathering information. We have taken a straightforward approach
to solving this problem by utilizing Python. The assistant supports various user tasks, including web searches,
accessing YouTube videos, sending voicemails, and more. Moving forward, our aim is to enhance the project
by integrating artificial intelligence technologies such as machine learning and neural networks. Additionally,
we plan to explore the possibilities offered by the Internet of Things to further enhance the capabilities of our
voice assistant. By incorporating these advancements, we will be able to introduce new and exciting features
to our assistant.

7. REFERENCES

[1] T. R. M, Vinoth Kumar V, Lim S-J (2023) UsCoTc: Improved Collaborative Filtering (CFL)
recommendation methodology using user confidence, time context with impact factors for
performance enhancement. PLoS ONE 18(3): e0282904.
https://doi.org/10.1371/journal.pone.0282904

[2] Ramakrishna, M.T.; Venkatesan, V.K.; Bhardwaj, R.; Bhatia, S.; Rahmani, M.K.I.; Lashari, S.A.;
Alabdali, A.M. HCoF: Hybrid Collaborative Filtering Using Social and Semantic Suggestions for
Friend Recommendation. Electronics 2023, 12, 1365. https://doi.org/10.3390/electronics12061365

[3] K. Gunasekaran, V. Vinoth Kumar, A. C. Kaladevi, T. R. Mahesh, C. Rohith Bhat and K.

Venkatesan, "Smart Decision-making and Communication Strategy in Industrial Internet of Things,"
in IEEE Access, doi:10.1109/ACCESS.2023.3258407.

[4] Venkatesan, V.K.; Ramakrishna, M.T.; Izonin, I.; Tkachenko, R.; Havryliuk, M. Efficient Data
Preprocessing with Ensemble Machine Learning Technique for the Early Detection of Chronic
Kidney Disease. Appl. Sci. 2023, 13, 2885. https://doi.org/10.3390/app13052885

Rabin Joshi, Supriyo Kar, Abenezer Wondimu Bamud and Mahesh T R. Personal A.I. Desktop Assistant 57
ISSN: 2583 5343 Int. J. of IT, Res. & App, Vol. 2, No. 2, June 2023: 54-60

[5] K.A. Sharada, KSN Sushma, V. Muthukumaran, T.R. Mahesh, B. Swapna, S. Roopashree, High
ECG diagnosis rate using novel machine learning techniques with Distributed Arithmetic (DA)
based gated recurrent units, Microprocessors and Microsystems, Volume 98,2023,104796,ISSN
0141-9331, https://doi.org/10.1016/j.micpro.2023.104796

[6] Vishal Kumar Dhanraj, Lokesh kriplani, Semal Mahajan, ”Research Paper on Desktop Voice
Assistant” International Journal of Research in Engineering and Science, Volume 10 Issue 2,
February 2022

[7] Prof. Suresh V. Reddy, Chandresh Chhari, Prajwal Wakde, Nikhi Kamble, ”Review on Personal
Desktop Virtual Voice Assistant using Python” International Advanced Research Journal in Science,
Engineering and Technology, Vol. 9 Issue 2, February 2022.

[8] Vishal Kumar Dhanraj, Lokesh kriplani, Semal Mahajan, ”Research Paper on Desktop Voice
Assistant” International Journal of Research in Engineering and Science, Volume 10 Issue 2,
February 2022

[9] Venkatesan, V.K.; Ramakrishna, M.T.; Batyuk, A.; Barna, A.; Havrysh, B. High-Performance
Artificial Intelligence Recommendation of Quality Research Papers Using Effective Collaborative
Approach. Systems 2023, 11, 81. https://doi.org/10.3390/systems11020081

[10] Ramakrishna, M.T.; Venkatesan, V.K.; Izonin, I.; Havryliuk, M.; Bhat, C.R. Homogeneous
Adaboost Ensemble Machine Learning Algorithms with Reduced Entropy on Balanced Data.
Entropy 2023, 25, 245. https://doi.org/10.3390/e25020245

[11] D. Devarajan D Stalin Alex, T R Mahesh, Rajanikanth Aluvalu, V Vinoth Kumar, Uma Maheswari,
S Shitharth, "Cervical Cancer Diagnosis Using Intelligent Living Behaviour of Artificial Jellyfish
Optimized with Artificial Neural Network," in IEEE Access, 2022,
https://doi.org/10.1109/ACCESS.2022.3221451,

[12] A. Mallikarjuna Reddy, K. S. Reddy, M. Jayaram, N. Venkata Maha Lakshmi, Rajanikanth Aluvalu,
T. R. Mahesh, V. Vinoth Kumar, D. Stalin Alex, "An Efficient Multilevel Thresholding Scheme for
Heart Image Segmentation Using a Hybrid Generalized Adversarial Network", Journal of Sensors,
vol. 2022, Article ID 4093658, 11 pages, 2022. https://doi.org/10.1155/2022/4093658

[13] Venkatesan, V.K.; Izonin, I.; Periyasamy, J.; Indirajithu, A.; Batyuk, A.; Ramakrishna, M.T.
Incorporation of Energy Efficient Computational Strategies for Clustering and Routing in
Heterogeneous Networks of Smart City. Energies 2022, 15, 7524.
https://doi.org/10.3390/en15207524

[14] Bhargavi Mokashi, Vandana S. Bhat, Jagadeesh D. Pujari, S. Roopashree, T. R. Mahesh, D. Stalin
Alex, "Efficient Hybrid Blind Watermarking in DWT-DCT-SVD with Dual Biometric Features for
Images", Contrast Media & Molecular Imaging, vol. 2022, Article ID 2918126, 14 pages, 2022.
https://doi.org/10.1155/2022/2918126

[15] S. Roopashree, J. Anitha, T.R. Mahesh, V. Vinoth Kumar, Wattana Viriyasitavat, Amandeep Kaur,
An IoT based authentication system for therapeutic herbs measured by local descriptors using
machine learning approach, Measurement, Volume 200, 2022, 111484, ISSN 0263-2241,
https://doi.org/10.1016/j.measurement.2022.111484

[16] Mahesh, T. R., Kumar, D., Vinoth Kumar, V., Asghar, J., Mekcha Bazezew, B., Natarajan, R., &
Vivek, V. (2022). Blended Ensemble Learning Prediction Model for Strengthening Diagnosis and
Treatment of Chronic Diabetes Disease. Computational Intelligence and
Neuroscience, 2022.https://doi.org/10.1155/2022/4451792

[17] T. R. Mahesh, V. Dhilip Kumar, V. Vinoth Kumar, Junaid Asghar, Oana Geman, G. Arulkumaran,
N. Arun, "AdaBoost Ensemble Methods Using K-Fold Cross Validation for Survivability with the
Early Detection of Heart Disease", Computational Intelligence and Neuroscience, vol. 2022, Article

Rabin Joshi, Supriyo Kar, Abenezer Wondimu Bamud and Mahesh T R. Personal A.I. Desktop Assistant 58
ISSN: 2583 5343 Int. J. of IT, Res. & App, Vol. 2, No. 2, June 2023: 54-60

[18] T. R., M. ., V. . Kumar V., R. . Sivakami, I. Manimozhi, N. Krishnamoorthy, and B. Swapna. “Early
Predictive Model for Detection of Plant Leaf Diseases Using MobileNetV2
Architecture”. International Journal of Intelligent Systems and Applications in Engineering, vol. 11,
no. 2, Feb. 2023, pp. 46-54, https://ijisae.org/index.php/IJISAE/article/view/2594

[19] V. S., B. N. ., Kumar Bhagat, A. ., C., C. ., Sulaiman Alfurhood, B. ., Pratap Singh, A. ., & T. R.,
M. . (2023). Blockchain Based De-Duplication Analysis of Cloud Data with Data Integrity using
Policy Based Encryption Technique in Cloud Storage. International Journal of Intelligent Systems
and Applications in Engineering, 11(3s), 161–164. Retrieved from
https://ijisae.org/index.php/IJISAE/article/view/2555

[20] Awasthi, . M. A. ., T R, M. ., Joshi, D. R., Pandey, D. A. K. ., Saxena, . D. R. ., & Goswami, S. .

(2022). Smart Grid Sensor Monitoring Based on Deep Learning Technique with Control System
Management in Fault Detection. International Journal of Communication Networks and Information
Security (IJCNIS), 14(3), 123–137. https://doi.org/10.17762/ijcnis.v14i3.5600

[21] S. T. Ahmed, V. Kumar and J. Kim, "AITel: eHealth Augmented Intelligence based Telemedicine
Resource Recommendation Framework for IoT devices in Smart cities," in IEEE Internet of Things
Journal, doi: 10.1109/JIOT.2023.3243784.

[22] Yogendra Narayan Prajapati, U. Sesadri, Mahesh T. R., Shreyanth S., Ashish Oberoi, & Khel
Prakash Jayant. (2022). Machine Learning Algorithms in Big Data Analytics for Social Media Data
Based Sentimental Analysis. International Journal of Intelligent Systems and Applications in
Engineering, 10(2s), 264 –. Retrieved from https://ijisae.org/index.php/IJISAE/article/view/2397

[23] R, M. T. ., Goswami, T. ., Sriramulu, S. ., Sharma, N. ., Kumari, A. ., & Khekare, G. . (2022), .

Cognitive Based Attention Deficit Hyperactivity Disorder Detection with Ability Assessment Using
Auto Encoder Based Hidden Markov Model. International Journal of Communication Networks and
Information Security (IJCNIS), 14(2), 53–65. https://doi.org/10.17762/ijcnis.v14i2.5464

[24] Palanivinayagam, A., Kumar, V. V., Mahesh, T. R., Singh, K. K., & Singh, A. (2022). Machine
Learning-Based COVID-19 Classification Using E-Adopted CT Scans. International Journal of E-
Adoption (IJEA), 14(3), 1-16. http://doi.org/10.4018/IJEA.310001

[25] Mahesh, T.R., Vinoth Kumar, V., Vivek, V. et al. Early predictive model for breast cancer
classification using blended ensemble learning. Int J Syst Assur Eng Manag (2022).
https://doi.org/10.1007/s13198-022-01696-0

[26] Natarajan, R., Lokesh, G. H., Flammini, F., Premkumar, A., Venkatesan, V. K., & Gupta, S. K.
(2023). A Novel Framework on Security and Energy Enhancement Based on Internet of Medical
Things for Healthcare 5.0. Infrastructures, 8(2), 22.

[27] Muthukumaran, V., Vinoth Kumar, V., Joseph, R. B., Munirathnam, M., Beschi, I. S., & Niveditha,
V. R. (2022, November). Efficient Authenticated Key Agreement Protocol for Cloud-Based Internet
of Things. In International Conference on Innovative Computing and Communications: Proceedings
of ICICC 2022, Volume 3 (pp. 365-373). Singapore: Springer Nature Singapore.

[28] Vinoth Kumar, V., Wang, L., Chen, J. I. Z., Sikdar, B., & Nones, M. (2022). Guest editorial: Trends,
perspectives and prospects of sensor technologies in hydrological sciences. Acta Geophysica, 1-3.

[29] Saravanan, S., Kumar, V. V., Sarveshwaran, V., Indirajithu, A., Elangovan, D., & Allayear, S. M.
(2022). Computational and Mathematical Methods in Medicine Glioma Brain Tumor Detection and
Classification Using Convolutional Neural Network. Computational and Mathematical Methods in
Medicine, 2022.

[30] Ahmed, S. T., Kumar, V. V., Singh, K. K., Singh, A., Muthukumaran, V., & Gupta, D. (2022). 6G
enabled federated learning for secure IoMT resource recommendation and propagation analysis.
Computers and Electrical Engineering, 102, 108210.

Rabin Joshi, Supriyo Kar, Abenezer Wondimu Bamud and Mahesh T R. Personal A.I. Desktop Assistant 59
ISSN: 2583 5343 Int. J. of IT, Res. & App, Vol. 2, No. 2, June 2023: 54-60

[31] Reddy, K. H. K., Luhach, A. K., Kumar, V. V., Pratihar, S., Kumar, D., & Roy, D. S. (2022).
Towards energy efficient Smart city services: A software defined resource management scheme for
data centers. Sustainable Computing: Informatics and Systems, 35, 100776.

[32] Kumar, V. V., Sikdar, B., Katina, P. F., & Ansari, I. S. (2022). Editorial Preface: Special issue on
sustainable computing for cyber-physical systems. Sustainable Computing: Informatics and
Systems, 100733.

BIOGRAPHIES OF AUTHORS

Rabin Joshi is a Bachelor's student studying Bachelor of Technology at the Faculty of

Engineering and Technology, Jain (Deemed-to-be University), Bangalore. He has a passion
for technology and programming, particularly in Python. Their research paper focuses on
developing a personal desktop assistant using Python. With a strong background in software
development principles, they have participated in coding competitions and projects related
to natural language processing, machine learning, and user interface design. He stays
updated with the latest advancements in artificial intelligence and actively engages in online
programming communities. Their goal is to contribute to the progress of technology and
explore the potential of personal desktop assistants to simplify daily tasks and enhance
productivity.

Supriyo kar is a Bachelor's student studying Bachelor of Technology at the Faculty of

Engineering and Technology, Jain (Deemed-to-be University), Bangalore. He has a
passion for technology and programming, particularly in Python. Their research paper
focuses on developing a personal desktop assistant using Python. With a strong background
in software development principles, they have participated in coding competitions and
projects related to natural language processing, machine learning, and user interface design.
He stays updated with the latest advancements in artificial intelligence and actively engages
in online programming communities. Their goal is to contribute to the progress of
technology and explore the potential of personal desktop assistants to simplify daily tasks
and enhance productivity.

Abenezer Wondimu Bamud is a Bachelor's student studying Bachelor of Technology at

the Faculty of Engineering and Technology, Jain (Deemed-to-be University), Bangalore.
He has a strong interest in technology and programming, particularly in languages like
Python. This research paper focuses on creating a personal desktop assistant using Python.
With a passion for problem-solving. He has participated in coding competitions and
hackathons, gaining experience in natural language processing, machine learning, and user
interface design. They stay updated with advancements in artificial intelligence and actively
engage in online programming communities. He aims to contribute to technological
advancements and believes that personal desktop assistants can enhance productivity and
simplify daily tasks."

Rabin Joshi, Supriyo Kar, Abenezer Wondimu Bamud and Mahesh T R. Personal A.I. Desktop Assistant 60