Moodify – An Emotion-Based Music Player
Siddiqui Mamoon
Dept. of Computer Engineering
M.H. Saboo Siddik Polytechnic
Byculla, Mumbai, India
siddiquimamoon2004@gmail.com
Waghoo Rehan
Dept. of Computer Engineering
M.H. Saboo Siddik Polytechnic
Byculla, Mumbai, India
waghoorehan03@gmail.com
Zaibunnisa L.H. Malik
Research Scholar, MCA Department
Sardar Patel Institute of Technology
Affiliated to Mumbai University
Mumbai, India
zebamalik@yahoo.com
Abstract- A user's emotion can be detected by
his/her facial expression. These expressions
can be derived from the system's camera's
live feed. Machine learning (ML) offers a
variety of strategies for detecting human
emotions. With our suggested system, a
music player that analyses emotions in real
time and recommends songs depending on
those emotions is constructed. This adds a
new feature to the conventional music player
apps that are already pre-installed on our
phones. Customer satisfaction is a significant
advantage of emotion detection. This
system's goal is to study the user's face,
foretell their feeling, and provide tunes that
fit that emotion.
Keywords: Machine Learning, Emotion
Detection
1. Introduction
Machine learning is extensively used in image
recognition, image processing, and particularly
facial expression recognition with the advent of
the information era. In the area of human-
computer interaction, face recognition has
emerged as a study hotspot, but there are still
Siddiqui Saad
Dept. of Computer Engineering
M.H. Saboo Siddik Polytechnic
Byculla, Mumbai, India
siddiquisaad529@gmail.com
Khobragade Ashish
Dept. of Computer Engineering
M.H. Saboo Siddik Polytechnic
Byculla, Mumbai, India
ashishkhobragade450@gmail.com
Salima Khatib
I/C HOD AN
M.H. Saboo Siddik Polytechnic
Byculla, Mumbai, India
khatibsalima@gmail.com
restrictions on how image processing results
can be used. Image research frequently focuses
on enhancing recognition accuracy, and the
image data lacks the use of secondary
processing, i.e., the image information has not
been fully and effectively utilized in the real
production and life process. An expression
detection model for convolutional neural
networks is created and trained using a deep
learning technique. When the outcomes of
image processing are combined with a music
recommendation algorithm, the music that best
suits the person's attitude is suggested. Major
music websites' playlists and manually
annotated tracks are crawled to generate music
data sets. The results of image processing have
a suitably broader range of applications.
2. Background and Motivation
2.1 Background
The muscles of the face can be moved in one or
more ways, or even positioned to convey a
facial expression. These motions communicate
a person's emotional state. Since a person has
control over his or her facial expression and can
choose how to express it, facial expression can
be chosen as a voluntary action.
The "Emotion Based Music Player" is a tool
designed to recognize a person's emotions and
play music selections in line with those
emotions. The person will first display his
feeling through his facial expression. The
device will then assess the facial expression's
state and interpret the mood from it. The music
player will play songs that can fit the person's
current mood after determining the person's
emotion. The system will only analyze facial
expressions; it won't take into account head or
face movement. In this work we have used
CNN in the beginning to get the required
trained model and predict user’s emotion. The
model is then used on android with including
the libraries like TensorFlow lite for prediction
from model [2].
2.2 Problem Statement and Motivation
Old-school music devices required the user to
actively peruse the selection and choose tracks
in accordance with his mood. Numerous audio
players have been created with features like
rapid forward, backward, variable playing
speed, local playback, streaming playback,
volume modulation, genre categorization, etc.
in the modern world due to the ever-increasing
developments in multimedia and technology.
These features might fulfill the user's
fundamental needs, but the user still has to
actively browse through the song playlist and
choose songs based on their attitude and
behavior at the time.
The main idea behind this initiative is to
automatically play music depending on the
user's emotions. It attempts to play music that
the user prefers based on the feelings found. In
the current system, the user must manually
select the songs because songs performed at
random may not suit the user's attitude. Instead,
the user must categorize the songs into different
emotions before manually selecting one to play.
An intelligent audio player should respond to
the user's tastes. Without requiring much effort
in song selection and reorganization, a music
device should assist users in instantly
organizing and playing the songs. All music
fans have access to a superior platform thanks
to the Emotion-Based Player, which automates
song selection and regularly updates play-lists.
Users can now arrange tracks according to their
emotions and play them.
3. Methodology
3.1 Mood Detection Module
● Face Detection
Face detection is an essential feature in
many mobile applications, such as social
media, security systems, and user
authentication. Face detection involves
locating and extracting facial features from
an image or video frame. We used the
OpenCV pre-trained model for face
detection and captured images from a
mobile device's camera.
We Chose a pre-trained machine learning
model for face detection, such as OpenCV
or TensorFlow Lite and Integrated the pre-
trained model into the Flutter application by
adding it as a dependency in the
pubspec.yaml file and importing it into the
Dart code. Use the pre-trained model to
detect faces in the captured image or video
frame by passing the image data through the
model and obtaining the location of the
detected faces.
● Emotion Detection / Model generation
Face detection and emotion detection are
essential features in many mobile
applications, such as social media, security
systems, and mental health apps.
We created Machine Learning Model for
emotion detection and modified the existing
face detection module in the Flutter
application to incorporate the additional
trained model for emotion detection by
importing the model and integrating it into
the existing code.
3.2 Diagram
● System Architecture
 Fig 1. System Architecture Design [1]
● Block Diagram

Fig 4. Expected O/P of Music Player

Fig 2. Block Diagram

4. Expected Result

Fig 5. Expected Result for Mood Selection

Fig 3. Expected Page for User Mood Selection
5. Future Scope
The project's primary goal is to identify feelings
and play the appropriate music in accordance
with those emotions. Future benchmarks
include expanding the database's size, adding
additional emotions for user ease, and
improving the accuracy of emotion detection.
The short-term objectives are to release
updates, improve the UI of the app, make it
more user-friendly, and add distinct music for a
better user experience.
6. Conclusion
This concept suggests an Android program that
plays music depending on emotions. The
application's goal is to make music
recommendations based on user feelings. Face
API is used to evaluate and categorize the
emotions. The application then recommends
the appropriate songs based on the user's
preference mode after taking into account the
user's mood. The app will suggest upbeat music
if the user chooses the positive option. In
contrast, because users want to express their
rage, sorrow, or tension, it will suggest tracks
with a bad tone. We intend to investigate
additional methods to get rid of the unregulated
environment attachment in order to enhance the
performance of the application. Additionally, in
order to accommodate the preferences of more
people, we intend to increase the music
database.
7. References
[1] Mahadik, Bharathi, Milgir, Kavathekar,
Patel, ©2021 “Mood based Music
Recommendation System”,
IJERTV10IS060253
[2] Azure.microsoft.com. (2019). Face API -
Facial Recognition Software — Microsoft
Azure. [online] Available at:
https://azure.microsoft.com/enus/services/cogn
itive-services/face/ [Accessed 4 Jan. 2020].