Analyzing multiclass machine learning algorithms to find the effective depression detection method on textual social media posts
टे क्स्ट सोशल मीडिया पोस्ट पर प्रभावी डिप्रेशन डिटे क्शन मेथड खोजने के लिए मल्टीक्लास मशीन लर्निंग एल्गोरिदम का श्लेषण
Prakruti Rajendra Kothari (pkothari@gmu.edu) | Shikhar Bharat Jain (Sjain26@gmu.edu ) | Krushmi Madkaikar (Kmadakaik@gmu.edu ) |Avnit Singh Banga (abanga2@gmu.edu )
Research Question:- What are
different AI techniques that are
available to detect depression
effectively?
INTRODUCTION:
Depression (major depressive disorder) is a
widespread and significant medical condition
that has a negative impact on how you feel, think
and behave. Mental illness causes unhappiness or
a loss of interest in previously appreciated
activities. It can cause a slew of mental and
physical issues, as well as a reduction in your
capacity to operate in your daily life. Nowadays,
due to an increase in stress because of daily life
events, millions of people worldwide suffer from
depression. Symptoms of depression may range
from moderate to severe. Some of the symptoms
may include: sadness, more or no sleep, low self-
esteem, suicidal tendencies or death thoughts [1].
There are various factors which may lead to
depression some of them may include family
history, some traumatic events that may have
happen in past, brain structure disorder or due to
some medical conditions. It is increasing day by
day and sometimes it is hard to treat.  According
to Goldberg, D. [2] as depression increases, the
subjective to quality of life decreases. Therefore,
it is hard to treat. It is important to detect
depression at its earliest stage.
Fig 1. depicts symptoms of Depression
TEMPLATE DESIGN © 2008
www.PosterPresentations.com
करना।
Department of Information Systems, Data Analytics Engineering, College of Engineering and Computing
WHAT IS MACHINE LEARNING?
Machine learning is defined as a branch of
computer science which aims to predict future
patterns with the help of data and algorithms.
These algorithms try to learn from the data in the
same way which humans learn. Machine learning
is one the important growing field because data is
increasing exponentially. With the help of
machine learning decision making within
applications and business is possible. Machine
learning is divided into two categories
A)Supervised learning – Supervised learning is an
approach to build models with labelled datasets.
Examples: Regression, Classification
B) Unsupervised learning- Unsupervised learning
is an approach to build models with unlabeled
datasets.
Fig 1. Illustrates work flow of Machine
learning Algorithms
Comparison between Models For
Detecting Depression :
Naïve Bayes:
Naïve Bayes classifier is a probabilistic classifier
based on Bayes’ theorem, which assumes that
each feature makes an independent and equal
contribution. Naive Bayes theorem finds out the
conditional probability of an event given that
some other event has already occurred. According
to a study done by Mandar Deshpande & Vignesh
Rao (2017), multinomial Naïve Bayes was the
best machine learning technique to build a
depression detection system based on sentiment
analysis with an accuracy of 83%[1].
Support Vector Machine (SVM):
Support Vector Machine (SVM) Classifies the
input as one or the other of two categories SVM
can deal with both linear and non-linear
classification. SVM technique is used for detecting
outliers, regression and classification. The main
advantage of this method is to give high accuracy
even in higher dimensional spaces.
According to Bridianne O'Dea, S Stephen Wan,
Philip J. Batterham, Alison L. Calear, Cecile Paris &
Helen Christensen (2015) SVM is the best
machine learning technique with an accuracy of
76%[3]. But the research study by Xiaohui Tao ,
Oliver Chi, Patrick J. Delaney, Lin Li and Jiajin
Huang states that the SVM classifier has given
them an accuracy of 92.1%, F1 score of 95.8% and
a recall of 99%[4]. Moreover, a case study by
Mandar Deshpande & Vignesh Rao (2017) got an
accuracy of 79% [1].
XGBOOST (Extreme gradient
boosting):
XGBOOST is a type of decision tree which boosts
the process of classifying unstructured data,
predicting trends in large amounts of data, and
evaluating regression predictive models. It helps
to predict datasets of biomarkers in classifying
and diagnosing depression. This model has the
advantage of giving higher accuracy over the
other decision tree models. The implementation
of this algorithm is easy and cost effective.
XGBOOST is a better model over the single
machine learning algorithms such as SVM,
Logistic Regression. This model is ensemble
modelling where multiple algorithms run and
makes it error free therefore is robust. A
limitation of the algorithm is that it may not be
able to detect through genetics [5].
As XGBOOST is computationally less expensive
than the Neural Networks, it is a better
alternative for implementation and secondly, the
neural networks involve complex calculations and
it is not easy to interpret the model development
process in neural network model setup [].
The accuracy of the model is over 90% based on
the dataset [5].
Ensemble technique:
Ensemble model technique: Ensemble model
technique is a machine learning technique where
it combines multiple models to build a single
optimal predictive model. The main aim is to
overcome the limitations of the each model, when
it combines the weak models into one it produces
high quality results and has proved promising
accurate diagnosis. For example, GBM, KNN, RGF,
LR can be combined to make one model where it
will help overcome the constraints. According to
Xiaohui Tao, Oliver Chi, Patrick J. Delaney, Lin Li
& Jiajin Huang, ensemble methods have accuracy
of 95.4% and precision of 95.6% which is better
than single traditional techniques [4].
DISCUSSION:
Machine Learning techniques which is the
subfield of Artificial Intelligence can be applied to
examine the emotional states which help in
detecting depression. The research paper
introduces several machine learning techniques
to detect depression. After reviewing the methods
such as Naïve Bayes and Ensemble Techniques
provide higher accuracy than the other
techniques. However, Ensemble techniques is the
best as it outrages the accuracy of all the other
techniques. Clinicians should adopt these
methods to detect mental disorders rather than
using traditional methods. AI can definitely help
to facilitate to the process of diagnosing
depression. Although there is no comparison
between machine learning models and doctors
treating mental illness. In future, it is possible
that AI techniques can help detect depression
with the help of chatbots or trained bots which
will ease this tedious task. Chatbots can interact
with humans by engaging the users in mental
health interventions.
REFERENCES:
[1] M. Deshpande and V. Rao, “Depression detection using emotion artificial intelligence”, IEEE ICISS Palladam,
2017, ISBN:978-1-5386-1959-9
[2] Goldberg D. (2010). The detection and treatment of depression in the physically ill. World psychiatry : official
journal of the World Psychiatric Association (WPA), 9(1), 16–20. https://doi.org/10.1002/j.2051-
5545.2010.tb00256.x
[3] O'Dea, B, Wan, S, Batterham, P, Calear, A, Paris, C, & Christensen, H. (2015). Detecting suicidality on Twitter.
Internet Interventions, 2 (2). Doi: 10.1016/j.invent.2015.03.005.
[4] Tao, X., Chi, O., Delaney, P. J., Li, L., & Huang, J. (2021). Detecting depression using an ensemble classifier based
on Quality of Life scales. Brain informatics, 8(1), 2. https://doi.org/10.1186/s40708-021-00125-5.
[5] Sharma, Amita & Verbeke, Willem. (2020). Improving Diagnosis of Depression With XGBOOST Machine Learning
Model and a Large Biomarkers Dutch Dataset (n = 11,081). Frontiers in Big Data. 3. 10.3389/fdata.2020.00015