Download as pdf or txt
Download as pdf or txt
You are on page 1of 7

See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/356481274

Sentiment Analysis of Bangladesh-specific COVID-19 Tweets using Deep Neural


Network

Conference Paper · October 2021


DOI: 10.1109/ITMS52826.2021.9615331

CITATION READS
1 148

6 authors, including:

Muhammad Nazrul Islam Nafiz Imtiaz Khan


Military Institute of Science and Technology Military Institute of Science and Technology
157 PUBLICATIONS   1,345 CITATIONS    23 PUBLICATIONS   136 CITATIONS   

SEE PROFILE SEE PROFILE

Ayon Roy Md Mahbubar Rahman


Military Institute of Science and Technology Military Institute of Science and Technology
5 PUBLICATIONS   4 CITATIONS    7 PUBLICATIONS   152 CITATIONS   

SEE PROFILE SEE PROFILE

Some of the authors of this publication are also working on these related projects:

World IT Project View project

Predict Insomnia From Tweets View project

All content following this page was uploaded by Muhammad Nazrul Islam on 03 January 2022.

The user has requested enhancement of the downloaded file.


Sentiment Analysis of Bangladesh-specific
COVID-19 Tweets using Deep Neural Network
Muhammad Nazrul Islam1 , Nafiz Imtiaz Khan1 , Ayon Roy1 , MD. Mahbubar Rahman1 , Saddam Hossain Mukta2 ,
A. K. M. Najmul Islam3
1
Department of Computer Science and Engineering, Military Institute of Science and Technology,
Mirpur Cantonment, Dhaka-1216, Bangladesh
2
Department of Computer Science and Engineering, United International University
Badda, Dhaka - 1212, Bangladesh.
3
LUT School of Engineering Science, Lappeenranta, Finland
Email: nazrul@cse.mist.ac.bd, nafiz@cse.mist.ac.bd, royshouhag@gmail.com, mahbub@mist.ac.bd, saddam@cse.uiu.ac.bd,
a.k.m.najmul.islam@gmail.com

Abstract—Nowadays, social media became a tracker of the [9]. During the lockdown period, users’ sentiments may vary
COVID-19 disease which reflects the status of the COVID-19 among different nationalities due to the differences in social,
outbreak in the world. Although it is important to know the cultural, economic, religious, and psychological factors [10].
impact of COVID- 19 on the sentiment of mass people for the
government and the policymakers in order to address peoples’ In this study, we investigate the sentiments of mass people
needs and take emergent decisions during such crisis time, not in the Bangladeshi demographics by analyzing the COVID-19
many studies have been conducted regarding this issue. Moreover, tweets.
very few studies were conducted on sentiment analysis during Analyzing the public sentiment due to the pandemic has
the COVID-19 pandemic in the context of Bangladesh. The become a key concern for the researchers to explore different
purpose of this study is to estimate the impact of the COVID-19
outbreak on the sentiment of the Bangladeshi people through views of people related to education, businesses, and various
a machine learning approach. To achieve this goal, COVID-19 other social issues. For example, the sentiment of the students
tweets were collected over a specific period and then build a regarding online instructions due to quarantine caused by the
deep learning classifier, having an average area under the curve COVID-19 pandemic is analyzed through a questionnaire-
(AUC) of 0.76. The study analyzes the spread and estimates based survey [11]. The study found that 66.5% of the respon-
various public emotions during the outbreak. And reveals that
a significant number (55%) of people had negative sentiment dents were negative, 29.4% neutral and 4.1% had a positive
regarding COVID-19, whereas, 38% and 7% of people had sentiment towards the online instructions. In [12], conducted
positive and neutral sentiment respectively. This study also found a study using Twitter data related to the living environment,
that people’s involvement with social media increases as the social distancing, closure of the educational institutions, and
number of active COVID-19 cases increases. Moreover, this study local news. The latest topics of the COVID-19 related tweets
identified people’s sentiment towards some important concerns
regarding the COVID-19 pandemic. are labeled using Latent Dirichlet Allocation (LDA) [13]. The
Keywords—COVID-19, social media, coronavirus, sentiment study found that the percentage of positive COVID-19 tweets
analysis, pandemic, machine learning, Deep Neural Network is very low compared to negative tweets. Similarly, Alrazaq et
al. [14] identified the important topics posted by Twitter users
I. I NTRODUCTION related to the COVID-19 pandemic. They identified distinct
Coronavirus Disease (COVID-19) is a new disease that topics that include developing bio-weapons, deaths, fear, and
originated in the year 2019. Soon after the outbreak, this stress, and the likes. Again, Rajput et. al. [15] presented a
virus propagated all over the globe [1]. Most countries started statistical analysis of the Twitter messages related to COVID-
fighting with the COVID-19 pandemic by implementing na- 19 posted since January 2020. The study found the majority
tionwide lockdown [2]. The government of Bangladesh also of tweets as positive (90%) polarity as compared to negative
implemented a nationwide lockdown from March 26, 2020, (15%) polarity. A similar kind of study [16] is conducted in
to 04 April, 2020; and later the lockdown was extended in the Philippines to reveal the sentiment of the Filipinos due to
six phases till 30 May 2020 [3]. Prior literature suggests that quarantine.
people express thoughts, sentiments, emotions, frustrations, Several studies have been conducted in the earlier pan-
feelings, anxiety, and uncertainties with their family, friends, demic/epidemic, focusing on sentiment analysis using social
colleagues, and acquaintances on social media [4] [5] [6] [7]. media data. In [17], a survey was conducted to analyze the
Thus, social media becomes a great source for researchers to Canadian sentiment towards the safety of the H1N1 vaccine
investigate users’ sentiments by analyzing the online content, during the 2009 influenza pandemic. The study found that
i.e., news feeds, tweets, photos, etc. through the different 23.4% of the participants considered the vaccine safe, 41.4%
techniques of machine learning and artificial intelligence [8] thought it was unsafe and 35.2% reported ambivalence over its

978-1-6654-0615-4/21/$31.00 ©2021 IEEE ©2020 IEEE


safety. In Germany, a similar study [18] was conducted to mon-
itor knowledge, attitude, and behavior concerning the disease
and vaccination against H1N1 pandemic influenza. Similarly,
Andrew et al. [19] analyzed the public perceptions trends on
the vaccine and antiviral uptake in the UK considering the
Twitter-based data.
Thus the previous works highlighted that sentiment analysis
during the COVID-19 pandemic is a crucial and important
issue. Most of the studies have been focused on Twitter
data to analyze public sentiment, while the existing works
are primarily concerned with positive, neutral, and negative
sentiments. The outcome of the prior studies varied due to
the country context. The pandemic has a contextual effect
as the earlier work showed that pandemic does not spread
equally in different countries due to the variation in population
density, age group, the strength of mental health, and immunity Fig. 1: Proposed DNN-based sentiment analysis model
system [15] [16]. Indeed, a few studies [17] [18] [19] are
conducted from the perspective of a particular country, none of TABLE I: Performance of proposed classifier for different
the research has been conducted in the context of Bangladesh. sentiment labels
Moreover, many of the existing studies are conducted on Dataset Class Precision Recall f1-score
the available data right after starting the pandemic. Thus, Model on Negative 1.00 0.99 0.99
Training Neutral 0.98 1.00 0.99
prior studies did not focus to explore how the sentiment Dataset Positive 1.00 0.99 0.99
changes over time. Moreover, though a number of ICT based Average 0.993 0.993 0.99
initiatives have been taken to fight with COVID-19 pandemic Model on Negative 0.62 0.76 0.68
Test Neutral 0.42 0.19 0.26
in Bangladesh, but a little attention has been paid to understand Dataset Positive 0.62 0.58 0.60
the user-sentiment over social media regarding COVID-19 Average 0.553 0.51 0.54
pandemic [20] [21] [22]. In this research, we focus to address
these research gaps.
Therefore, this study has the following objectives. First, to Synthetic Minority Over-sampling Technique (SMOTE) was
prepare a sentiment dataset using Bangladeshi demographics used [23], which is an over-sampling procedure that is used
in the COVID-19 context. Second, to build a deep neural to eliminate the imbalance issues in the classes. The number
network (DNN) model by using a rigorously annotated dataset of positive, negative, and neutral tweets before the sampling
to predict users’ sentiment from their tweets. Third, to analyze were 677, 921, and 256 respectively; while the quantity of
the classified tweets to understand the dynamics of peoples’ these class labels after the sampling was 831.
sentiment regarding COVID-19. The model is trained for 100 epochs with a Batch Size
of 512, which ensures that each time a significant number of
II. B UILDING M ODEL instances remain in the training model. A train test split of 90-
In this section, the process of building the DNN model 10 was used in this study. The performance of the proposed
is described. The architecture of the proposed DNN model classifier is shown in Table I. It can be seen from table I that,
is shown in Figure 1. To build the model, a vector with average precision, recall, and f1-score for the train dataset were
continuous values generated by the USE encoder with the 0.993, 0.993, and 0.99, while the average precision, recall, and
dimensions of (512, 1) is computed. The vectorized tweets f1 score for the test dataset were 0.553, 0.51, and 0.54.
were the independent features, while annotated sentiment The ROC Curves for both the train as well as test dataset
labels are the dependent features of the model. Three different are shown in Figure 2 (a) and 2 (b) respectively. It can be
hidden layers, consisting of 256, 128, and 128 neurons, were seen from the ROC curves for the training dataset of negative,
used in model construction. The Input layer and Hidden neutral, and positive classes that each has an area of 1.00.
layers have a Dropout rate of 0.5, while Rectified Linear This indicates that the model accurately discriminates the three
Unit (ReLU) was used as the activation function. The output classes while training. The ROC curves for the test dataset
of the hidden layer is then forwarded to the Output layer show that the test dataset of the negative class has an area of
with 3 units (Positive, Negative, and Neutral), while SoftMax 0.70, the neutral class has an area of 0.67 and the positive class
was used as an activation function. The model was designed has an area of 0.72. Therefore, the model largely discriminates
with Categorical Cross Entropy as Loss function and Adam the three-class labels.
Optimizer as an optimization function.
In the prepared labeled dataset, the number of instances for III. ANALYSIS AND FINDINGS
each class label was not the same, which could make the model To explore how Bangladeshi people’s sentiment changes
biased towards a particular class. To handle the issue, the concerning time during the COVID-19 pandemic, we classified
(a) (b)
Fig. 2: ROC Curves for each epoch: (a) training data, (b) testing data

means the public viewed staying safe, staying home, and


maintaining quarantine as positive despite having different
thoughts/feelings about COVID- 19 and lockdown. These re-
sults indicate that people were in general positive with the idea
that they had to curb the spread of the virus by maintaining
proper health measures as well as social distancing. The words
“government”, “minister” also stood out in both the positive
and negative tweets. An important point to notice is that the
word “government” is much bigger in positive tweets than
in negative tweets. This means that most of the people’s
sentiment regarding government was positive. It can be seen
that the words “together”, “fight”, and “support” came in the
positive word cloud, which indicates that people were sure
that by being united and being supportive to each other, people
will be able to fight against COVID-19. Furthermore, it can be
seen that the country name “China” came in the negative word
cloud. Seemingly, people showed negative sentiment regarding
China.

B. Sentiment Timeline
Fig. 3: Most frequent words from all the tweets
1) General presentation with regards to time: We estimated
how the percentage of positive and negative tweets of people
the collected tweets using the DNN model. The analysis varied over time to time when a pandemic was ongoing. Day
result showed that 55% of the total tweets were classified as wise percentage of positive and negative tweets is plotted in
negative tweets whereas, 38% and 7% of tweets were classified Figure 5. From the graph, it can be interpreted that as days
as positive and neural tweets respectively. The analysis is pass on, negativity among people increases. For a developing
presented in detail in the following subsections. country like Bangladesh, it is very hard for many people to
manage the least amount of food to stay alive due to lockdown.
A. Frequently stated words That is the reason negativity among people increases as days
The most frequent ten words from all the tweets and their pass on during a pandemic. However, after a certain amount
number of occurrences in the dataset are plotted in Figure 3. of time, negativity slightly decreases, and positivity increases,
The word clouds are generated for positive, negative, neutral and after a significant amount of time, both positivity and
and all sentiments and are shown in Figure 4. However, in the negativity almost maintain a stable state. This can be inter-
word cloud, the size of each word indicates its frequency or preted that after a certain time people became habituated to
importance. the pandemic. Then again negativity slowly starts to increase
The mostly observed positive words were “stay home”, and positivity starts to decrease, which can be interlinked with
“stay safe”, and “quarantine” as shown in the word the rapid price hike, unemployment, domestic violence. As a
cloud generated for positive sentiments (see fig 4(a)). That result of these reasons, people’s sentiments turned negative.
(a) (b)

(c) (d)
Fig. 4: Word clouds: (a) word cloud for positive tweets, (b) word cloud for negative tweets, (c) word cloud for neutral tweets,
(d) word cloud for all tweets.

2) Before and after COVID-19 case in Bangladesh:


COVID-19 was confirmed to have spread in Bangladesh on 8th
March 2020. Since then there can be seen a rise in COVID-
19 related tweets. Month-wise public sentiment regarding
COVID-19 is plotted in Figure 6. If we observe the number of
month-wise COVID-19 related tweets, there can be observed
a major increase in the COVID-19 tweets in March, compared
to January and February (see Figure 6). Starting from March
onward, it can be seen that the number of COVID-19 cases
increased rapidly in Bangladesh [24], which is proportional to
the number of monthly tweets. From the month-wise public
sentiment graph (see Figure 6), it can be interpreted that the
month-wise number of pandemic-related tweets has a positive
relationship with the number of COVID-19 cases.

3) Before and after lockdown: The Bangladesh government


imposed a nationwide lockdown on March 26 [3], as a result,
there can be seen a rise in public concern during the end of
March in Figure 7, where the day-wise total number of tweets
is plotted. Seemingly, a large number of people expressed their
opinion regarding COVID-19 when the government imposed a
nationwide lockdown. Here we observed a mixed reaction of
people; many people showed positive sentiment towards the
Fig. 5: Public sentiment over time lockdown, they were in a hope that by ensuring a nationwide
lockdown, soon they can win the war against Coronavirus.
Fig. 6: Month wise public sentiment related to COVID-19 Fig. 7: Day wise public sentiment related to pandemic tweets

4) Comparison with the increased rate of confirmed cases:


By the first week of May, Bangladesh had seen a rapid
increase in the number of daily confirmed COVID-19 cases.
Concerning the rapid rise in the number of infected patients, a
spike in public concerns can also be noticed in the number of
daily tweets in Figure 7. If we compare this with the first week
when the lockdown was imposed, more public concerns can
be observed when daily infected cases started to rise rapidly.
From this, we can infer that most of the people were aware
of daily COVID-19 cases, but the high increase in the number
of infected patients drove them actively share their opinions
about COVID-19.
5) Sentiment against Important Concerns: To understand
the sentiment of people regarding few important issues
(words), each tweet is grouped in some specific categories
based on the presence of these words. The tweets and the
respective categories are plotted in Figure 8 where each of
the bars denotes a total number of positive, negative, and
neutral tweets. Except for the tweets containing the words
(e.g. vaccine, stay home and stay safe), other tweets have more Fig. 8: Public sentiment on important concerns
negative sentiment than positive sentiment (see Figure 8). The
results showed that people had positive sentiments regarding
the words, “vaccine”, “stay home” and “stay safe” whereas, hospitals refused to give treatment to COVID-19 patients due
people expressed negative sentiment regarding “epidemic”, to the lack of skilled health workers and treatment facilities
“hospital”, “lockdown”, “mask”, “outbreak”, and “quaran- for the COVID-19 patients. That created dissatisfaction in the
tine”. That indicates that the Bangladeshi people were very overall health care system of Bangladesh. Although people’s
much optimistic to win the fight against COVID-19. They sentiment was very positive when the lockdown was first im-
were very hopeful that by staying at home, people can stay posed, their sentiment turned towards negative as the lockdown
safe from this virus. People were also in hope that a vaccine was extended again and again. The words, “epidemic” and
will be soon developed. “outbreak”, show some positive sentiments. This result can be
The results showed that people expressed more negative sen- interpreted, for example by the fact that due to the nationwide
timent regarding the word “hospital”. In Bangladesh, during lockdown the air quality in Dhaka improved by more than 30
the early stage of COVID-19, most of the non-government percent [25]. Furthermore, the city of Dhaka observed reduced
traffic congestion, which has been a severe problem in the city [8] A. Zaman, M. N. Islam, T. Zaki, and M. S. Hossain, “Ict intervention
[26]. in the containment of the pandemic spread of covid-19: An exploratory
study,” arXiv preprint arXiv:2004.09888, 2020.
IV. CONCLUSION [9] M. N. Islam, T. T. Inan, S. Rafi, S. S. Akter, I. H. Sarker, and A. N. Islam,
“A systematic review on the use of ai and ml for fighting the covid-19
This study provides fourfold outcomes: firstly, a DNN pandemic,” IEEE Transactions on Artificial Intelligence, vol. 1, no. 3,
model with an average area under the curve (AUC) of 0.76 was pp. 258 – 270, 2021.
[10] M. M. Rahman and M. N. Islam, “Exploring the performance of
built to classify the tweets into positive, negative, and neutral ensemble machine learning classifiers for sentiment analysis of covid-19
sentiment. Secondly, it is shown that how public sentiment tweets,” in International Conference on Sentimental Analysis and Deep
regarding COVID-19 varies concerning time. Thirdly, a strong Learning (ICSADL 2021).
[11] C. K. L. Pastor, “Sentiment analysis on synchronous online delivery
correlation is shown between the numbers of daily COVID- of instruction due to extreme community quarantine in the philippines
19 infected cases with the number of daily tweets. Fourthly, caused by covid-19 pandemic,” Asian Journal of Multidisciplinary
public sentiment is grouped into several categories based Studies, vol. 3, no. 1, pp. 1–6, 2020.
[12] V. Duong, J. Luo, P. Pham, T. Yang, and Y. Wang, “The ivory tower lost:
on the presence of few sensitive words. It is identified that How college students respond differently than the general public to the
regarding the issues “stay safe”, “stay home”, and “vaccine” covid-19 pandemic,” in 2020 IEEE/ACM International Conference on
people had mostly positive sentiment whereas, people ex- Advances in Social Networks Analysis and Mining (ASONAM). IEEE,
2020, pp. 126–130.
pressed negative sentiment towards “epidemic”, “hospital”, [13] D. M. Blei, A. Y. Ng, and M. I. Jordan, “Latent dirichlet allocation,”
“lockdown”, “mask”, “outbreak” and “quarantine”. the Journal of machine Learning research, vol. 3, pp. 993–1022, 2003.
In our study, we did not consider the timeline when the [14] A. Abd-Alrazaq, D. Alhuwail, M. Househ, M. Hamdi, and Z. Shah,
“Top concerns of tweeters during the covid-19 pandemic: infoveillance
lockdown was lifted in Bangladesh. Also, only one social study,” Journal of medical Internet research, vol. 22, no. 4, p. e19016,
media platform was considered in this study. Moreover, only 2020.
one ML model (DNN) and one embedding method (USE) was [15] N. K. Rajput, B. A. Grover, and V. K. Rathi, “Word frequency and
sentiment analysis of twitter messages during coronavirus pandemic,”
used in this study. Future studies in the context of Bangladesh arXiv preprint arXiv:2004.03925, 2020.
shall be conducted on different social media platforms such [16] C. K. Pastor, “Sentiment analysis of filipinos and effects of extreme
as Facebook, Instagram, and YouTube, considering the post- community quarantine due to coronavirus (covid-19) pandemic,” Avail-
able at SSRN 3574385, 2020.
lockdown period by exploring different algorithms and em- [17] N. Seeman, C. Rizo et al., “Assessing and responding in real time
bedding methods. to online anti-vaccine sentiment during a flu pandemic.” Healthcare
The prior studies [11], [14], [22], [27], [28] were con- quarterly (Toronto, Ont.), vol. 13, pp. 8–15, 2010.
[18] D. Walter, M. M. Böhmer, S. Reiter, G. Krause, and O. Wichmann,
ducted to explore the public sentiment due to pandemics, “Risk perception and information-seeking behaviour during the 2009/10
but none of the studies particularly focused on the sentiment influenza a (h1n1) pdm09 pandemic in germany,” Eurosurveillance,
of Bangladeshi people. Moreover, it can also be observed vol. 17, no. 13, p. 20131, 2012.
[19] A. McNeill, P. R. Harris, and P. Briggs, “Twitter influence on uk
that most of the studies used publicly available datasets for vaccination and antiviral uptake during the 2009 h1n1 pandemic,”
building their sentiment analysis model, but no labeled social Frontiers in public health, vol. 4, p. 26, 2016.
media data can be found in the context of Bangladesh and [20] M. N. Islam and A. N. Islam, “A systematic review of the digital
interventions for fighting covid-19: the bangladesh perspective,” Ieee
COVID-19. Therefore, in this study, we tried to focus on Access, vol. 8, pp. 114 078–114 087, 2020.
the shortcomings by studying in the context of Bangladesh. [21] M. S. A. Pran, M. R. Bhuiyan, S. A. Hossain, and S. Abujar, “Analysis
Nonetheless, this experimental study and the performance of of bangladeshi people’s emotion during covid-19 in social media using
deep learning,” in 2020 11th International Conference on Computing,
the proposed classifier showed the efficacy of our approach. Communication and Networking Technologies (ICCCNT). IEEE, 2020,
pp. 1–6.
R EFERENCES [22] M. N. Islam, N. I. Khan, and T. Mahmud, “Covid-19 and black fungus:
[1] M. Ciotti, M. Ciccozzi, A. Terrinoni, W.-C. Jiang, C.-B. Wang, and Analysis of the public perceptions through machine learning,” medRxiv,
S. Bernardini, “The covid-19 pandemic,” Critical reviews in clinical 2021.
laboratory sciences, vol. 57, no. 6, pp. 365–388, 2020. [23] N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, “Smote:
[2] V. Alfano and S. Ercolano, “The efficacy of lockdown against covid-19: synthetic minority over-sampling technique,” Journal of artificial intel-
a cross-country panel analysis,” Applied health economics and health ligence research, vol. 16, pp. 321–357, 2002.
policy, vol. 18, pp. 509–517, 2020. [24] M. A. Hossain, M. I. K. Jahid, K. M. A. Hossain, L. M. Walton,
[3] M. Z. Ela, T. A. Shohel, L. Khan, N. Jahan, M. T. Hossain, M. N. Islam Z. Uddin, M. O. Haque, M. F. Kabir, S. Y. Arafat, M. Sakel, R. Faruqui
et al., “Prolonged lockdown and academic uncertainties in bangladesh: A et al., “Knowledge, attitudes, and fear of covid-19 during the rapid rise
qualitative investigation during the covid-19 pandemic,” Heliyon, vol. 7, period in bangladesh,” PloS one, vol. 15, no. 9, p. e0239646, 2020.
no. 2, p. e06263, 2021. [25] M. S. Islam and T. A. Chowdhury, “Effect of covid-19 pandemic-induced
[4] A. Agarwal, B. Xie, I. Vovsha, O. Rambow, and R. J. Passonneau, lockdown (general holiday) on air quality of dhaka city,” Environmental
“Sentiment analysis of twitter data,” in Proceedings of the workshop Monitoring and Assessment, vol. 193, no. 6, pp. 1–16, 2021.
on language in social media (LSM 2011), 2011, pp. 30–38. [26] N. M. Zafri, S. Afroj, and M. A. Ali, “Effectiveness of containment
[5] M. Thelwall, K. Buckley, and G. Paltoglou, “Sentiment in twitter strategies to control vehicular traffic on roads in dhaka, bangladesh
events,” Journal of the American Society for Information Science and during covid-19 pandemic: use of google map based real-time traffic
Technology, vol. 62, no. 2, pp. 406–418, 2011. data,” Bangladesh during COVID-19 Pandemic: Use of Google Map
[6] S. Laato, A. N. Islam, M. N. Islam, and E. Whelan, “What drives Based Real-Time Traffic Data (June 20, 2020), 2020.
unverified information sharing and cyberchondria during the covid-19 [27] B. P. Pokharel, “Twitter sentiment analysis during covid-19 outbreak in
pandemic?” European Journal of Information Systems, vol. 29, no. 3, nepal,” Available at SSRN 3624719, 2020.
pp. 288–305, 2020. [28] A. Ahmed, M. S. H. Mukta, F. Muntasir, S. Rahman, A. N. Islam, and
[7] S. Laato, A. Islam, M. N. Islam, and E. Whelan, “Why do people M. E. Ali, “Can covid-19 change the big5 personality traits of healthcare
share misinformation during the covid-19 pandemic?” arXiv preprint workers?” in 7th International Conference on Networking, Systems and
arXiv:2004.09600, 2020. Security, 2020, pp. 12–17.

View publication stats

You might also like