Multimodal Deep Learning Crime Prediction

Using Tweets

PRESENTED
GUIDED BY ,
Mr.Muhammed Jaseem N BY
Rohit Singh
AWH20CS04
8 S7 CSE

DEPT. OF COMPUTER SCIENCE AND ENGINEERING

AWH ENGINEERING COLLEGE
 CONTENTS
1) Introduction
2) Literature Survey
3) Multimodal Deep Learning Crime Prediction
Using Tweets
4) Working Principle
5) Conclusion
6) Future Scope
7) References

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

2
 INTRODUCTION
• Crime prediction is crucial for law enforcement, and
researchers are using data mining to improve it. Social media
data, like tweets, is a valuable source of information.

• Sentiment analysis, applied to data from platforms like Twitter,

helps identify public attitudes and emotions related to crime.

• It categorizes text as positive, negative, or neutral, aiding law

enforcement in resource allocation and early detection of
crime trends.

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

3
 • Additionally, data fusion could help the study to enhances
crime prediction by combining the data from various sources
including tweets and incidents.

• Machine learning algorithms have been utilized in crime

prediction to analyze crime data and predict future crime
patterns.

• Predictive policing that refers to using data and analytics to

inform law enforcement efforts and reduce crime.

• This study utilizes data fusion, sentiment analysis and

predictive policing to develop a deep learning model for real-
time crime prediction.

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

4
 LITERATURE SURVEY

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

5
 1. An Empirical Analysis of Machine Learning Algorithms for
Crime Prediction Using Stacked Generalization: An Ensemble
Approach

• Ensemble learning combines predictions from multiple

classifiers for better accuracy. Ensembles are more reliable
than single classifiers, but finding the right setup for a dataset
is still challenging.

• The Process aims to improve the crime prediction accuracy by

combining SVM and other base learners using ensemble
stacking techniques and addressing the limitations of
individual classifiers.

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

6
 • The model uses SVM(Support vector machine) as one of the
base classifiers which is used for classification and regression
tasks. It works by finding the optimal hyperplane that
separates different classes in a dataset.

• It also uses other classifiers like J48, SMO which works as an

algorithm helps in crime prediction by constructing a decision
tree based on historical crime data.

• The results also proved that any empirical data on crime, is

compatible with criminological theories. The proposed
approach also found to be useful for predicting possible crime
predictions.

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

7
 Advantages

• High Prediction Accuracy

• Efficiency
• Versatility

Disadvantages
• Data Size Limitations
• Complexity
• Future Scalability

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

8
 2. A Novel Multi-Module Approach to Predict Crime
Based on Multivariate Spatio-Temporal Data Using
Attention and Sequential Fusion Model

• Forecasting crime is complex due to the multitude of factors

involved and the high frequency of daily incidents across
various locations.

• The paper introduces an efficient multi-module approach for

crime prediction using deep learning techniques. It consists of
two modules: Feature Level Fusion and Decision Level
Fusion.

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

9
 • The first module employs temporal-based Attention LSTM and
Spatio-Temporal based Stacked Bidirectional LSTM.

• The second module uses Spatio-Temporal based Attention-

LSTM, Stacked Bidirectional LSTM, and the results from the
feature-level fusion module to make the final prediction.

• The proposed architecture predicts future crime occurrences

based on category, time, and location. It was primarily tested in
San Francisco and Chicago, showing impressive results with
low Mean Absolute Error and high Coefficient of
Determination.

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

10
 Advantages
• High Prediction Accuracy
• Effective Fusion Techniques
• Transfer Learning

Disadvantages
• Long Training Time
• Data Categorization

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

11
 3. Spatio-Temporal Crime Predictions by Leveraging
Artificial Intelligence for Citizens Security in Smart
Cities
• The rapid urbanization poses challenges in managing
resources, safety, and security in smart cities.

• This model presents a novel approach to enhance safety and

security in smart city environment by identifying and
predicting crime hot-spots.

• The proposed model is evaluated using ten years of crime data

from New York City (NYC) and outperforms other methods
with an average Mean Absolute Error

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

12
 • The approach combines Hierarchical Density-Based Spatial
Clustering (HDBSCAN) for hot-spot detection and Seasonal
Auto-Regressive Integrated Moving Average (SARIMA) for
crime prediction.

• The study detects dense crime regions through spatial

clustering, and then performs time series predictions for each
cluster to forecast crime incidents.

• In conclusion, the proposed model aims to address the safety

and security challenges in smart cities by identifying crime
hot-spots and predicting future crime incidents, offering an
improved predictive approach.

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

13
 Advantages
• Effective Crime Prediction
• Resource Allocation
• Improved Accuracy

Disadvantages
• Data Complexity
• Knowledge Transfer

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

14
 COMPARISON
Ref Methodology Advantages Disadvantages
.
No
1 Stack • High Prediction Accuracy • Data Size Limitations
Generalization • Future Scalability
: An Ensemble • Efficiency
Approach

2 Attention and • Effective Fusion • Long Training Time

Sequential Techniques
Fusion Model • Data Categorization
• Transfer Learning

3 By Leveraging AI • Resource Allocation • Data Complexity

For Citizens • Improved Accuracy
Securities • Knowledge Transfer

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

15
 Multimodal Deep Learning Crime Prediction
Using Tweets

• Cryptocurrencies have become a new means of investment in

place of stocks, and numerous cryptocurrency-based platforms
and software programs have been developed.

• Many previous studies have proven that the cryptocurrency

market is affected by textual data, such as Twitter tweets and
news headlines.

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

16
 • Therefore , this study proposes a Twitter sentiment analysis-
based adjustment method for the cryptocurrency action
recommendation model result.

• It is risky to accept the prediction when the probability that the

result of the action recommendation model for two classes is
the correct answer is approximately 51%.

• To solve this problem , a method for adjusting the result of the

action recommendation model based on Twitter sentiment
analysis is adopted.

05-10-2023 Multimodal Deep Learning Crime Prediction Using Tweet

17
 WORKING PRINCIPLE
• In this method two research approaches have been adopted.
Where , studies adopting the first approach directly predict the
future cryptocurrency price.

• Studies adopting the second approach recommend actions

to investors to maximize profits, such as ‘‘Sell’’, ‘‘Buy’’, and
‘‘Wait.’’ using classification models and results are derived
based on probabilities.

• Long short-term memory (LSTM) and gated recurrent unit

(GRU), which show high performance in time-series data, are
mainly used for this approach.

05-10-2023 Twitter Sentiment Analysis-Based Adjustment of Cryptocurrency Action Recommendation Model for Profit
18
Maximization
 • The action recommendation model was trained and
tested
using the collected cryptocurrency price data.

• Twitter tweets for BTC were collected by date and for better
sentiment analysis ,several pre-processing processes were
employed.

• After the pre-processing, positive tweets and negative tweets

on a specific date were analyzed through deep learning-based
sentiment analysis.

• The result of the action recommendation model derived

by
05-10-2023 dateTwitter
is determined byAdjustment
Sentiment Analysis-Based its probability
of Cryptocurrency Action Recommendation Model for Profit
19
Maximization
 OVERVIEW OF
APPROACH

05-10-2023 Twitter Sentiment Analysis-Based Adjustment of Cryptocurrency Action Recommendation Model for Profit
20
Maximization
 Accuracy of the proposed adjustment method according to the
threshold.
05-10-2023 Twitter Sentiment Analysis-Based Adjustment of Cryptocurrency Action Recommendation Model for Profit
21
Maximization
 Advantages

• Improved accuracy : F1 score were used as evaluation

methods, and a statistical technique called a t-test was also
used for a more systematic analysis of the results.

• Profit Maximization : This model's ability to fine-tune

predictions can help investors make more informed decisions,
potentially increasing their profitability in cryptocurrency
trading.

• Risk Mitigation : The model's improved accuracy and risk-

adjusted predictions can assist investors in making more
prudent choices, reducing the potential for losses.

05-10-2023 Twitter Sentiment Analysis-Based Adjustment of Cryptocurrency Action Recommendation Model for Profit
22
Maximization
Disadvantages

• Dependency on Social Media: The model relies heavily on

Twitter sentiment analysis, which means if Twitter sentiment
does not accurately reflect broader market sentiment or if there
is a bias in Twitter data, the model's predictions may be less
reliable.

• Generalization Challenges: While the model may perform

well in specific market conditions, it could face challenges
when market dynamics change.

Twitter Sentiment Analysis-Based Adjustment of Cryptocurrency Action Recommendation Model for Profit
Maximization
 CONCLUSION
• Each model presents its unique approach to Cryptocurrency
forecasting. Model 1 focuses on sparrow search algorithm,
Model 2 on reinforcement learning , and Model 3 on decision
tree and regression techniques.

• Twitter sentiment analysis based model is expected to

accurately recommend profit-maximizing actions to investors
trading cryptocurrencies.

• Furthermore, cryptocurrency is a core technology for NFT and

metaverse and therefore the proposed method can help predict
the price liquidity of cryptocurrencies within these ecosystems.

05-10-2023 Twitter Sentiment Analysis-Based Adjustment of Cryptocurrency Action Recommendation Model for Profit
24
Maximization
 FUTURE SCOPE
• The use of machine learning and sentiment analysis in
financial markets, including cryptocurrencies, is expected to
become more widespread.

• Financial institutions, traders, and investors may

increasingly rely on these models for decision-making.

• As research and technology advance, these models are likely

to become more accurate in predicting cryptocurrency prices.

• Better algorithms, larger datasets, and enhanced

feature
engineering can lead to more precise forecasts.
Twitter Sentiment Analysis-Based Adjustment of Cryptocurrency Action Recommendation Model for Profit
Maximization
 REFERENCES
[1] Jaehyun Park and Yeong-Seok Seo , “Twitter Sentiment Analysis-Based
Adjustment of Cryptocurrency Action Recommendation Model for Profit
Maximization” , IEEE 8 May 2023

[2] Xiaoxu Du , Zhenpeng Tang , Junchuan Wu , Kaijie Chen and Yi cai , “A New
Hybrid Cryptocurrency Returns Forecasting Method Based on Multiscale
Decomposition and an Optimized Extreme Learning Machine Using the
Sparrow Search Algorithm” , IEEE 22 May 2022

[3] Zainab Shahbazi and Yung-Cheol Byun , “Improving the Cryptocurrency Price
Prediction Performance Based on Reinforcement Learning ” , IEEE 6
December 2021

[4] Karunya Rathan , Somarouthu venket sai , Tubati Sai Manikanta , “Crypto-
Currency price prediction using Decision Tree and Regression techniques ” ,
IEEE 2019

05-10-2023 Twitter Sentiment Analysis-Based Adjustment of Cryptocurrency Action Recommendation Model for Profit
26
Maximization
 THANK
YOU

05-10-2023 Twitter Sentiment Analysis-Based Adjustment of Cryptocurrency Action Recommendation Model for Profit
27
Maximization