Fraudulent Detection System
Using OpenCV and Deep Learning
Aishwarya Janardhan, Anushka Pandey, KM Nidhi, Aman Yadav
Department of Computer Science and Engineering, JSS Academy of Technical Education Noida
Abstract- Banks play an important role in the
economic stability of a country. They are
vulnerable to armed robbery where theft involves
use of lethal weapons to perpetrate violence
against a victim and obtain money. Banks have
installed surveillance services for security but
they are not very effective when it comes to
immediately alerting the police and taking action
before harm is inflicted. There is a lot of pressure
on law enforcement authorities to reduce the
chances of armed robbery by monitoring places
and engaging in patrols and stopping potential
offenders. So, there is a need to build an effective
system because crime techniques are improving
and surveillance techniques are not advanced.
I. Introduction
Bank intrusion can have a considerable impact on
the people involved such as the employees,
customers and police officials. We need a model
to assess the risk of bank robbery so that we can
reduce the impact on people and prioritize the
investments in security measures. First of all,
there has been an increase of financial
transactions in favour of the traditional trading
market. Providing good financial services is vital
and often these services are offered by the
banking industry. The link between banks and the
business world in today’s society makes the
banks a central part of the well-being of the
economy as a whole and a source of funding that
needs to be stable and reliable in order to create
incentive for businesses to invest with loans as a
source of funding. The central role that the bank
organization has in today’s society leads to the
issue that if the organization is not well prepared
for the crisis that faces them it will not only
affect the organization as such but also the
surrounding stakeholders. Another reason why
the banking sector is of interest is that when
looking at concepts such as stability, reliability
and trustworthiness, terms that often people
relate to the banking industry, you understand the
importance of good crisis management.
Traditionally people, as well as private
businesses trust the bank to take care of their
savings with the belief that the money will be
safe and secure. When this notion of stability
breaks down, in the event of a crisis, the
customers of the banks face the choice of
continuing to trust their bank or to find other
financial institutions to handle their funds.
Implementing a well working model for robbery
management plan will rebuild the confidence of
the stakeholders and bolster the opinion that the
bank is reliable and secure, minimizing the
perception of uncertainty that occurred during the
intrusion.
Humans glance at an image and instantly know
what objects are in the image, where they are,
and how they interact. Similarly, we need a
system that can look at an image and identify
objects such as helmet, gun and mask or pattern
to identify that there is a possible threat of bank
authorities within seconds so that they report to
the law enforcement authorities and ensure
safety, close all escape routes and catch the
intruder before any harm is caused. We can use
computer vision and deep learning to build this
model. Classical computer vision and machine
learning approaches for object detection usually
suffer from the slow response time. Modern
algorithms and architectures based on artificial
neural networks, such as the YOLO (You Only
Look Once) algorithm, solve this problem
without precision losses. In this paper we provide
a demonstration of the usage of the newest
YOLOv3 algorithm for the detection of bank
intrusion. We will train the network for 3 object
Fig1. Weapon detection using YOLO
classes (gun, mask and helmet) and demonstrate
the effectiveness of the approach in a variety of
conditions by training models by providing
thousands of images.

II. Object Detection

Object Detection is used to track the motion

trajectory of an object in a video. First, we use
the OpenCV's function, select ROI, to select an
object on a frame and track its motion using
built-in-tracker. Next, instead of using select
ROI, we use YOLO to detect an object in each
frame and track them by object centroid and size
comparison. Then we combine YOLO detection
with the OpenCV's built in tracker by detecting
the object in the first frame using YOLO and
tracking them using select ROI. The video
tracking is widely used in multiple purpose such
as: human computer interaction, security and
SurVivaLink, traffic control, medical imaging,
and so on.