REPORT ON DEEP LEARNING

Dev Ranjan Raut-20scse1180165

Sarmistha Debnath-21scse1180027

Course Code: - CSAI3051

Course Name: - ANN & Deep Learning

Academic Year: -2021-22

Submitted to: Mr.Vipin Rai

1
 INTRODUCTION
Deep Learning is a subfield of machine learning concerned with algorithms inspired
by the structure and function of the brain called artificial neural networks. Deep
learning is a machine learning method that instructs computers to learn by doing
what comes naturally to people. Driverless cars use deep learning as a vital
technology to recognize stop signs and tell a pedestrian from a lamppost apart. It is
essential for voice control on consumer electronics including hands-free speakers,
tablets, TVs, and smartphones. Recently, deep learning has attracted a lot of interest,
and for good reason. It is producing outcomes that were previously unattainable.
Deep learning is a specialized form of machine learning. A machine learning
workflow starts with relevant features being manually extracted from images. The
features are then used to create a model that categorizes the objects in the image.
With a deep learning workflow, relevant features are automatically extracted from
images. In addition, deep learning performs “end-to-end learning” – where a
network is given raw data and a task to perform, such as classification, and it learns
how to do this automatically.

Deep learning algorithms scale with data, whereas shallow learning converges.
Shallow learning refers to machine learning methods that plateau at a certain level
of performance when you add more examples and training data to the network. A
key advantage of deep learning networks is that they often continue to improve as
the size of your data increases.

A computer model learns to carry out categorization tasks directly from images, text,
or sound using deep learning. Modern precision can be attained by deep learning
models, sometimes even outperforming human ability.
Artificial neural networks, also known as deep learning neural networks, try to
imitate the human brain using data inputs, weights, and bias. Together, these
components accurately identify, categorize, and characterize items in the data. Most
deep learning methods use neural network architectures, which is why deep learning
models are often referred to as deep neural networks.
The term “deep” usually refers to the number of hidden layers in the neural
network. Traditional neural networks only contain 2-3 hidden layers, while deep
networks can have as many as 150. Deep learning models are trained by using large
sets of labeled data and neural network architectures that learn features directly from
the data without the need for manual feature extraction.

2
Deep neural networks are made up of many layers of interconnected nodes, each of
which improves upon the prediction or categorization made by the one underneath
it. Forward propagation refers to the movement of calculations through the network.
A deep neural network's visible layers are its input and output layers. The deep
learning model ingests the data for processing in the input layer, and the final
prediction or classification is performed in the output layer.

Backpropagation is a different method that uses techniques like gradient descent to

calculate prediction errors before changing the function's weights and biases by
iteratively going back through the layers to train the model. A neural network can
make predictions and make necessary corrections for any faults thanks to forward
propagation and backpropagation working together. The algorithm continuously
improves in accuracy over time.

In the simplest terms possible, the summarizes the simplest kind of deep neural
network. To solve certain issues or datasets, there are various forms of neural
networks, but deep learning techniques are highly complex. For example,

 Convolutional neural networks (CNNs), used primarily in computer vision

and image classification applications, can detect features and patterns within
an image, enabling tasks, like object detection or recognition. In 2015, a
CNN bested a human in an object recognition challenge for the first time.
 Recurrent neural network (RNNs), are typically used in natural language
and speech recognition applications as it leverages sequential or times series
data.

One of the most popular types of deep neural networks is known as convolutional
neural networks (CNN or ConvNet). A CNN convolves learned features with input
3
data, and uses 2D convolutional layers, making this architecture well suited to
processing 2D data, such as images.

CNNs eliminate the need for manual feature extraction, so you do not need to
identify features used to classify images. The CNN works by extracting features
directly from images. The relevant features are not pretrained; they are learned while
the network trains on a collection of images. This automated feature extraction
makes deep learning models highly accurate for computer vision tasks such as object
classification.

FUTURE SCOPE

When thinking of technology, one cannot go without talking about deep learning.
Deep learning has become one of the most critical aspects of technology. Gone are
the days when organizations alone used to show interest in technologies like AI,
deep learning, machine learning, etc. Today, even individuals are inclined towards
the very aspect of technology, deep learning. One of the many reasons why deep
learning draws all the attention is because of its ability to enable improved data-
driven decisions and also improve the accuracy of the predictions made. In a
nutshell, companies can reap out various financial and operational benefits by virtue
of deep learning. With many deep learning innovations proliferating with time, it
makes every possible sense to have a clear picture as to how does the future of deep
learning looks like. In line with what we have seen over the past few years, this is
what we could expect in the coming days as far as deep learning is concerned –
 Even though deep learning is a little on the slower side when compared to
traditional AI and other machine learning algorithms, what one can stay
assured of is the fact that it is way more powerful as well as straightforward.
It is because of this that fields such as medicine, supply chain, robotics,
manufacturing, etc. would see immense usage of deep learning in the days
that lie ahead.

 A few years from now, it is very much possible that deep learning
development tools, libraries, and languages could become standard
components of every software development tool kit. These tool kits with
modern capabilities will pave the way for easy design, configuration, and
training of new models. With these capabilities, style transformation, auto-
tagging, music composition, etc. would be a lot easier to accomplish.

4
  The need for faster coding is at an all-time high. The future is all set to see the
deep learning developers adopting integrated, open, cloud-based development
environments that provide access to a wide range of off-the-shelf and
pluggable algorithm libraries.

 The prediction that neural architecture search would play a pivotal role in
building data sets for the deep learning models still stands strong.

 Global marketers have a positive mindset by virtue of Google’s acquisition of

DeepMind Technologies.

 It is highly likely that the deep learning networks would demystify computer
memory.

 Yet another point that is worth making a note of is the fact that the automation
of deep learning tools would mean that there’s an inherent risk that could
develop into something so complex that the average developers will find
themselves totally ignorant.

 Deep learning should be able to demonstrate learning from limited training

materials and transfer learning between contexts, continuous learning, and
adaptive capabilities. Wondering why. Well, just to remain useful.

What everything boils down to is the fact that as a result of the growing popularity
of deep learning and with the advancement in technology, by the end of this decade,
the deep learning industry will simplify its offerings considerably so that they’re
comprehensible and useful to the average developer.

APPLICATIONS
Real-world deep learning applications are a part of our daily lives, but in most cases,
they are so well-integrated into products and services that users are unaware of the
complex data processing that is taking place in the background. Some of these
examples include the following:

5
 1. Law enforcement:
Deep learning algorithms can analyze and learn from transactional data to identify
dangerous patterns that indicate possible fraudulent or criminal activity. Speech
recognition, computer vision, and other deep learning applications can improve the
efficiency and effectiveness of investigative analysis by extracting patterns and
evidence from sound and video recordings, images, and documents, which helps law
enforcement analyze large amounts of data more quickly and accurately.
2. Financial services:
Financial institutions regularly use predictive analytics to drive algorithmic trading
of stocks, assess business risks for loan approvals, detect fraud, and help manage
credit and investment portfolios for clients.
3. Customer service:
Many organizations incorporate deep learning technology into their customer
service processes. Chatbots—used in a variety of applications, services, and
customer service portals—are a straightforward form of AI. Traditional chatbots use
natural language and even visual recognition, commonly found in call center-like
menus. However, more sophisticated chatbot solutions attempt to determine,
through learning, if there are multiple responses to ambiguous questions. Based on
the responses it receives, the chatbot then tries to answer these questions directly or
route the conversation to a human user.
Virtual assistants like Apple's Siri, Amazon Alexa, or Google Assistant extends the
idea of a chatbot by enabling speech recognition functionality. This creates a new
method to engage users in a personalized way.
4. Healthcare:
The healthcare industry has benefited greatly from deep learning capabilities ever
since the digitization of hospital records and images. Image recognition applications
can support medical imaging specialists and radiologists, helping them analyze and
assess more images in less time.

6
 5. Entertainment:

Companies such as Netflix, Amazon, YouTube, and Spotify give relevant movies,
songs, and video recommendations to enhance their customer experience. This is all
thanks to Deep Learning. Based on a person’s browsing history, interest, and
behavior, online streaming companies give suggestions to help them make product
and service choices. Deep learning techniques are also used to add sound to silent
movies and generate subtitles automatically.
6. News Aggregation and Fake News Detection:
Deep Learning allows you to customize news depending on the readers’ persona.
You can aggregate and filter out news information as per social, geographical, and
economic parameters and the individual preferences of a reader. Neural Networks
help develop classifiers that can detect fake and biased news and remove it from
your feed. They also warn you of possible privacy breaches.
7. Composing Music:
A machine can learn the notes, structures, and patterns of music and start producing
music independently. Deep Learning-based generative models such as WaveNet can
be used to develop raw audio. Long Short-Term Memory Network helps to generate
music automatically. Music21 Python toolkit is used for computer-aided
musicology. It allows us to train a system to develop music by teaching music theory
fundamentals, generating music samples, and studying music.

7
 8. Image Coloring:

Image colorization has seen significant advancements using Deep Learning. Image
colorization is taking an input of a grayscale image and then producing an output of
a colorized image. ChromaGAN is an example of a picture colorization model. A
generative network is framed in an adversarial model that learns to colorize by
incorporating a perceptual and semantic understanding of both class distributions
and color.
9. Robotics:
Deep Learning is heavily used for building robots to perform human-like tasks.
Robots powered by Deep Learning use real-time updates to sense obstacles in their
path and pre-plan their journey instantly. It can be used to carry goods in hospitals,
factories, warehouses, inventory management, manufacturing products, etc.
Boston Dynamics robots react to people when someone pushes them around, they
can unload a dishwasher, get up when they fall, and do other tasks as well.

QUESTION
1. Explain deep learning, its future scope and its applications in detail?
2. Explain CNN and the role of CNN in deep learning?
3. How deep learning is differ from machine learning?