NEURAL NTWORK AND DEEP LEARNING

KEY POINTS
PART A
1. What do you mean by neural network?
A neural network is a method in artificial intelligence that teaches computers to
process data in a way that is inspired by the human brain.

It is a type of machine learning process, called deep learning, that uses

interconnected nodes or neurons in a layered structure that resembles the human
brain.

2. What are different types of learning rules?

Types of Learning in Neural Networks

• Supervised Learning

• Unsupervised Learning and Reinforcement Learning

3. What is called Lyapunov function?

Definition.

A Lyapunov function for an autonomous dynamical system. with an equilibrium

point at is a scalar function that is continuous, has continuous first derivatives,
is strictly positive for and for which the time derivative is non positive.

4. What is the main purpose of hop field network?

Hopfield Networks are predominantly employed. They have uses in associative

memory, image recognition, mistake correction, and optimization issues.

5. what is the difference between the convolution neural network and fully
connected neural network?

Fully connected neural network

• A fully connected neural network consists of a series of

fully connected layers that connect every neuron in one layer to
every neuron in the other layer.
 • The major advantage of fully connected networks is that they
are “structure agnostic” i.e. there are no special assumptions
needed to be made about the input.

• While being structure agnostic makes fully connected networks

very broadly applicable, such networks do tend to have weaker
performance than special-purpose networks tuned to the
structure of a problem space.

CONVOLUTIONAL NEURAL NETWORK

• CNN architectures make the explicit assumption that the inputs are
images, which allows encoding certain properties into the model
architecture.
• A simple CNN is a sequence of layers, and every layer of a CNN
transforms one volume of activations to another through a
differentiable function. Three main types of layers are used to build
CNN architecture: Convolutional Layer, Pooling Layer, and Fully-
Connected Layer.

6. How is max pooling is used in CNN?

max pooling layers are placed after convolutional layers in a CNN. After a
convolutional layer extracts features from the input image, the max pooling
layer reduces the spatial size of the convolved feature map, keeping only the
most salient information.
7. What are the application of deep learning?

• Image recognition: To identify objects and features in images, such as

people, animals, places, etc.

• Natural language processing: To help understand the meaning of text,

such as in customer service chatbots and spam filters.

• Finance: To help analyze financial data and make predictions about

market trends

• Text to image: Convert text into images, such as in the Google Translate
app.

8. what do you mean by dropout?

Dropout refers to data, or noise, that's intentionally dropped from a neural

network to improve processing and time to results.

Dropout is a technique used in neural networks to improve model performance

and reduce overfitting.

9. Why RNN is used in deep learning?

RNNs have accelerated machine learning innovation: Extensive memory: RNNs

can remember previous inputs and outputs, and this ability is enhanced with the
help of LSTM networks. Greater accuracy: Because RNNs are able to learn
from past experiences, they can make accurate predictions.

10. What is the hyperparameters in autoencoders?

Here are 4 hyperparameters that we need to set before training an

autoencoder: Code size: It represents the number of nodes in the middle
layer. Smaller size results in more compression. Number of layers: The
autoencoder can consist of as many layers as we want,