Lecture 1

Neural Networks
Overview
 Introduction to AI
 Artificial Neural Network
 Biological Neural Network
 Types of Neural Network
 ANN Applications
 ANN Advantages
 Shallow Neural Network
 What is AI?
Artificial intelligence means provide the ability of
think, Sense, decision making to machines.
AI, or Artificial Intelligence, is a field of computer
science that focuses on creating intelligent
machines capable of performing tasks that
typically require human intelligence. It involves
the development of algorithms and models that
enable machines to learn from data, recognize
patterns, make decisions, and solve problems.
 Motivation Behind Ai
 Nature has inspired us for inventions. Eg. Birds inspired us to fly.
 It seems only logical, then, to look at the brain’s architecture for
inspiration on how to build an intelligent machine. This is the key
idea that inspired artificial neural networks (ANNs).
 However, although planes were inspired by birds, they don’t have
to flap their wings.
 Similarly, ANNs have gradually become quite different from their
biological cousins.
 Some researchers even argue that we should drop the biological
analogy altogether (e.g., by saying “units” rather than “neurons”)
What is Artificial Neural Network?
 The term "Artificial Neural Network" is derived
from Biological neural networks that develop
the structure of a human brain.
 Similar to the human brain that has neurons

interconnected to one another;

 Artificial neural networks also have neurons

that are interconnected to one another in

various layers of the networks.
 These neurons are known as nodes.
Biological Neural NetworkDiagram
Working of BNN
 Dendrites − They are tree-like branches,
responsible for receiving the information from
other neurons it is connected to. In other sense,
we can say that they are like the ears of neuron.
 Cell Nucleus-It is the cell body of the neuron and
is responsible for processing of information, they
have received from dendrites.
 Axon − It is just like a cable through which
neurons send the information.
 Synapses − It is the connection between the axon
and other neuron dendrites.
ANN diagram
ANN VS BNN

Biological Neural Artificial Neural

Network Network

Dendrites Inputs

Cell nucleus Nodes

Synapse Weights

Axon Output
Types of Neural Networks
Neural Network types can be classified based on following
attributes:
1. Connection type:
 Static(feed forward)
 Dynamic(feedback)

2. Topology
 Single layer
 Multilayer
 Recurrent

3. Learning Methods
 Supervised
 Unsupervised
 reinforcement
Architecture of an artificial neural network:
Model of Artificial Neuron
Layers
Input Layer:
As the name suggests, it accepts inputs in several
different formats provided by the programmer.
Hidden Layer:
The hidden layer presents in-between input and
output layers. It performs all the calculations to find
hidden features and patterns.
Output Layer:
The input goes through a series of transformations
using the hidden layer, which finally results in
output that is conveyed using this layer.
Applications of ANN
 Image Recognition and Computer Vision
 Speech Recognition and Natural Language

Processing (NLP)
 Medical Diagnosis and Treatment Planning
 Recommender Systems
 Fraud Detection
ANN Advantages
Artificial Neural Networks (ANNs) offer several advantages, including:

1. Non-linearity: ANNs can model and learn non-linear relationships

between inputs and outputs. This enables them to capture complex
patterns and make accurate predictions in various domains, such as
image recognition, natural language processing, and financial
forecasting.

2. Adaptability and Learning: ANNs can adapt and learn from training
data, adjusting the weights and biases of the neurons to improve their
performance over time. This allows them to generalize from examples
and make predictions on unseen data.

3. Parallel Processing: ANNs can perform computations in parallel,

which makes them well-suited for tasks that require large-scale
processing, such as big data analysis and deep learning. This
parallelism can lead to significant speed improvements compared to
traditional serial computing.
4. Fault Tolerance and Robustness: ANNs are robust to noise
and can tolerate missing or incomplete data. They can still
provide meaningful outputs even in the presence of noisy or
corrupted input.

5. Distributed Representation: ANNs can encode information

in distributed representations across multiple neurons. This
allows them to capture and represent complex features and
concepts, facilitating hierarchical learning and abstraction.

6. Generalization: ANNs have the ability to generalize from

examples and make predictions on unseen data. This is
crucial for tasks such as classification and regression, where
the goal is to accurately predict outcomes for new, unseen
instances.
Shallow Neural Network
Shallow neural network has only one (or just a few)
hidden layers between the input and output layers.
The input layer receives the data, the hidden layer(s)
process it, and the final layer produces the output.
Shallow neural networks are simpler, more easily
trained, and have greater computational efficiency
than deep neural networks, which may have
thousands of hidden units in dozens of layers.
Shallow networks are typically used for simpler tasks
such as linear regression, binary classification, or
low-dimensional feature extraction. 
Thank you
Any query