INFORMATION

THEORY
Prepared by:
Michael Angelo V. Infante
 Why speak about
information?
because when we have to
look at object, when we
evaluate and appreciate it,
the relation which
established between the
object and us is an exchange
of information.
 INFORMATION
• The communication or
reception of knowledge or
intelligence
(Merriam-Webster)
• It is stimuli that has meaning
in some context for its
receiver (techtarget)
 INFORMATION
• It is a perceived difference
that can make a difference
• It represents the
connection between the
observer and the observed
 INFORMATION
THEORY
It studies the
quantification, storage
and communication of
information.
Claude E. Shannon
Claude E. Shannon
American Mathematician
Electrical Engineer
Father of Digital Age
Father of Information
theory
 INFORMATION
THEORY
so what’s the purpose?
 Basic data
communication theory
that applies to technical
processes of encoding a
signal for transmission
and provides statistical
description of the
message produced by
the code.
 INFORMATION
THEORY
It was invented by
Claude Shannon
(1948) to solve
communication
problems
It focuses on how to
transmit data most
efficiently and
economically, and to
detect errors in its
transmission and
reception.
 The fundamental
problem that Shannon
define was the task of
reliable
communication over
an unreliable channel
Most of the time,
message is not
identical to
transmitted
messages
 So what is our
solution to a
reliable
communication?
Physical Solutions

Systems Solutions
 INFORMATION THEORY
Humans are symbol-
making creatures. We
communicate by symbols
– growls and grunts, hand
signals and drawings
painted on cave walls in
prehistoric times
INFORMATION THEORY
Today, we transmit
symbols, code digital
signals of voice graphics,
video and data around
the world at close to the
speed of light.
 PRINCIPLES OF
INFORMATION THEORY
Basic Elements of any general
communication systems:
1. Source of information
2. Means or channel
3. Receiving Device
4. Destination
5. Source of noise
 INFORMATION
A piece of information is considered
valueless if, after receiving it, things
remain unchanged.
-- businessdictionary.com