DATA OPTIMISATION

Improving Information consistency for better big data

management

AJAY RATHI

New Natural resource

What is BIG DATA

Every day, we create 2.5 quintillion
bytes of data so much that 90%
of the data in the world today has
been created in the last two years
alone. This data comes from
everywhere:
sensors used to gather
information.

Cell phone GPS

signals to name a few.
Purchase
transaction records

Digital pictures and

videos
Posts to social
media sites

GARTNER HYPE CYCLE OF BIG DATA

GARTNER HYPE CYCLE OF IOT

The 4 Vs of Big data

Variabilit
y
Data is not
IMPORTANT, it is
what you do with it
is IMPORTANT

VALUE
Visualizati
on

Traditional Data Vs Big Data.

DATA LAKE

OUTCOME OF DATA LAKE

BIG DATA GOVERNANCE TRUTH Vs TRUST.

In God We
trust all other
bring data

TRADITIONAL Vs BIG DATA GOVERNANCE

WHY IS BIG DATA TRUST IMPORTANT

What Should be done --- Look for answers

Is the data
from a
transaction
that can be
audited and
proven?

Where did
the data
come from?

Is the profile
information
supplied by a
registered
user reliable?

Is the data an
intentional
fabrication?

Is the data
truth or
opinion?

is it
behavioral
data from a
data
aggregator?

What Should be done Three principals to start

with
Has the source (system, person or data stream)
proved to be reliable on previous occasions?
Chances are he/she/it will be again.
Do other sources point in the same direction?
Although it is unlikely that you'll get exactly the
same results when you triangulate, you may be
able to confirm a trend.
Have other users or uses found the data to be
useful? Try counting the effective popularity of data