Big Data

Living in I.T Era

 What is Big Data?

• Big data is a term that describes the large volume of

data – both structured and unstructured – that
inundates a business on a day-to-day basis.
• ‘Big Data’ is similar to ‘small data’, but bigger in size
• It cannot be processed effectively with the
traditional applications that exist. The processing of
Big Data begins with the raw data that isn’t
aggregated and is most often impossible to store in
the memory of a single computer.
 Examples of Big Data
• Walmart handles more than 1 million customer transactions
every hour.
• Facebook handles 40 billion photos from its user base.
• Decoding the human genome originally took 10years to
process; now it can be achieved in one week.
 Data Analytics

• Data Analytics: Data Analytics the science of

examining raw data with the purpose of drawing
conclusions about that information.
Characteristics
 Volume

The amount of data matters. With big data, you’ll have

to process high volumes of low-density, unstructured
data. This can be data of unknown value, such as
Twitter data feeds, clickstreams on a webpage or a
mobile app, or sensor-enabled equipment. For some
organizations, this might be tens of terabytes of data.
For others, it may be hundreds of petabytes.
 Velocity

• Velocity is the fast rate at which data is received and

(perhaps) acted on. Normally, the highest velocity of
data streams directly into memory versus being
written to disk. Some internet-enabled smart
products operate in real time or near real time and
will require real-time evaluation and action.
 Variety

• Variety refers to the many types of data that are

available. Traditional data types were structured and
fit neatly in a relational database. With the rise of big
data, data comes in new unstructured data types.
Unstructured and semistructured data types, such as
text, audio, and video require additional
preprocessing to derive meaning and support
metadata.
 Why Is Big Data Important?
• The importance of big data doesn’t revolve around how
much data you have, but what you do with it. You can
take data from any source and analyze it to find answers
that enable
1) cost reductions,
2) time reductions,
3) new product development and optimized offerings, and
4) smart decision making.
 Sources for Big Data

Streaming data Social media data Publicly available

• This category includes data • The data on social interactions is
that reaches your IT
systems from a web of
connected devices. You can
analyze this data as it
arrives and make decisions
on what data to keep, what
not to keep and what
requires further analysis.
• Massive amounts of data are
an increasingly attractive set of
information, particularly for
marketing, sales and support
functions. It's often in
unstructured or semistructured
forms, so it poses a unique
challenge when it comes to
consumption and analysis.
sources
available through open data
sources like the US
government’s data.gov, the CIA
World Factbook or the European
Union Open Data Portal.
Application of Big Data
Benefits of Big Data and Data
Analytics:
• Big data makes it possible for you to
gain more complete answers because
you have more information.
• More complete answers mean more
confidence in the data—which means a
completely different approach to
tackling problems.
Video for Big Data