Scribd Logo
Upload

Welcome to Scribd!

  • Lec 5 & 6 - Hadoop

    Uploaded by

    Bushra Zainab
    15 views43 pages
    The document discusses Hadoop, an open-source framework for distributed storage and processing of large datasets across clusters of commodity hardware. It provides an overview of Hadoop's history and ecosystem, including core components like HDFS, YARN, MapReduce, Pig, Hive, Mahout, Spark, HBase, Drill, Oozie, Flume, Sqoop, Solr, Lucene, ZooKeeper and Ambari. The presentation aims to introduce these Hadoop ecosystem projects and how they enable processing and analyzing large datasets in distributed systems.

    Original Description:

    Original Title

    Lec 5 & 6- Hadoop

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document discusses Hadoop, an open-source framework for distributed storage and processing of large datasets across clusters of commodity hardware. It provides an overview of Hadoop's history and ecosystem, including core components like HDFS, YARN, MapReduce, Pig, Hive, Mahout, Spark, HBase, Drill, Oozie, Flume, Sqoop, Solr, Lucene, ZooKeeper and Ambari. The presentation aims to introduce these Hadoop ecosystem projects and how they enable processing and analyzing large datasets in distributed systems.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    15 views43 pages

    Lec 5 & 6 - Hadoop

    Uploaded by

    Bushra Zainab
    The document discusses Hadoop, an open-source framework for distributed storage and processing of large datasets across clusters of commodity hardware. It provides an overview of Hadoop's history and ecosystem, including core components like HDFS, YARN, MapReduce, Pig, Hive, Mahout, Spark, HBase, Drill, Oozie, Flume, Sqoop, Solr, Lucene, ZooKeeper and Ambari. The presentation aims to introduce these Hadoop ecosystem projects and how they enable processing and analyzing large datasets in distributed systems.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    of 43

    Dr Muhammad Rashid Hussain, PhD

    Agenda
    • What is Hadoop
    • Brief History on Hadoop
    • Hadoop EcoSystem
    • Hadoop Vendors
    • Intro of each Hadoop Ecosystem

    2
    Hadoop ???

    3
    Hadoop ???

    4
    Hadoop ???

    5
    Hadoop ???

    6
    Hadoop - Technology

    7
    Need of Hadoop

    8
    Need - Hadoop

    9
    Hadoop - Need

    10
    Hadoop - Need

    11
    Hadoop

    12
    Hadoop

    13
    Hadoop

    14
    Hadoop

    15
    Hadoop

    16
    Hadoop - Framework

    17
    Hadoop - Architecture

    18
    Hadoop

    19
    Hadoop

    20
    Hadoop

    21
    Hadoop Ecosystem

    22
    Hadoop

    23
    Hadoop

    24
    Hadoop Ecosystem

    25
    Hadoop Ecosystem

    26
    Hadoop Ecosystem - HDFS

    27
    Hadoop Ecosystem – YARN

    28
    Hadoop Ecosystem – Map Reduce
    Data Processing using Programming

    29
    Hadoop Ecosystem – PIG
    Data Processing using Query

    30
    Hadoop Ecosystem – HIVE

    31
    Hadoop Ecosystem – MAHOUT
    Machine Learning

    32
    Hadoop Ecosystem – Spark
    In Memory Data Processing

    33
    Hadoop Ecosystem – Spark
    In Memory Data Processing

    34
    Hadoop Ecosystem – HBASE
    NO Sql DataBase

    35
    Hadoop Ecosystem – Drill
    Sql on Hadoop

    36
    Hadoop Ecosystem – OOZIE
    Job Schedular

    37
    Hadoop Ecosystem – Flume
    Data Ingesting Servive

    38
    Hadoop Ecosystem – Sqoop
    Data Ingesting Servive

    39
    Hadoop Ecosystem – Solr & Lucene

    40
    Hadoop Ecosystem – ZooKeeper
    Coordinator

    41
    Hadoop Ecosystem – Ambari
    Cluster Manager

    42
    THANK YOU

    43

    You might also like