Scribd Logo
Upload

Welcome to Scribd!

  • 038 Hiveql-Orderby-Sortby-Clusterby-Q

    Uploaded by

    Pradeep Saraswat
    3 views1 page
    The document discusses the differences between ORDER BY, SORT BY, and CLUSTER BY in Hive SQL. ORDER BY sorts the final output of a query, SORT BY sorts data within a reducer but does not guarantee order of final output, and CLUSTER BY groups data by the specified column and ensures that operations on that column are performed on data within the same reducer.

    Original Description:

    Copyright

    © © All Rights Reserved

    Available Formats

    TXT, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document discusses the differences between ORDER BY, SORT BY, and CLUSTER BY in Hive SQL. ORDER BY sorts the final output of a query, SORT BY sorts data within a reducer but does not guarantee order of final output, and CLUSTER BY groups data by the specified column and ensures that operations on that column are performed on data within the same reducer.

    Copyright:

    © All Rights Reserved
    Download as TXT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as txt, pdf, or txt
    3 views1 page

    038 Hiveql-Orderby-Sortby-Clusterby-Q

    Uploaded by

    Pradeep Saraswat
    The document discusses the differences between ORDER BY, SORT BY, and CLUSTER BY in Hive SQL. ORDER BY sorts the final output of a query, SORT BY sorts data within a reducer but does not guarantee order of final output, and CLUSTER BY groups data by the specified column and ensures that operations on that column are performed on data within the same reducer.

    Copyright:

    © All Rights Reserved
    Download as TXT, PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as txt, pdf, or txt
    of 1

    /**************Hadoop In Real World**************/

    Hadoop In Real World *** http://www.hadoopinrealworld.com


    Hive - Order By vs. Sort By vs. Cluster By
    /**************Hadoop In Real World**************/

    hive> SELECT * FROM stocks


    ORDER BY price_close DESC;

    hive> SET mapreduce.job.reduces=3;

    hive> SELECT * FROM stocks


    ORDER BY price_close DESC;

    hive> SELECT ymd, symbol, price_close


    FROM stocks WHERE year(ymd) = '2003'
    SORT BY symbol ASC, price_close DESC;

    hive> INSERT OVERWRITE LOCAL DIRECTORY '/home/hirw/output/hive/stocks'


    ROW FORMAT DELIMITED FIELDS TERMINATED BY ','
    SELECT ymd, symbol, price_close
    FROM stocks WHERE year(ymd) = '2003'
    SORT BY symbol ASC, price_close DESC;

    hive> INSERT OVERWRITE LOCAL DIRECTORY '/home/hirw/output/hive/stocks'


    ROW FORMAT DELIMITED FIELDS TERMINATED BY ','
    SELECT ymd, symbol, price_close
    FROM stocks WHERE year(ymd) = '2003'
    DISTRIBUTE BY symbol
    SORT BY symbol ASC, price_close DESC;

    hive> SELECT ymd, symbol, price_close


    FROM stocks
    DISTRIBUTE BY symbol
    SORT BY symbol ASC;

    hive> INSERT OVERWRITE LOCAL DIRECTORY '/home/hirw/output/hive/stocks'


    ROW FORMAT DELIMITED FIELDS TERMINATED BY ','
    SELECT ymd, symbol, price_close
    FROM stocks
    CLUSTER BY symbol;

    You might also like