Scribd Logo
Upload

Welcome to Scribd!

  • 4 views

    Null 1

    Uploaded by

    yedlaraghunath
    The document discusses different methods for manipulating columns in a PySpark DataFrame, including dropping columns, adding new columns using select and selectExpr, and using withColumn to add or modify columns with simple or complex expressions. The methods covered are: how to drop a column from a DataFrame, how to add a new column using select, how to add a new column using selectExpr, how to use withColumn, and how to use withColumn with complex expressions.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content

    You might also like

    Null 1

    Uploaded by

    yedlaraghunath
    4 views11 pages
    The document discusses different methods for manipulating columns in a PySpark DataFrame, including dropping columns, adding new columns using select and selectExpr, and using withColumn to add or modify columns with simple or complex expressions. The methods covered are: how to drop a column from a DataFrame, how to add a new column using select, how to add a new column using selectExpr, how to use withColumn, and how to use withColumn with complex expressions.

    Original Description:

    Dicc

    Original Title

    null-1

    Copyright

    © © All Rights Reserved

    Available Formats

    PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    Report this Document
    The document discusses different methods for manipulating columns in a PySpark DataFrame, including dropping columns, adding new columns using select and selectExpr, and using withColumn to add or modify columns with simple or complex expressions. The methods covered are: how to drop a column from a DataFrame, how to add a new column using select, how to add a new column using selectExpr, how to use withColumn, and how to use withColumn with complex expressions.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    4 views11 pages

    Null 1

    Uploaded by

    yedlaraghunath
    The document discusses different methods for manipulating columns in a PySpark DataFrame, including dropping columns, adding new columns using select and selectExpr, and using withColumn to add or modify columns with simple or complex expressions. The methods covered are: how to drop a column from a DataFrame, how to add a new column using select, how to add a new column using selectExpr, how to use withColumn, and how to use withColumn with complex expressions.

    Copyright:

    © All Rights Reserved
    Download as PDF, TXT or read online from Scribd
    Flag for inappropriate content
    Download as pdf or txt
    of 11

    PYSPARK LEARNING HUB : ARTICLE - 16

    WWW.LINKEDIN.COM/IN/AKASHMAHINDRAKAR
    PYSPARK LEARNING HUB : ARTICLE - 16

    Agenda :
    1. how to drop a column from a df
    2. how to add a new column using select
    3. how to add a new column using selectExpr
    4. how to use withcolumn
    5. how to use withColum with complex expression

    WWW.LINKEDIN.COM/IN/AKASHMAHINDRAKAR
    PYSPARK LEARNING HUB : ARTICLE - 16

    WWW.LINKEDIN.COM/IN/AKASHMAHINDRAKAR
    PYSPARK LEARNING HUB : ARTICLE - 16

    WWW.LINKEDIN.COM/IN/AKASHMAHINDRAKAR
    PYSPARK LEARNING HUB : ARTICLE - 16

    # HOW TO DROP A COLUMN FROM A DF

    WWW.LINKEDIN.COM/IN/AKASHMAHINDRAKAR
    PYSPARK LEARNING HUB : ARTICLE - 16

    # HOW TO ADD A NEW COLUMN USING


    SELECT

    WWW.LINKEDIN.COM/IN/AKASHMAHINDRAKAR
    PYSPARK LEARNING HUB : ARTICLE - 16

    # HOW TO ADD A NEW COLUMN USING


    SELECTEXPR

    WWW.LINKEDIN.COM/IN/AKASHMAHINDRAKAR
    PYSPARK LEARNING HUB : ARTICLE - 16

    WWW.LINKEDIN.COM/IN/AKASHMAHINDRAKAR
    PYSPARK LEARNING HUB : ARTICLE - 16

    WWW.LINKEDIN.COM/IN/AKASHMAHINDRAKAR
    PYSPARK LEARNING HUB : ARTICLE - 16

    #HOW TO USE WITHCOLUMN

    HOW TO USE WITHCOLUM WITH COMPLEX


    EXPRESSION

    WWW.LINKEDIN.COM/IN/AKASHMAHINDRAKAR
    PYSPARK LEARNING HUB : ARTICLE - 16

    WWW.LINKEDIN.COM/IN/AKASHMAHINDRAKAR

    You might also like