pyspark dropna in one column

Fancy Flamingo answered on July 18, 2021 Popularity 9/10 Helpfulness 6/10

answer pyspark dropna in one column

pyspark dropna in one column

Comment

ou can use Column.isNull / Column.isNotNull:

df.where(col("dt_mvmt").isNull())

df.where(col("dt_mvmt").isNotNull())
If you want to simply drop NULL values you can use na.drop with subset argument:

df.na.drop(subset=["dt_mvmt"])

Popularity 9/10 Helpfulness 6/10 Language python

Source: Grepper

Tags: pyspark python

Link to this answer
Share Copy Link

Contributed on Jul 18 2021

Fancy Flamingo

0 Answers Avg Quality 2/10

pyspark dropna in one column

Contents

More Related Answers

pyspark dropna in one column

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.