pyspark.sql.DataFrameNaFunctions

class pyspark.sql.DataFrameNaFunctions(df)

Functionality for working with missing data in DataFrame.

New in version 1.4.0.

Changed in version 3.4.0: Supports Spark Connect.

Methods

drop([how, thresh, subset])	Returns a new DataFrame omitting rows with null or NaN values.
fill(value[, subset])	Returns a new DataFrame which null values are filled with new value.
replace(to_replace[, value, subset])	Returns a new DataFrame replacing a value with another value.