Remove duplicates from a Spark DataFrame

Source: R/sdf_interface.R

Remove duplicates from a Spark DataFrame

sdf_drop_duplicates(x, cols = NULL)

Arguments

x

An object coercible to a Spark DataFrame

cols

Subset of Columns to consider, given as a character vector