Breaking News: Grepper is joining You.com. Read the official announcement!

add sets pyspark

notPlancha answered on April 6, 2023 Popularity 1/10 Helpfulness 3/10

answer add sets pyspark

add sets pyspark

Comment

If you're adding sets in multiple rows:

from pyspark.sql.functions import *
df = df.groupBy("group") \
	.agg(collect_set("column_sets")) \
	.withColumn("sets_flatened", flatten(col("column_sets")))

if you're adding sets in multiple columns:

df_union = df.withColumn("set_union", array_union("Meat", "Fish"))

Popularity 1/10 Helpfulness 3/10 Language python

Source: Grepper

Tags: add pyspark python

Link to this answer
Share Copy Link

Contributed on Apr 06 2023

notPlancha

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

add sets pyspark

Contents

More Related Answers

add sets pyspark

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.