join columns pyspark

notPlancha answered on April 8, 2023 Popularity 9/10 Helpfulness 2/10

answer join columns pyspark

Comment

df = spark.createDataFrame([['Alex','Jobs'], ['Bob','Miley'], ['Cathy','Lee']], ['fname','lname'])

+-----+-----+

|fname|lname|

+-----+-----+

| Alex| Jobs|

| Bob|Miley|

|Cathy| Lee|

+-----+-----+

df_merged = df.select(F.array('fname', 'lname').alias('merged'))
df_merged.show()

+------------+

| merged|

+------------+

|[Alex, Jobs]|

|[Bob, Miley]|

|[Cathy, Lee]|

+------------+

Popularity 9/10 Helpfulness 2/10 Language python

Tags: join pyspark whatever

Link to this answer
Share Copy Link

Contributed on Apr 08 2023

notPlancha

0 Answers Avg Quality 2/10

Oops, You will need to install Grepper and log-in to perform this action.