Breaking News: Grepper is joining You.com. Read the official announcement!

Build the union of a list of RDDs

Ethercourt.ml answered on March 31, 2020 Popularity 2/10 Helpfulness 1/10

answer Build the union of a list of RDDs

Build the union of a list of RDDs

Comment

# Build the union of a list of RDDs

path = os.path.join(tempdir, "union-text.txt")
with open(path, "w") as testFile:
  _ = testFile.write("Hello")
textFile = sc.textFile(path)
textFile.collect()
# ['Hello']
parallelized = sc.parallelize(["World!"])
sorted(sc.union([textFile, parallelized]).collect())
# ['Hello', 'World!']

Popularity 2/10 Helpfulness 1/10 Language python

Source: spark.apache.org

Tags: build list python union

Link to this answer
Share Copy Link

Contributed on Mar 31 2020

Ethercourt.ml

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

Build the union of a list of RDDs

Contents

More Related Answers

Build the union of a list of RDDs

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.