pyspark read multiple files from different directories

Enthusiastic Elephant answered on May 18, 2022 Popularity 1/10 Helpfulness 1/10

Comment

val rdd2 = spark.sparkContext.textFile("C:/tmp/dir1/*,C:/tmp/dir2/*,c:/tmp/files/text01.txt")
  rdd2.foreach(f=>{
    println(f)
  })

Popularity 1/10 Helpfulness 1/10 Language whatever

Tags: pyspark whatever

Link to this answer
Share Copy Link

Contributed on May 18 2022

Enthusiastic Elephant

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

Oops, You will need to install Grepper and log-in to perform this action.