Breaking News: Grepper is joining You.com. Read the official announcement!

how to read binary file in spark

MazelTov27 answered on September 22, 2022 Popularity 3/10 Helpfulness 2/10

answer how to read binary file in spark

how to read binary file in spark

Comment

# Binary Files 

# Reading a binary file into a DataFrame
path = "your_file_path" #ex. "/databricks-datasets/learning-spark/cctvVideos/train_images/"
binary_files_df = (spark.read.format("binaryFile")
                .option("pathGlobFilter", "*.jpg")
                .load(path))
binary_files_df.show()

# To ignore partitioning data discovery in a directory, you can set recursiveFileLookup to True 
binary_files_df = (spark.read.format("binaryFile")
                .option("pathGlobFilter", "*.jpg")
                .option("recursiveFileLookup", "true")
                .load(path))
binary_files_df.show()

Popularity 3/10 Helpfulness 2/10 Language python

Source: Grepper

Tags: binary file python

Link to this answer
Share Copy Link

Contributed on Sep 22 2022

MazelTov27

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

how to read binary file in spark

Contents

More Related Answers

how to read binary file in spark

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.