Breaking News: Grepper is joining You.com. Read the official announcement!

connect spark to postgres; connect spark to database

sivakguru answered on September 3, 2021 Popularity 8/10 Helpfulness 5/10

answer connect spark to postgres; connect spark to database

connect spark to postgres; connect spark to database

Comment

spark = SparkSession.builder.config(conf=spark_conf).getOrCreate()

#make sure the necessary jar files are loaded
#@ opt/spark/jars folder

df = spark.read \
    .format("jdbc") \
    .option("url", "jdbc:postgresql://<host>:<port>/<db_name>") \
    .option("dbtable", "<schema>.<tablename>") \
    .option("user", "<username>") \
    .option("password", "<password>") \
    .option("driver", "org.postgresql.Driver") \
    .load()

Popularity 8/10 Helpfulness 5/10 Language python

Source: Grepper

Tags: connect database python

Link to this answer
Share Copy Link

Contributed on Sep 03 2021

sivakguru

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

connect spark to postgres; connect spark to database

Contents

More Related Answers

connect spark to postgres; connect spark to database

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.