Breaking News: Grepper is joining You.com. Read the official announcement!

Creating a SparkConnector for use with PostgreSQL

Lyna Kaouther answered on June 17, 2022 Popularity 1/10 Helpfulness 1/10

answer Creating a SparkConnector for use with PostgreSQL

Creating a SparkConnector for use with PostgreSQL

Comment

from pyspark.sql import SparkSession

spark = SparkSession.builder \
    .appName("PySpark PostgreSQL") \
    .config("spark.jars", "path\to\postgresql-42.3.1.jar") \
    .getOrCreate()

# Read PostgreSQL DB table into dataframe
df = spark.read \
    .format("jdbc") \
    .option("url", "jdbc:postgresql://localhost:5432/analysis")\
    .option("dbtable", "insurance") \
    .option("user", "postgres") \
    .option("password", "********") \
    .option("driver", "org.postgresql.Driver") \
    .load()

# Display database table schema
df.printSchema()

Popularity 1/10 Helpfulness 1/10 Language whatever

Source: arctype.com

Tags: postgresql whatever

Link to this answer
Share Copy Link

Contributed on Jun 17 2022

Lyna Kaouther

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

Creating a SparkConnector for use with PostgreSQL

Contents

More Related Answers

Creating a SparkConnector for use with PostgreSQL

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.