jupyter notebook spark

Death_Vader answered on June 20, 2021 Popularity 9/10 Helpfulness 4/10

answer jupyter notebook spark

jupyter notebook spark

Comment

import os
import sys
os.environ["PYSPARK_PYTHON"] = "/opt/cloudera/parcels/Anaconda/bin/python"
os.environ["JAVA_HOME"] = "/usr/java/jdk1.8.0_232-cloudera/jre"
os.environ["SPARK_HOME"]="/opt/cloudera/parcels/SPARK2-2.3.0.cloudera2-1.cdh5.13.3.p0.316101/lib/spark2/"
os.environ["PYLIB"] = os.environ["SPARK_HOME"] + "/python/lib"
sys.path.insert(0, os.environ["PYLIB"] +"/py4j-0.10.6-src.zip")
sys.path.insert(0, os.environ["PYLIB"] +"/pyspark.zip")

Popularity 9/10 Helpfulness 4/10 Language python

Source: Grepper

Tags: jupyter-notebook python

Link to this answer
Share Copy Link

Contributed on Jun 20 2021

Death_Vader

0 Answers Avg Quality 2/10

jupyter notebook spark

Contents

More Related Answers

jupyter notebook spark

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.