How can I use Apache Spark with notebook in Anaconda

Lazy Lion answered on September 10, 2021 Popularity 5/10 Helpfulness 1/10

answer How can I use Apache Spark with notebook in Anaconda

related How can I use Apache Spark with notebook in Anaconda

How can I use Apache Spark with notebook in Anaconda

Comment

import os
import sys
os.environ["PYSPARK_PYTHON"] = "/opt/continuum/anaconda/bin/python"
os.environ["JAVA_HOME"] = "/usr/java/jdk1.7.0_67-cloudera/jre"
os.environ["SPARK_HOME"] = "/opt/cloudera/parcels/CDH/lib/spark"
os.environ["PYLIB"] = os.environ["SPARK_HOME"] + "/python/lib"
sys.path.insert(0, os.environ["PYLIB"] +"/py4j-0.9-src.zip")
sys.path.insert(0, os.environ["PYLIB"] +"/pyspark.zip")

Popularity 5/10 Helpfulness 1/10 Language python

Source: docs.anaconda.com

Tags: anaconda apache-spark python

Link to this answer
Share Copy Link

Contributed on Sep 10 2021

Lazy Lion

0 Answers Avg Quality 2/10

Closely Related Answers

How can I use Apache Spark with notebook in Anaconda

Comment

PYSPARK_PYTHON=/opt/continuum/anaconda/bin/python spark-submit pyspark_script.py

Popularity 5/10 Helpfulness 1/10 Language whatever

Source: docs.anaconda.com

Tags: anaconda whatever apache-spark

Link to this answer
Share Copy Link

Contributed on Sep 10 2021

Lazy Lion

0 Answers Avg Quality 2/10

How can I use Apache Spark with notebook in Anaconda

Contents

More Related Answers

How can I use Apache Spark with notebook in Anaconda

Closely Related Answers

How can I use Apache Spark with notebook in Anaconda

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.