Spark Environment Setup

Spark Environment Setup

Working Environment to be built:

Dev environment we develop Spark applications in Python (PySpark) and Scala

Production environment: the Spark cluster environment that we will submit Spark jobs to be run with

Last updated