> For the complete documentation index, see [llms.txt](https://george-jen.gitbook.io/data-science-and-apache-spark/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://george-jen.gitbook.io/data-science-and-apache-spark/spark_setup.md).

# Spark Environment Setup

### Spark Environment Setup

Working Environment to be built:

Dev environment we develop Spark applications in Python (PySpark) and Scala

Production environment: the Spark cluster environment that we will submit Spark jobs to be run with