> For the complete documentation index, see [llms.txt](https://george-jen.gitbook.io/data-science-and-apache-spark/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://george-jen.gitbook.io/data-science-and-apache-spark/docker-deployment-of-spark-cluster.md).

# Docker deployment of Spark Cluster

### Docker deployment of Spark Cluster

Docker Install, for our purpose, we only need to install Docker Community Edition (CE)

Get Docker CE for CentOS:

{% embed url="<https://docs.docker.com/v17.09/engine/installation/linux/docker-ce/centos/>" %}

Get Docker CE for Debian:

{% embed url="<https://docs.docker.com/v17.09/engine/installation/linux/docker-ce/debian/>" %}

Get Docker CE for Ubuntu:

{% embed url="<https://docs.docker.com/v17.09/engine/installation/linux/docker-ce/ubuntu/#set-up-the-repository>" %}

Docker for Windows 10:

{% embed url="<https://docs.docker.com/v17.09/docker-for-windows/install/#download-docker-for-windows>" %}

Docker for Mac:

{% embed url="<https://docs.docker.com/v17.09/docker-for-mac/install/>" %}

For others:

{% embed url="<https://docs.docker.com/v17.09/engine/installation/#server>" %}

Non Windows:

After Docker is installed, need to do the following to allow non root user to run Docker container

sudo groupadd docker

sudo usermod -aG docker $USER

exit and log in again

Install docker-compose:

{% embed url="<https://docs.docker.com/compose/install/>" %}