Docker deployment of Spark Cluster

Docker deployment of Spark Cluster

Docker Install, for our purpose, we only need to install Docker Community Edition (CE)

Get Docker CE for CentOS:

CentOSDocker Documentation

Get Docker CE for Debian:

DebianDocker Documentation

Get Docker CE for Ubuntu:

UbuntuDocker Documentation

Docker for Windows 10:

WindowsDocker Documentation

Docker for Mac:

MacDocker Documentation

For others:

InstallDocker Documentation

Non Windows:

After Docker is installed, need to do the following to allow non root user to run Docker container

sudo groupadd docker

sudo usermod -aG docker $USER

exit and log in again

Install docker-compose:

InstallDocker Documentation