Ctrlk
For the complete documentation index, see llms.txt. This page is also available as Markdown.

Docker deployment of Spark Cluster

Docker deployment of Spark Cluster

Docker Install, for our purpose, we only need to install Docker Community Edition (CE)

Get Docker CE for CentOS:

LogoInstall Docker Engine on CentOSDocker Documentation

Get Docker CE for Debian:

LogoInstall Docker Engine on DebianDocker Documentation

Get Docker CE for Ubuntu:

LogoInstall Docker Engine on UbuntuDocker Documentation

Docker for Windows 10:

LogoInstall Docker Desktop on WindowsDocker Documentation

Docker for Mac:

LogoInstall Docker Desktop on MacDocker Documentation

For others:

LogoInstall Docker EngineDocker Documentation

Non Windows:

After Docker is installed, need to do the following to allow non root user to run Docker container

sudo groupadd docker

sudo usermod -aG docker $USER

exit and log in again

Install docker-compose:

LogoOverview of installing Docker ComposeDocker Documentation
PreviousConfigure VirtualBox NAT as Network Adapter on Guest VM and Allow putty ssh Through Port ForwardingNextCreate customized Apache Spark Docker container

Last updated