This is a docker-compose cluster that uses mesos-slave-dind to collocate multiple slave nodes, each with their own docker daemon and /24 network allocation.
The cluster consists of several docker containers linked together by docker-managed hostnames:
| Component | Hostname | Description |
|---|---|---|
| Zookeeper + Exhibitor | zookeeper | key/value store w/ process monitor & web gui |
| Mesos Master | mesosmaster master0.mesos leader.mesos |
resource manager w/ web gui |
| Mesos-DNS | mesosdns | dns for mesos components, frameworks, and tasks |
| Mesos Slave (x2) | mesosslave slave0.mesos slave1.mesos |
resource owner |
| Marathon | marathon.mesos | resource scheduler & container PaaS |
-
Install Docker For Mac
-
Install wget
brew install wget -
Install probe
brew tap karlkfi/homebrew-terminal brew install probe
- Docker CLI - container management command line client
- Docker Engine - container management daemon
- Docker Compose - multi-container application orchestration
- Probe (>= 0.2.0) - command-line service interrogator
- Wget - command-line http client
Most of the above are available via apt and yum, but depending on your distribution, you may have to install via other means to get the latest versions.
It is recommended to use Ubuntu, simply because it supports OverlayFS, used by docker to mount volumes. Alternate file systems may not fully support docker-in-docker.
Most configuration is contained in the docker-compose.yaml file.
Mesos-DNS is configured by mesos-dns-config.json.
Some other details (e.g. number of slaves) can be modified with environment variables. See env.sh for details.
Create a new cluster:
./bin/create.sh
Stop a running cluster:
./bin/stop.sh
Start a stopped cluster:
./bin/start.sh
Destroy a running or stopped cluster:
./bin/destroy.sh
In order to allow resolution of domain names on your host machine, mesos-dns need to be added as a nameserver.
sudo ./bin/dns-update.sh $(source lib/util.sh && util::find_docker_service_ips "mesosdns" | tail -1)
WARNING: This can be done before or after create, but will slow down host domain name resolution if mesos-dns is not running.
This will remove the extra nameserver and leave the original one.
sudo ./bin/dns-update.sh
WARNING: Macs normally use auto-updating DNS, which is disabled as a side effect of dns-update. To restore auto-updates on network change: delete all DNS records in System Preferences > Network > [current network] > Advanced > DNS.
To verify Mesos-DNS (after running dns-update) run:
./test/dns.sh
To verify Marathon (after running dns-update) run:
./test/marathon.sh
Mesos UI is accessible on port 5050. Get the IP on the command-line:
docker inspect -f '{{.NetworkSettings.IPAddress}}:5050' mcd_mesosmaster_1
Marathon UI is accessible on port 8080. Get the IP on the command-line:
docker inspect -f '{{.NetworkSettings.IPAddress}}:8080' mcd_marathon_1
Exhibitor UI is accessible on port 8080. Get the IP on the command-line:
docker inspect -f '{{.NetworkSettings.IPAddress}}:8080/exhibitor/v1/ui/index.html' mcd_zookeeper_1
Copyright 2015-2018 The Mesos Compose Docker-in-Docker Authors
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.