https://github.com/seomoz/roger-mesos

A complete mesos cluster setup with automatic load balancing
https://github.com/seomoz/roger-mesos

Last synced: 2 months ago
JSON representation

A complete mesos cluster setup with automatic load balancing

• Host: GitHub
• URL: https://github.com/seomoz/roger-mesos
• Owner: seomoz
• License: apache-2.0
• Archived: true
• Created: 2015-11-30T08:24:43.000Z (over 8 years ago)
• Default Branch: master
• Last Pushed: 2017-04-19T18:13:10.000Z (about 7 years ago)
• Last Synced: 2024-01-25T08:02:36.918Z (5 months ago)
• Language: Python
• Homepage:
• Size: 18.4 MB
• Stars: 8
• Watchers: 94
• Forks: 5
• Open Issues: 1
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Lists

• awesome-mesos - roger-mesos with Bamboo

README

        
# roger-mesos

This repo contains everything you need to set up a complete Mesos cluster with the following components -

* [zookeeper](https://zookeeper.apache.org/)

* [mesos](http://mesos.apache.org/) (masters + slaves)

* [marathon](https://mesosphere.github.io/marathon/)

* [chronos](http://mesos.github.io/chronos/)

* [docker](https://www.docker.com/) (on the slaves)

* [haproxy](http://www.haproxy.org/) + [roger-bamboo](https://github.com/seomoz/roger-bamboo) (for load-balancing/proxy)

It also contains examples that use Vagrant VMs to illustrate how to set up a cluster (see [vagrant/](vagrant)).

### Pre-requisites

* [Ansible](http://docs.ansible.com/ansible/intro.html) is installed on the control machine (prior knowledge of [ansible](http://docs.ansible.com/ansible/index.html) helps.)

* Inventory (aka a set of host machines) exists and have ubuntu 14.0.4 LTS along with openssh-server installed.

* Sudo access to each of the host machines is available.

If you are only looking for a vagrant based cluster running on your machine for development/testing purposes go to the [vagrant/](vagrant) directory.

### Steps to get (a real) cluster up and running

* Ensure that an inventory file exists with the list of masters, slaves, etc. (see an existing hosts file in the hosts dir under [vagrant/single_node or vagrant/multi_node](vagrant)).

* Run the following commands (*_WARNING:_* the first command below will reboot the hosts):

```

$ ansible-playbook -i  --user= --ask-pass --ask-sudo-pass --extra-vars="restart_machine=true" base.yml

$ ansible-playbook -i  --user= --ask-pass --ask-sudo-pass zookeeper-nodes.yml

$ ansible-playbook -i  --user= --ask-pass --ask-sudo-pass --extra-vars="mesos_cluster_name=" master-nodes.yml

$ ansible-playbook -i  --user= --ask-pass --ask-sudo-pass marathon-nodes.yml

$ ansible-playbook -i  --user= --ask-pass --ask-sudo-pass chronos.yml

$ ansible-playbook -i  --user= --ask-pass --ask-sudo-pass slave-nodes.yml

$ ansible-playbook -i  --user= --ask-pass --ask-sudo-pass bamboo-nodes.yml

```

### To set up and start docker registry

* Make sure host file contains docker_registry group.

* Run:

```

$ ansible-playbook -i  --user= --ask-pass --ask-sudo-pass docker-registry.yml

```

### Notes

* The `--ask-pass` and `--ask-sudo-pass` are not needed if ssh key is added and the user is part of the sudo group in the host machines.

* To restart a service on all hosts, you can use ansible's service module. For example:

```

$ ansible zookeeper -i  --user= --ask-pass --ask-sudo-pass -m service -a "name=zookeeper state=restarted" -s

$ ansible marathon_servers -i  --user= --ask-pass --ask-sudo-pass -m service -a "name=marathon state=restarted" -s

```

* For marathon generate permissions the various variables are required to be available. Using ansible vault is one way to do this. Example -

```

$ ansible-playbook -i /path/to/inventory/file ansible/marathon-nodes.yml -e @$HOME/my-ansible-secrets.yml.encrypted --vault-password-file ~/.my-ansible-secrets-vault-pass

```