cookbook 'et_mesos', '= 5.0.3'
et_mesos (13) Versions 5.0.3 Follow0
Installs/Configures mesos
cookbook 'et_mesos', '= 5.0.3', :supermarket
knife supermarket install et_mesos
knife supermarket download et_mesos
Mesos Cookbook
Install Mesos (http://mesos.apache.org/) and configure mesos master and slave.
This cookbook installs Mesos using Mesosphere packages.
All credit to @everpeace for the basis for this cookbook, everpeace/cookbook-mesos.
Platform
Currently only supports ubuntu
and centos
. But centos
support is experimental.
If you would use cgroups
isolator or docker
containerizer, Ubuntu 14.04 is highly recommended. Note that docker
containerizer is only supported by Mesos 0.20.0+.
Recipes
et_mesos::default
Install Java and Mesos, with platform-dependent switches in place.
et_mesos::package
Install Mesos using Mesosphere's mesos
package.
You can also install zookeeper
package by node['et_mesos']['package']['with_zookeeper']
if required because Mesosphere's Mesos package doesn't necessarily include ZooKeeper.
For a production use case, however, instead of setting that attribute to true, one should use the zookeeper
cookbook to provision a well-configured ZooKeeper instance or cluster of instances. There is a caveat to this: the mesos
package on Ubuntu installs the zookeeper
package, so co-locating Mesos and ZooKeeper using that cookbook is tricky, at best. A separate ZK cluster is encouraged.
et_mesos::master
Configure master and cluster deployment configuration files, and start
mesos-master
.
node['et_mesos']['deploy_dir']/masters
node['et_mesos']['deploy_dir']/slaves
node['et_mesos']['deploy_dir']/mesos-deploy-env.sh
node['et_mesos']['deploy_dir']/mesos-master-env.sh
Furthermore, this recipe will also configure upstart configuration files.
/etc/mesos/zk
/etc/defaults/mesos
/etc/defaults/mesos-master
How to configure mesos-master
You can configure mesos-master
command line options using the node['et_mesos']['master']
attribute.
If you have a configuration as shown below:
node['et_mesos']['master'] = {
port: "5050",
log_dir: "/var/log/mesos",
zk: "zk://localhost:2181/mesos",
cluster: "MyCluster",
quorum: "1"
}
Then mesos-master
will be invoked with command line options like this:
mesos-master --zk=zk://localhost:2181/mesos --port=5050 --log_dir=/var/log/mesos --cluster=MyCluster
See the latest Mesos config docs for available options or the output of mesos-master --help
.
et_mesos::slave
Configure slave configuration files, and start mesos-slave
.
node['et_mesos']['deploy_dir']/mesos-slave-env.sh
Furthermore, this recipe also configures upstart configuration files.
/etc/mesos/zk
/etc/defaults/mesos
/etc/defaults/mesos-slave
How to configure mesos-slave
You can configure mesos-slave
command line options by node['et_mesos']['slave']
hash.
If you have a configuration as shown below:
node['et_mesos']['slave'] = {
master: 'zk://localhost:2181/mesos',
log_dir: '/var/log/mesos',
containerizers: 'docker,mesos',
isolation: 'cgroups/cpu,cgroups/mem',
work_dir: '/var/run/work'
}
Then mesos-slave
will be invoked with command line options like this:
mesos-slave --master=zk://localhost:2181/mesos --log_dir=/var/log/mesos --containerizers=docker,mesos --isolation=cgroups/cpu,cgroups/mem --work_dir=/var/run/work
See the latest Mesos config docs for available options or the output of mesos-slave --help
.
Usage
Wrap this cookbook and include_recipe 'et_mesos::master'
or include_recipe 'et_mesos::slave'
, depending on what part of the cluster you need to provision.
The recommendation would be to have two wrapper cookbooks, one for the master(s), and another for your slave(s).
Attributes
<table>
<tr>
<th>Key</th>
<th>Type</th>
<th>Description</th>
<th>Default</th>
</tr>
<tr>
<td><tt>['et_mesos']['version']</tt></td>
<td>String</td>
<td>Version(branch or tag name at <a href="http://github.com/apache/mesos">http://github.com/apache/mesos</a>).</td>
<td><tt>0.22.1</tt></td>
</tr>
<tr>
<td><tt>['et_mesos']['package']['with_zookeeper']</tt></td>
<td>String</td>
<td>Flag for installing zookeeper package</tt>.</td>
<td><tt>false</tt></td>
</tr>
<tr>
<td><tt>['et_mesos']['ssh_opt']</tt></td>
<td>String</td>
<td>ssh options to be used in <tt>mesos-[start|stop]-cluster</tt></td>
<td><tt>-o StrictHostKeyChecking=no <br> -o ConnectTimeout=2</tt></td>
</tr>
<tr>
<td><tt>['et_mesos']['deploy_with_sudo']</tt></td>
<td>String</td>
<td>Flag whether sudo will be used in <tt>mesos-[start|stop]-cluster</tt></td>
<td><tt>1</tt></td>
</tr>
<tr>
<td><tt>['et_mesos']['cluster_name']</tt></td>
<td>String</td>
<td>[OBSOLETE] Human readable name for the cluster, displayed at webui. </td>
<td><tt>MyCluster</tt></td>
</tr>
<tr>
<td><tt>['et_mesos']['master_ips']</tt></td>
<td>Array of String</td>
<td>IP list of masters used in <tt>mesos-[start|stop]-cluster</tt></td>
<td>[ ]</td>
</tr>
<tr>
<td><tt>['et_mesos']['slave_ips']</tt></td>
<td>Array of String</td>
<td>IP list of slaves used in <tt>mesos-[start|stop]-cluster</tt></td>
<td>[ ]</td>
</tr>
<tr>
<td><tt>['et_mesos']['master']['zk']</tt></td>
<td>String</td>
<td>[REQUIRED(0.19.1+)] ZooKeeper URL (used for leader election amongst masters). May be one of:<br>
zk://host1:port1,host2:port2,…path<br>
zk://username:password@host1:port1,host2:port2,…/path<br>
file://path/to/file (where file contains one of the above)</td>
<td></td>
</tr>
<tr>
<td><tt>['et_mesos']['master']['work_dir']</tt></td>
<td>String</td>
<td>[REQUIRED(0.19.1+)] Where to store the persistent information stored in the Registry.</td>
<td><tt>/tmp/mesos</tt></td>
</tr>
<tr>
<td><tt>['et_mesos']['master']['quorum']</tt></td>
<td>String</td>
<td>[REQUIRED(0.19.1+)] The size of the quorum of replicas when using “replicated_log” based registry. It is imperative to set this value to be a majority of masters, i.e., quorum > (number of masters) / 2.</td>
<td></td>
</tr>
<tr>
<td><tt>['et_mesos']['master']['option_name']</tt></td>
<td>String</td>
<td>You can set arbitrary command line option for <tt>mesos-master</tt>, replace option_name
with the key for the option to set. See the <a href="http://mesos.apache.org/documentation/latest/configuration/">latest Mesos config docs</a> for available options, or the output of mesos-master --help
.</td>
<td></td>
</tr>
<tr>
<td><tt>['et_mesos']['slave']['master']</tt></td>
<td>String</td>
<td>[REQUIRED] mesos master url.This should be a zk://
style address.</td>
<td></td>
</tr>
<tr>
<td><tt>['et_mesos']['slave']['option_name']</tt></td>
<td>String</td>
<td>Like <tt>['et_mesos']['master']['option_name']</tt> above, arbitrary options may be specified as a key for a slave by replacing option_name
with your option’s key.</td>
<td></td>
</tr>
</table>
Testing
There are a couple of test suites in place:
-
chefspec
for unit tests. -
test-kitchen
withserverspec
for integration tests (usingkitchen-ec2
).
Contributing
- Fork the repository on Github
- Create a named feature branch (like
add_component_x
) - Write you change
- Write tests for your change (if applicable)
- Run the tests, ensuring they all pass
- Submit a Pull Request using Github
License
MIT License. see [LICENSE.txt](LICENSE.txt)
(Please note that before 2015-02-06-18:00 PST, this project is opened under Apache License, Version 2.0. See also README.md in old version)
Collaborator Number Metric
5.0.3 passed this metric
Contributing File Metric
5.0.3 failed this metric
Failure: To pass this metric, your cookbook metadata must include a source url, the source url must be in the form of https://github.com/user/repo, and your repo must contain a CONTRIBUTING.md file
Foodcritic Metric
5.0.3 passed this metric
Testing File Metric
5.0.3 failed this metric
Failure: To pass this metric, your cookbook metadata must include a source url, the source url must be in the form of https://github.com/user/repo, and your repo must contain a TESTING.md file
5.0.3 passed this metric
5.0.3 failed this metric
Failure: To pass this metric, your cookbook metadata must include a source url, the source url must be in the form of https://github.com/user/repo, and your repo must contain a CONTRIBUTING.md file
Foodcritic Metric
5.0.3 passed this metric
Testing File Metric
5.0.3 failed this metric
Failure: To pass this metric, your cookbook metadata must include a source url, the source url must be in the form of https://github.com/user/repo, and your repo must contain a TESTING.md file
5.0.3 passed this metric
5.0.3 failed this metric
Failure: To pass this metric, your cookbook metadata must include a source url, the source url must be in the form of https://github.com/user/repo, and your repo must contain a TESTING.md file