If you have taken a look underneath the covers of VMware Big Data Extensions, then you have probably seen the Zookeeper Chef cookbooks that are part of every default cluster deployment. The Zookeeper role is built-in and was an critical part of being able to develop the option for a Mesosphere cluster so quickly using BDE — no need to reinvent the wheel. The only part missing from being able to deploy a Zookeeper only cluster is the JSON specification file.
I took a few minutes and put together a quick JSON specification file that can be used to deploy just Zookeeper as a cluster that could then be utilized by any application as a service layer. As with the Mesosphere cluster, I started with the basic cluster JSON file found in the /opt/serengeti/samples directory.
1 // This is a cluster spec for creating a Zookeeper cluster without installing any hadoop stuff.
2 {
3 "nodeGroups":[
4 {
5 "name": "master",
6 "roles": [
7 "zookeeper"
8 ],
9 "instanceNum": 5,
10 "cpuNum": 2,
11 "memCapacityMB": 3768,
12 "storage": {
13 "type": "SHARED",
14 "sizeGB": 50
15 },
16 "haFlag": "on"
17 }
18 ]
19 }
A quick definition in the /opt/serengeti/conf/serengeti.properties file, the /opt/serengeti/www/specs/map file and /opt/serengeti/www/manifest file is all that is needed. Quickly restart tomcat on the management server and you are off to the races!
The unknown cluster option is now available with very little modification to your BDE environment.
