JStorm-on-YARN is a project enables JStorm to run on YARN. It learns from storm-yarn project and did some personalization for JStorm. To learn more about JStorm, look at JStorm.
- 赵颖(Ying Zhao), @飞天小颖猪,mail: [email protected]
Please install the following software first:
- java7
- zookeeper cluster
- python 2.x
- zeromq
- jzmq
- YARN details can refer to Chinese version document or English Version
- download jstorm release package. Download
- untar it, and make it a zip file named, for example, jstorm.zip.
- configure storm.yaml in jstorm package like link, and copy it to $HOME/.jstorm/storm.yaml
- put jstorm.zip into HDFS directory
/lib/jstorm/[version]/. - download jstorm-yarn package and untar it.
- add jstorm-yarn/bin to $PATH
- run
jstorm-yarn launchto start running jstorm on yarn! other commands can be get fromjstorm-yarn help.
- Currently nimbus and supervisors' logs are in HDFS, not within YARN's container's logs, so it could be a little hard to get them.