发布时间:2025-12-09 12:01:26 浏览次数:1
jstorm的安装有很多方式,这里主要讲述的是Standalone模式,其它模式请查看官方文档。
首先下载安装包,地址https://github.com/alibaba/jstorm/releases/download/2.1.1/jstorm-2.1.1.zip
然后配置环境变量
export JSTORM_HOME=/opt/jstorm/jstorm-2.1.1export PATH=$PATH:$JSTORM_HOME/bin为了保险,在bashrc中做同样的操作,然后执行
source /etc/profile配置hostname,使hostname -i命令任何时候都不出现127.0.0.1
切换到安装目录,解压安装包,cd到conf目录,编辑storm.yaml
storm.zookeeper.servers: - "10.5.3.100" - "10.5.3.101" - "10.5.3.102" storm.zookeeper.root: "/jstorm" nimbus.host: "10.5.3.100" storm.local.dir: "%JSTORM_HOME%/data"注意:
1、每一行配置开头必须有空格,否则报错
2、zookeeper端口必须一致,默认2128
3、不能写hostname只能写ip
配置完成后,将安装包分发到其它机器上,在nimbus节点执行
nohup jstorm nimbus &执行stop.sh关闭nimbus
在supervisor执行
nohup jstorm supervisor &执行stop.sh关闭supervisor
当出现
get supervisor host error!java.lang.Exception: the hostname which supervisor get is localhost at com.alibaba.jstorm.daemon.supervisor.Heartbeat.initSupervisorInfo(Heartbeat.java:113) [jstorm-core-2.1.1.jar:na] at com.alibaba.jstorm.daemon.supervisor.Heartbeat.<init>(Heartbeat.java:99) [jstorm-core-2.1.1.jar:na] at com.alibaba.jstorm.daemon.supervisor.Supervisor.mkSupervisor(Supervisor.java:123) [jstorm-core-2.1.1.jar:na] at com.alibaba.jstorm.daemon.supervisor.Supervisor.run(Supervisor.java:201) [jstorm-core-2.1.1.jar:na] at com.alibaba.jstorm.daemon.supervisor.Supervisor.main(Supervisor.java:237) [jstorm-core-2.1.1.jar:na][ERROR 2016-05-26 00:02:59 c.a.j.d.s.Supervisor:218 main] Fail to run supervisor java.lang.RuntimeException: java.lang.Exception: the hostname which supervisor get is localhost at com.alibaba.jstorm.daemon.supervisor.Heartbeat.initSupervisorInfo(Heartbeat.java:118) ~[jstorm-core-2.1.1.jar:na] at com.alibaba.jstorm.daemon.supervisor.Heartbeat.<init>(Heartbeat.java:99) ~[jstorm-core-2.1.1.jar:na] at com.alibaba.jstorm.daemon.supervisor.Supervisor.mkSupervisor(Supervisor.java:123) [jstorm-core-2.1.1.jar:na] at com.alibaba.jstorm.daemon.supervisor.Supervisor.run(Supervisor.java:201) [jstorm-core-2.1.1.jar:na] at com.alibaba.jstorm.daemon.supervisor.Supervisor.main(Supervisor.java:237) [jstorm-core-2.1.1.jar:na]Caused by: java.lang.Exception: the hostname which supervisor get is localhost at com.alibaba.jstorm.daemon.supervisor.Heartbeat.initSupervisorInfo(Heartbeat.java:113) ~[jstorm-core-2.1.1.jar:na] ... 4 common frames omitted说明hostname没有配置正确
webui的war包在jstorm的安装目录,下载一个tomcat,然后将war拷贝到webapps下,并且解压到root文件夹,以下是官方命令
mkdir ~/.jstormcp -f $JSTORM_HOME/conf/storm.yaml ~/.jstorm下载tomcat 7.x (以apache-tomcat-7.0.37 为例)tar -xzf apache-tomcat-7.0.37.tar.gzcd apache-tomcat-7.0.37cd webappscp $JSTORM_HOME/jstorm-ui-2.1.1.war ./mv ROOT ROOT.oldln -s jstorm-ui-2.1.1 ROOT #这个地方可能变化,是根据你的JStorm版本来确定,比如当0.9.6.1时,是ln -s jstorm-0.9.6.1 ROOT 另外不是 ln -s jstorm-ui-0.9.6.3.war ROOT 这个要小心cd ../bin./startup.sh然后在创建~/.jstorm文件,并把jstorm的配置文件storm.yaml拷贝到这个文件夹下,编辑配置文件
storm.zookeeper.servers: - "10.5.3.100" - "10.5.3.101" - "10.5.3.102" storm.zookeeper.root: "/jstorm" nimbus.host: "10.5.3.100" storm.local.dir: "%JSTORM_HOME%/data" ui.clusters: - { name: "jstorm", zkRoot: "/jstorm", zkServers: [ "10.5.3.100","10.5.3.101","10.5.3.102"], zkPort: 2181, }启动zookeeper集群,启动jstorm集群,启动tomcat。
访问http://ip:8080
storm的故障容忍型参照如下博客http://www.linuxidc.com/Linux/2015-02/113729.htm
当需要停机重启升级时:
1、kill Nimbus-》升级-》重启 2、kill Supervisor (当运行在此节点上的work全部转移到别的节点上时) -》升级-》重启 3、重复2,直到全部重启完毕
1、部署TOPOLOGY
jstorm jar /opt/hadoop/loganalyst/storm-dependend/data/teststorm-1.0.jar teststorm.TopologyMain /opt/hadoop/loganalyst/storm-dependend/data/words.txt2、删除TOPOLOGY
jstorm kill {toponame}3、激活TOPOLOGY
jstorm active {toponame}4、不激活TOPOLOGY
jstorm deactivate {toponame}5、列出所有TOPOLOGY
jstorm list