分享

Topolog发布后的问题求助

caiyifeng 发表于 2014-12-18 20:52:07 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 2 22419
写了一个Topology,发布上去后,但在UI界面上看不到这个Topology的执行信息,但实际上已经执行了,数据都有插入表中,我看了后台日志,觉得问题应该在这,但不知道什么原因,请各位帮忙看看,报错信息:
nimbus.log :
2014-12-18 20:33:42 b.s.d.nimbus [INFO] Delaying event :remove for 1 secs for cdcTopology-352-1418905615
2014-12-18 20:33:42 b.s.d.nimbus [INFO] Updated cdcTopology-352-1418905615 with status {:type :killed, :kill-time-secs 1}
2014-12-18 20:33:47 b.s.d.nimbus [INFO] Killing topology: cdcTopology-352-1418905615
2014-12-18 20:33:47 b.s.d.nimbus [INFO] Cleaning up cdcTopology-352-1418905615
2014-12-18 20:35:29 b.s.d.nimbus [INFO] Uploading file from client to /uniiof/uatusers/uatstm01/storm-0.9.2/stmdata/nimbus/inbox/stormjar-776fee93-6fc0-4789-aebe-1706d5eb12d7.jar
2014-12-18 20:35:29 b.s.d.nimbus [INFO] Finished uploading file from client: /uniiof/uatusers/uatstm01/storm-0.9.2/stmdata/nimbus/inbox/stormjar-776fee93-6fc0-4789-aebe-1706d5eb12d7.jar
2014-12-18 20:35:29 b.s.d.nimbus [INFO] Received topology submission for cdcTopology with conf {"storm.id" "cdcTopology-353-1418906129", "oracle.changeset" "TUNGSTEN_CS_CDC_REPL", "oracle.username" "CDCUSR_PUB", "topology.acker.executors" nil, "topology.kryo.decorators" (), "topology.name" "cdcTopology", "oracle.password" "CDCUSR_PUB", "hbase.zookeeper.property.clientPort" "2181", "scan.scanBufferSize" 1000, "topology.debug" false, "topology.kryo.register" nil, "topology.workers" 1, "hbase.zookeeper.quorum" "132.37.5.195,132.37.5.196", "oracle.publishername" "CDCUSR_PUB", "hbase.master" "132.37.5.197:60010", "topology.max.task.parallelism" nil, "oracle.url" "jdbc:oracle:thin:@132.37.5.195:8899:TSTDB3"}
2014-12-18 20:35:29 b.s.d.nimbus [INFO] Activating cdcTopology: cdcTopology-353-1418906129
2014-12-18 20:35:29 b.s.s.EvenScheduler [INFO] Available slots: (["2a68fa45-4150-4ec4-87ac-cd6b3430f46d" 26707] ["2a68fa45-4150-4ec4-87ac-cd6b3430f46d" 26706] ["2a68fa45-4150-4ec4-87ac-cd6b3430f46d" 26705] ["2a68fa45-4150-4ec4-87ac-cd6b3430f46d" 26704] ["2a68fa45-4150-4ec4-87ac-cd6b3430f46d" 26702] ["2a68fa45-4150-4ec4-87ac-cd6b3430f46d" 26703] ["2a68fa45-4150-4ec4-87ac-cd6b3430f46d" 26700] ["2a68fa45-4150-4ec4-87ac-cd6b3430f46d" 26701])
2014-12-18 20:35:29 b.s.d.nimbus [INFO] Setting new assignment for topology id cdcTopology-353-1418906129: #backtype.storm.daemon.common.Assignment{:master-code-dir "/uniiof/uatusers/uatstm01/storm-0.9.2/stmdata/nimbus/stormdist/cdcTopology-353-1418906129", :node->host {"2a68fa45-4150-4ec4-87ac-cd6b3430f46d" "gxuweg3tst11"}, :executor->node+port {[3 3] ["2a68fa45-4150-4ec4-87ac-cd6b3430f46d" 26707], [2 2] ["2a68fa45-4150-4ec4-87ac-cd6b3430f46d" 26707], [1 1] ["2a68fa45-4150-4ec4-87ac-cd6b3430f46d" 26707]}, :executor->start-time-secs {[1 1] 1418906129, [2 2] 1418906129, [3 3] 1418906129}}
2014-12-18 20:35:29 o.a.t.s.TNonblockingServer [WARN] Got an IOException in internalRead!
java.io.IOException: Connection reset by peer
        at sun.nio.ch.FileDispatcherImpl.read0(Native Method) ~[na:1.7.0_51]
        at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) ~[na:1.7.0_51]
        at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223) ~[na:1.7.0_51]
        at sun.nio.ch.IOUtil.read(IOUtil.java:197) ~[na:1.7.0_51]
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379) ~[na:1.7.0_51]
        at org.apache.thrift7.transport.TNonblockingSocket.read(TNonblockingSocket.java:141) ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
        at org.apache.thrift7.server.TNonblockingServer$FrameBuffer.internalRead(TNonblockingServer.java:669) [storm-core-0.9.2-incubating.jar:0.9.2-incubating]
        at org.apache.thrift7.server.TNonblockingServer$FrameBuffer.read(TNonblockingServer.java:458) [storm-core-0.9.2-incubating.jar:0.9.2-incubating]
        at org.apache.thrift7.server.TNonblockingServer$SelectThread.handleRead(TNonblockingServer.java:359) [storm-core-0.9.2-incubating.jar:0.9.2-incubating]
        at org.apache.thrift7.server.TNonblockingServer$SelectThread.select(TNonblockingServer.java:304) [storm-core-0.9.2-incubating.jar:0.9.2-incubating]
        at org.apache.thrift7.server.TNonblockingServer$SelectThread.run(TNonblockingServer.java:243) [storm-core-0.9.2-incubating.jar:0.9.2-incubating]

已有(2)人评论

跳转到指定楼层
bioger_hit 发表于 2014-12-18 21:29:28
检查下:topology的name为是什么。
如下
在BasicDRPCTopology代码中声明
  1. new LinearDRPCTopologyBuilder("exclamation");
复制代码



指定了topology的name为exclamation

在手动使用./storm jar...参数提交的时候指定的名字又是什么?
二者注意保持一致。
回复

使用道具 举报

caiyifeng 发表于 2014-12-19 09:43:56
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条