分享

storm报错

zhuqitian 发表于 2017-7-20 17:31:12 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 4 6834


这些一大堆报错,你我都不要愿意看,更不想它出现,可没有这些东西折磨你,你怎么牛逼呢
下面这些错是我在跑一个storm程序时出现的,说是kafka连接问题,可我压根没用kafka,程序里也没有product,consumer
有遇到过的望指点12

[main] ERROR o.a.a.h.AtlasHook - Failed to send notification - attempt #1; error=java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Batch containing 1 record(s) expired due to timeout while requesting metadata from brokers for ATLAS_HOOK-0
66560 [main] ERROR o.a.a.h.AtlasHook - Failed to send notification - attempt #2; error=java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Batch containing 1 record(s) expired due to timeout while requesting metadata from brokers for ATLAS_HOOK-0
97655 [main] ERROR o.a.a.h.AtlasHook - Failed to notify atlas for entity [[{Id='(type: storm_topology, id: <unassigned>)', traits=[], values={outputs=[], owner=storm, nodes=[{Id='(type: storm_spout, id: <unassigned>)', traits=[], values={name=spout, outputs=[bolt], conf={}, driverClass=pv.SourceSpout}}, {Id='(type: storm_bolt, id: <unassigned>)', traits=[], values={name=bolt, conf={ZkPvBolt.beginTime=1500542249704, ZkPvBolt.endTime=0, ZkPvBolt.Pv=0}, driverClass=pv.ZkPvBolt, inputs=[spout]}}], inputs=[], qualifiedName=top, clusterName=bcwdmpv1, name=top, startTime=2017-07-20T09:17:33.403Z, id=top-17-1500542250}}]] after 3 retries. Quitting
org.apache.atlas.notification.NotificationException: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Batch containing 1 record(s) expired due to timeout while requesting metadata from brokers for ATLAS_HOOK-0
        at org.apache.atlas.kafka.KafkaNotification.sendInternalToProducer(KafkaNotification.java:249) ~[atlas-notification-0.7.0.2.5.0.0-1245.jar:0.7.0.2.5.0.0-1245]
        at org.apache.atlas.kafka.KafkaNotification.sendInternal(KafkaNotification.java:222) ~[atlas-notification-0.7.0.2.5.0.0-1245.jar:0.7.0.2.5.0.0-1245]
        at org.apache.atlas.notification.AbstractNotification.send(AbstractNotification.java:84) ~[atlas-notification-0.7.0.2.5.0.0-1245.jar:0.7.0.2.5.0.0-1245]
        at org.apache.atlas.hook.AtlasHook.notifyEntitiesInternal(AtlasHook.java:129) [atlas-notification-0.7.0.2.5.0.0-1245.jar:0.7.0.2.5.0.0-1245]
        at org.apache.atlas.hook.AtlasHook.notifyEntities(AtlasHook.java:114) [atlas-notification-0.7.0.2.5.0.0-1245.jar:0.7.0.2.5.0.0-1245]
        at org.apache.atlas.hook.AtlasHook.notifyEntities(AtlasHook.java:167) [atlas-notification-0.7.0.2.5.0.0-1245.jar:0.7.0.2.5.0.0-1245]
        at org.apache.atlas.hook.AtlasHook.notifyEntities(AtlasHook.java:101) [atlas-notification-0.7.0.2.5.0.0-1245.jar:0.7.0.2.5.0.0-1245]
        at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:104) [storm-bridge-0.7.0.2.5.0.0-1245.jar:0.7.0.2.5.0.0-1245]
        at org.apache.atlas.storm.hook.StormAtlasHook.notify(StormAtlasHook.java:57) [storm-bridge-shim-0.7.0.2.5.0.0-1245.jar:0.7.0.2.5.0.0-1245]
        at org.apache.storm.StormSubmitter.invokeSubmitterHook(StormSubmitter.java:284) [storm-core-1.0.1.2.5.0.0-1245.jar:1.0.1.2.5.0.0-1245]
        at org.apache.storm.StormSubmitter.submitTopologyAs(StormSubmitter.java:257) [storm-core-1.0.1.2.5.0.0-1245.jar:1.0.1.2.5.0.0-1245]
        at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:310) [storm-core-1.0.1.2.5.0.0-1245.jar:1.0.1.2.5.0.0-1245]
        at org.apache.storm.StormSubmitter.submitTopology(StormSubmitter.java:157) [storm-core-1.0.1.2.5.0.0-1245.jar:1.0.1.2.5.0.0-1245]
        at pv.Main.main(Main.java:29) [31d176546d2c11e797780894ef18e5f7.jar:?]
Caused by: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Batch containing 1 record(s) expired due to timeout while requesting metadata from brokers for ATLAS_HOOK-0
        at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.valueOrError(FutureRecordMetadata.java:65) ~[kafka-clients-0.10.0.2.5.0.0-1245.jar:?]
        at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.get(FutureRecordMetadata.java:52) ~[kafka-clients-0.10.0.2.5.0.0-1245.jar:?]
        at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.get(FutureRecordMetadata.java:25) ~[kafka-clients-0.10.0.2.5.0.0-1245.jar:?]
        at org.apache.atlas.kafka.KafkaNotification.sendInternalToProducer(KafkaNotification.java:240) ~[atlas-notification-0.7.0.2.5.0.0-1245.jar:0.7.0.2.5.0.0-1245]
        ... 13 more
Caused by: org.apache.kafka.common.errors.TimeoutException: Batch containing 1 record(s) expired due to timeout while requesting metadata from brokers for ATLAS_HOOK-0

已有(4)人评论

跳转到指定楼层
langke93 发表于 2017-7-20 18:48:39
storm是自己写的吗?
在什么环境下运行的?
怎么运行的?
如果是自己写的,就单纯的storm环境下,应该肯定不会出现这个问题。
回复

使用道具 举报

zhuqitian 发表于 2017-7-20 19:13:18
langke93 发表于 2017-7-20 18:48
storm是自己写的吗?
在什么环境下运行的?
怎么运行的?

自己写的
在ambair安装的hadoop环境下执行的,zk,kafka,storm这些组件都有
StormSubmitter.submitTopology(args[0], config, builder.createTopology());提交的
回复

使用道具 举报

hyj 发表于 2017-7-21 12:25:37
只能是环境的问题了。如果找不出问题,只能从代码入手。提交一个空的内容,看是否同样的问题。
回复

使用道具 举报

zhuqitian 发表于 2017-7-21 17:21:46
hyj 发表于 2017-7-21 12:25
只能是环境的问题了。如果找不出问题,只能从代码入手。提交一个空的内容,看是否同样的问题。

提交空的collector.emit(new Values(""));也还是报错只能猜测是环境问题了,环境问题就不大好找了,我是用ambair工具安装的
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条