没有拿到分区号-1 /brokers/ids 的分区号 这里有相关内容,可能会对楼主有所帮助 Storm-kafka【接口实现】-1 DynamicBrokersReader |
easthome001 发表于 2015-1-10 00:04 昨天那个问题 解决了 是jar包不兼容造成的 但是今天storm从kafka取不到消息了,看了 日志 但是 就是不知道为什么 会 和 那个 -1 ids有关 什么原因啊 下面是日志: 91352 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] Refreshing partition manager connections 91358 [Thread-24-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist 91361 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] Refreshing partition manager connections 91363 [Thread-24-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist 91363 [Thread-24-spout] INFO storm.kafka.DynamicBrokersReader - Read partition info from zookeeper: GlobalPartitionInformation{partitionMap={}} 91363 [Thread-24-spout] WARN storm.kafka.KafkaUtils - there are more tasks than partitions (tasks: 2; partitions: 0), some tasks will be idle 91363 [Thread-24-spout] WARN storm.kafka.KafkaUtils - Task [1/2] no partitions assigned 91363 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] Deleted partition managers: [] 91363 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] New partition managers: [] 91363 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] Finished refreshing 91368 [Thread-26-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist 91372 [Thread-26-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist 91372 [Thread-26-spout] INFO storm.kafka.DynamicBrokersReader - Read partition info from zookeeper: GlobalPartitionInformation{partitionMap={}} 91372 [Thread-26-spout] WARN storm.kafka.KafkaUtils - there are more tasks than partitions (tasks: 2; partitions: 0), some tasks will be idle 91372 [Thread-26-spout] WARN storm.kafka.KafkaUtils - Task [2/2] no partitions assigned 91372 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] Deleted partition managers: [] 91372 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] New partition managers: [] 91372 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] Finished refreshing |
昨天那个问题 解决了 是jar包不兼容造成的 但是今天storm从kafka取不到消息了,看了 日志 但是 就是不知道为什么 会 和 那个 -1 ids有关 什么原因啊 下面是日志: 91352 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] Refreshing partition manager connections 91358 [Thread-24-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist 91361 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] Refreshing partition manager connections 91363 [Thread-24-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist 91363 [Thread-24-spout] INFO storm.kafka.DynamicBrokersReader - Read partition info from zookeeper: GlobalPartitionInformation{partitionMap={}} 91363 [Thread-24-spout] WARN storm.kafka.KafkaUtils - there are more tasks than partitions (tasks: 2; partitions: 0), some tasks will be idle 91363 [Thread-24-spout] WARN storm.kafka.KafkaUtils - Task [1/2] no partitions assigned 91363 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] Deleted partition managers: [] 91363 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] New partition managers: [] 91363 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] Finished refreshing 91368 [Thread-26-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist 91372 [Thread-26-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist 91372 [Thread-26-spout] INFO storm.kafka.DynamicBrokersReader - Read partition info from zookeeper: GlobalPartitionInformation{partitionMap={}} 91372 [Thread-26-spout] WARN storm.kafka.KafkaUtils - there are more tasks than partitions (tasks: 2; partitions: 0), some tasks will be idle 91372 [Thread-26-spout] WARN storm.kafka.KafkaUtils - Task [2/2] no partitions assigned 91372 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] Deleted partition managers: [] 91372 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] New partition managers: [] 91372 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] Finished refreshing |
easthome001 发表于 2015-1-10 00:04 谢谢,确实是这样的 |
muyannian 发表于 2015-1-9 23:16 谢谢 确实是jar包不兼容 |
学习了,试试看~~ |
应该是版本兼容问题。或则楼主看缺什么就补什么 |