storm-kafka 整合项目测试

我首先手动发送一条  消息 ：hello word 到kafka
然后通过storm程序接受这条消息并打印出来，但是消息是打印出来了，就是总是报异常，不知道什么情况
请大家看到到了帮忙看看啊

缺少方法，应该是版本不匹配
英文参考：

Getting Exception In Kafka-storm

storm0.9.1&kafka0.8.1 with storm-kafka-0.8-plus-0.5.0 can not run

error backtype.storm.util-async loop died java.lang.NosuchMethoderror:com.netflix.curator.framework.api.CreateBuilder.creatingParentsIfNeeded()Lcom/netflix/curator/framework/api/ProtecACLCreateModePathAndBytesable
复制代码

应该是版本兼容问题。或则楼主看缺什么就补什么

学习了，试试看~~

muyannian 发表于 2015-1-9 23:16
缺少方法，应该是版本不匹配
英文参考：

谢谢 确实是jar包不兼容

easthome001 发表于 2015-1-10 00:04
应该是版本兼容问题。或则楼主看缺什么就补什么

谢谢，确实是这样的

昨天那个问题 解决了 是jar包不兼容造成的 但是今天storm从kafka取不到消息了，看了 日志 但是 就是不知道为什么 会 和 那个  -1 ids有关 什么原因啊
下面是日志：

91352 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] Refreshing partition manager connections
91358 [Thread-24-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist
91361 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] Refreshing partition manager connections
91363 [Thread-24-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist
91363 [Thread-24-spout] INFO storm.kafka.DynamicBrokersReader - Read partition info from zookeeper: GlobalPartitionInformation{partitionMap={}}
91363 [Thread-24-spout] WARN storm.kafka.KafkaUtils - there are more tasks than partitions (tasks: 2; partitions: 0), some tasks will be idle
91363 [Thread-24-spout] WARN storm.kafka.KafkaUtils - Task [1/2] no partitions assigned
91363 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] Deleted partition managers: []
91363 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] New partition managers: []
91363 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] Finished refreshing
91368 [Thread-26-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist
91372 [Thread-26-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist
91372 [Thread-26-spout] INFO storm.kafka.DynamicBrokersReader - Read partition info from zookeeper: GlobalPartitionInformation{partitionMap={}}
91372 [Thread-26-spout] WARN storm.kafka.KafkaUtils - there are more tasks than partitions (tasks: 2; partitions: 0), some tasks will be idle
91372 [Thread-26-spout] WARN storm.kafka.KafkaUtils - Task [2/2] no partitions assigned
91372 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] Deleted partition managers: []
91372 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] New partition managers: []
91372 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] Finished refreshing

easthome001 发表于 2015-1-10 00:04
应该是版本兼容问题。或则楼主看缺什么就补什么

昨天那个问题 解决了 是jar包不兼容造成的 但是今天storm从kafka取不到消息了，看了 日志 但是 就是不知道为什么 会 和 那个  -1 ids有关 什么原因啊
下面是日志：

91352 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] Refreshing partition manager connections
91358 [Thread-24-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist
91361 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] Refreshing partition manager connections
91363 [Thread-24-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist
91363 [Thread-24-spout] INFO storm.kafka.DynamicBrokersReader - Read partition info from zookeeper: GlobalPartitionInformation{partitionMap={}}
91363 [Thread-24-spout] WARN storm.kafka.KafkaUtils - there are more tasks than partitions (tasks: 2; partitions: 0), some tasks will be idle
91363 [Thread-24-spout] WARN storm.kafka.KafkaUtils - Task [1/2] no partitions assigned
91363 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] Deleted partition managers: []
91363 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] New partition managers: []
91363 [Thread-24-spout] INFO storm.kafka.ZkCoordinator - Task [1/2] Finished refreshing
91368 [Thread-26-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist
91372 [Thread-26-spout] ERROR storm.kafka.DynamicBrokersReader - Node /brokers/ids/-1 does not exist
91372 [Thread-26-spout] INFO storm.kafka.DynamicBrokersReader - Read partition info from zookeeper: GlobalPartitionInformation{partitionMap={}}
91372 [Thread-26-spout] WARN storm.kafka.KafkaUtils - there are more tasks than partitions (tasks: 2; partitions: 0), some tasks will be idle
91372 [Thread-26-spout] WARN storm.kafka.KafkaUtils - Task [2/2] no partitions assigned
91372 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] Deleted partition managers: []
91372 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] New partition managers: []
91372 [Thread-26-spout] INFO storm.kafka.ZkCoordinator - Task [2/2] Finished refreshing

没有拿到分区号-1
/brokers/ids 的分区号

这里有相关内容，可能会对楼主有所帮助
Storm-kafka【接口实现】-1 DynamicBrokersReader