想通过logstash将日志直接发送到kafka报错如下:
log4j, [2016-05-27T17:34:41.268] ERROR: kafka.producer.async.DefaultEventHandler: Failed to collate messages by topic, partition due to: fetching topic metadata for topics [Set(spark_252)] from broker [ArrayBuffer(id:1,host:101.204.243.113,port:10001, id:2,host:101.204.243.112,port:10001, id:0,host:101.204.243.114,port:10001)] failed
log4j, [2016-05-27T17:34:41.454] WARN: kafka.client.ClientUtils$: Fetching topic metadata with correlation id 76 for topics [Set(spark_252)] from broker [id:1,host:101.204.243.113,port:10001] failed
java.io.EOFException: Received -1 when reading from channel, socket has likely been closed.
at kafka.utils.Utils$.read(Utils.scala:381)
at kafka.network.BoundedByteBufferReceive.readFrom(BoundedByteBufferReceive.scala:54)
at kafka.network.Receive$class.readCompletely(Transmission.scala:56)
at kafka.network.BoundedByteBufferReceive.readCompletely(BoundedByteBufferReceive.scala:29)
………………………………………………
|
|