org.apache.hadoop.ipc.StandbyException: Operation category READ is not suppor...

2015-01-31 09:37:25,279 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 2 edits starting from txid 5199691
2015-01-31 09:37:43,638 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yrservice (auth:SIMPLE) cause:org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby
2015-01-31 09:37:43,638 INFO org.apache.hadoop.ipc.Server: IPC Server handler 68 on 8020, call org.apache.hadoop.hdfs.protocol.ClientProtocol.getFileInfo from 10.21.150.8:45848 Call#0 Retry#0: error: org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby
2015-01-31 09:38:05,413 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yrservice (auth:SIMPLE) cause:org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby
2015-01-31 09:38:05,413 INFO org.apache.hadoop.ipc.Server: IPC Server handler 94 on 8020, call org.apache.hadoop.hdfs.protocol.ClientProtocol.getFileInfo from 10.21.125.11:38410 Call#0 Retry#0: error: org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby
2015-01-31 09:38:45,825 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yrservice (auth:SIMPLE) cause:org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby
2015-01-31 09:38:45,825 INFO org.apache.hadoop.ipc.Server: IPC Server handler 73 on 8020, call org.apache.hadoop.hdfs.protocol.ClientProtocol.getFileInfo from 10.21.150.8:45851 Call#0 Retry#0: error: org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby
2015-01-31 09:39:01,076 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yrservice (auth:SIMPLE) cause:org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby
2015-01-31 09:39:01,077 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yrservice (auth:SIMPLE) cause:org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby
2015-01-31 09:39:01,077 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 8020, call org.apache.hadoop.hdfs.protocol.ClientProtocol.getFileInfo from 10.21.127.40:30650 Call#37342 Retry#0: error: org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby
2015-01-31 09:39:01,077 INFO org.apache.hadoop.ipc.Server: IPC Server handler 53 on 8020, call org.apache.hadoop.hdfs.protocol.ClientProtocol.getFileInfo from 10.21.127.40:30650 Call#37343 Retry#0: error: org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby
2015-01-31 09:39:07,118 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yrservice (auth:SIMPLE) cause:org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby
2015-01-31 09:39:07,118 INFO org.apache.hadoop.ipc.Server: IPC Server handler 10 on 8020, call org.apache.hadoop.hdfs.protocol.ClientProtocol.getFileInfo from 10.21.125.11:38413 Call#0 Retry#0: error: org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby
2015-01-31 09:39:25,771 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Triggering log roll on remote NameNode sh-d0-sv0676.sh.idc.yunyun.com/10.21.129.42:8020
2015-01-31 09:39:26,103 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Reading org.apache.hadoop.hdfs.server.namenode.RedundantEditLogInputStream@3b059247 expecting start txid #5199694
2015-01-31 09:39:26,103 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Start loading edits file http://sh-d0-sv0677.sh.idc.yunyu ... 9-8afa-8e4a2ccca9c8
2015-01-31 09:39:26,103 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://sh-d0-sv0677.sh.idc.yunyun.com:8480/getJournal?jid=ads-hadoop-cluster&segmentTxId=5199694&storageInfo=-47%3A1964913040%3A0%3ACID-4105c13b-a245-41a9-8afa-8e4a2ccca9c8' to transaction ID 5199694
2015-01-31 09:39:26,103 INFO org.apache.hadoop.hdfs.server.namenode.EditLogInputStream: Fast-forwarding stream 'http://sh-d0-sv0677.sh.idc.yunyun.com:8480/getJournal?jid=ads-hadoop-cluster&segmentTxId=5199694&storageInfo=-47%3A1964913040%3A0%3ACID-4105c13b-a245-41a9-8afa-8e4a2ccca9c8' to transaction ID 5199694
2015-01-31 09:39:26,146 INFO org.apache.hadoop.hdfs.server.namenode.FSImage: Edits file http://sh-d0-sv0677.sh.idc.yunyu ... 9-8afa-8e4a2ccca9c8 of size 30 edits # 2 loaded in 0 seconds
2015-01-31 09:39:26,193 INFO org.apache.hadoop.hdfs.server.namenode.ha.EditLogTailer: Loaded 2 edits starting from txid 5199693
2015-01-31 09:39:47,589 ERROR org.apache.hadoop.security.UserGroupInformation: PriviledgedActionException as:yrservice (auth:SIMPLE) cause:org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby
2015-01-31 09:39:47,589 INFO org.apache.hadoop.ipc.Server: IPC Server handler 51 on 8020, call org.apache.hadoop.hdfs.protocol.ClientProtocol.getFileInfo from 10.21.150.8:45855 Call#0 Retry#0: error: org.apache.hadoop.ipc.StandbyException: Operation category READ is not supported in state standby


这是个 什么问题阿？？Operation category READ is not supported in state standby  
hdfs 写 失败。。。集群正常。。

Web页面查看两个NameNode状态，是不是都 standby状态了

nextuser 发表于 2015-2-2 13:49
Web页面查看两个NameNode状态，是不是都 standby状态了

现在 没有，那个是在日志里看到的。因为集群已经重启过了。
就是想知道是什么原因引起这个的？？

536528395 发表于 2015-2-2 13:52
现在 没有，那个是在日志里看到的。因为集群已经重启过了。
就是想知道是什么原因引起这个的？？

可以参考下这个帖子Operation category READ is not supported in state standby

nextuser 发表于 2015-2-2 13:55
可以参考下这个帖子Operation category READ is not supported in state standby

周六出的问题，别人在家重启的 当时只是重启了hadoop集群，并没有 重启zookeeper，所以应该不是zookeeper挂了。
http://caiguangguang.blog.51cto.com/1652935/1418895 这个里面说什么跟journalnode 这个有关。不知道  是不是阿，我发现集群里指配置了一台journalnode。
但是日志里好像又没发现错误。。哀。

nextuser 发表于 2015-2-2 13:55
可以参考下这个帖子Operation category READ is not supported in state standby

这个错误是周六发生的，同事在家直接把hadoop集群重启了，并没有重启zookeeper集群，我刚才看了一下zookeeper集群正常运行着呢。
我看一篇日志http://caiguangguang.blog.51cto.com/1652935/1418895说 跟journalnode 有关？  但是我看那个日志里面也没有报错阿。
不过 集群里面那个journalnode 就配置了一台。

536528395 发表于 2015-2-2 14:24
这个错误是周六发生的，同事在家直接把hadoop集群重启了，并没有重启zookeeper集群，我刚才看了一下zooke ...

以前正常，现在不正常，要么磁盘满了，要么网络有问题，要么写入有问题。