hbase scan tables

       在对hbase表进行scan操作时，有时候程序会输出下面的信息：(程序运行在hadoop集群外的机器上,etc/hosts文件中对hadoop集群的ip也进行了映射)
[INFO ] 2013-12-30 18:34:25,947(1399) --> [main] org.apache.hadoop.hbase.ipc.HBaseRPC.handleConnectionException(HBaseRPC.java:261): Server at DN78/192.168.1.78:60020 could not be reached after 1 tries, giving up.  
[INFO ] 2013-12-30 18:34:27,966(3418) --> [main] org.apache.hadoop.hbase.ipc.HBaseRPC.handleConnectionException(HBaseRPC.java:261): Server at DN78/192.168.1.78:60020 could not be reached after 1 tries, giving up.  
[INFO ] 2013-12-30 18:34:29,986(5438) --> [main] org.apache.hadoop.hbase.ipc.HBaseRPC.handleConnectionException(HBaseRPC.java:261): Server at DN78/192.168.1.78:60020 could not be reached after 1 tries, giving up.  
[INFO ] 2013-12-30 18:34:32,010(7462) --> [main] org.apache.hadoop.hbase.ipc.HBaseRPC.handleConnectionException(HBaseRPC.java:261): Server at DN78/192.168.1.78:60020 could not be reached after 1 tries, giving up.  
[INFO ] 2013-12-30 18:34:34,022(9474) --> [main] org.apache.hadoop.hbase.ipc.HBaseRPC.handleConnectionException(HBaseRPC.java:261): Server at DN78/192.168.1.78:60020 could not be reached after 1 tries, giving up.  
[INFO ] 2013-12-30 18:34:38,049(13501) --> [main] org.apache.hadoop.hbase.ipc.HBaseRPC.handleConnectionException(HBaseRPC.java:261): Server at DN78/192.168.1.78:60020 could not be reached after 1 tries, giving up.  
[INFO ] 2013-12-30 18:34:42,070(17522) --> [main] org.apache.hadoop.hbase.ipc.HBaseRPC.handleConnectionException(HBaseRPC.java:261): Server at DN78/192.168.1.78:60020 could not be reached after 1 tries, giving up.  
[INFO ] 2013-12-30 18:34:50,107(25559) --> [main] org.apache.hadoop.hbase.ipc.HBaseRPC.handleConnectionException(HBaseRPC.java:261): Server at DN78/192.168.1.78:60020 could not be reached after 1 tries, giving up.  

一直提示，然后有时候程序却是好的，不知道什么原因？

hosts是怎么配置的，还有你代码中是怎么实现的，你贴出来我看一下。

lzw 发表于 2013-12-30 20:41
hosts是怎么配置的，还有你代码中是怎么实现的，你贴出来我看一下。

etc/hosts文件内容:127.0.0.1   localhost
::1         localhost6

192.168.1.76 NN76
192.168.1.77 DN77
192.168.1.78 DN78
192.168.1.79 DN79

代码中是这样连接的：
      private static Configuration configuration = HBaseConfiguration.create();
       
        static{
                configuration.set("hbase.zookeeper.quorum", "NN76,DN77,DN78,DN79");
        }

fanbells 发表于 2013-12-31 09:54
etc/hosts文件内容:127.0.0.1   localhost
::1         localhost6

你的配置和代码连接方式我觉得都没有问题。你查看一下78 DN上的datanode日志和regionserver日志、zookeeper日志，我觉得这台机器上regionserver有问题。

lzw 发表于 2013-12-31 10:12
你的配置和代码连接方式我觉得都没有问题。你查看一下78 DN上的datanode日志和regionserver日志、zookeep ...

分别查了hbase和zookeeper的日志，hbase没问题，问题在zookeeper，日志中只有一个错误okeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:740)
2013-12-27 14:40:58,678 [myid:2] - ERROR [QuorumPeer[myid=2]/0:0:0:0:0:0:0:0:2181:Learner@229] - Unexpected exception
java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
        at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
        at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
        at java.net.Socket.connect(Socket.java:529)
        at org.apache.zookeeper.server.quorum.Learner.connectToLeader(Learner.java:224)
        at org.apache.zookeeper.server.quorum.Follower.followLeader(Follower.java:71)
        at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:740)
2013-12-27 14:40:58,678 [myid:2] - WARN  [QuorumPeer[myid=2]/0:0:0:0:0:0:0:0:2181:Follower@89] - Exception when following the leader
java.net.ConnectException: Connection refused
        at java.net.PlainSocketImpl.socketConnect(Native Method)
        at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
        at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
        at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
        at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
        at java.net.Socket.connect(Socket.java:529)
        at org.apache.zookeeper.server.quorum.Learner.connectToLeader(Learner.java:224)
        at org.apache.zookeeper.server.quorum.Follower.followLeader(Follower.java:71)
        at org.apache.zookeeper.server.quorum.QuorumPeer.run(QuorumPeer.java:740)





然后其他的的全是警告：

2013-12-31 10:54:41,969 [myid:2] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection@542] - Notification: 2 (n.leader), 0x500000141 (n.zxid), 0x6c (n.round), FOLLOWING (n.state), 1 (n.sid), 0x5 (n.peerEPoch), LOO
KING (my state)
2013-12-31 10:54:41,969 [myid:2] - INFO  [WorkerSender[myid=2]:QuorumCnxManager@190] - Have smaller server identifier, so dropping the connection: (5, 2)
2013-12-31 10:54:41,970 [myid:2] - WARN  [RecvWorker:2:QuorumCnxManager$RecvWorker@762] - Connection broken for id 2, my id = 2, error =
java.io.EOFException
        at java.io.DataInputStream.readInt(DataInputStream.java:375)
        at org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:747)
2013-12-31 10:54:41,970 [myid:2] - WARN  [RecvWorker:2:QuorumCnxManager$RecvWorker@765] - Interrupting SendWorker
2013-12-31 10:54:41,970 [myid:2] - INFO  [WorkerReceiver[myid=2]:FastLeaderElection@542] - Notification: 2 (n.leader), 0x500000141 (n.zxid), 0x6c (n.round), FOLLOWING (n.state), 4 (n.sid), 0x5 (n.peerEPoch), LOO
KING (my state)
2013-12-31 10:54:41,970 [myid:2] - WARN  [SendWorker:2:QuorumCnxManager$SendWorker@679] - Interrupted while waiting for message on queue
java.lang.InterruptedException
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:1961)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2038)
        at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:347)
        at org.apache.zookeeper.server.quorum.QuorumCnxManager.pollSendQueue(QuorumCnxManager.java:831)
        at org.apache.zookeeper.server.quorum.QuorumCnxManager.access$500(QuorumCnxManager.java:62)
        at org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:667)
2013-12-31 10:54:41,970 [myid:2] - WARN  [SendWorker:2:QuorumCnxManager$SendWorker@688] - Send worker leaving thread
2013-12-31 10:54:52,985 [myid:2] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /192.168.1.78:55884
2013-12-31 10:54:52,990 [myid:2] - WARN  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@354] - Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
2013-12-31 10:54:52,991 [myid:2] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@1001] - Closed socket connection for client /192.168.1.78:55884 (no session established for client)
2013-12-31 10:54:53,424 [myid:2] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /192.168.1.76:42541
2013-12-31 10:54:53,663 [myid:2] - INFO  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxnFactory@197] - Accepted socket connection from /192.168.1.80:37185
2013-12-31 10:54:53,663 [myid:2] - WARN  [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2181:NIOServerCnxn@354] - Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running

fanbells 发表于 2013-12-31 10:57
分别查了hbase和zookeeper的日志，hbase没问题，问题在zookeeper，日志中只有一个错误okeeper.server.quo ...

你的zookeeper装的有问题，你用这个查一下zookeeper状态：service mapr-zookeeper qstatus， 还有把你的zookeeper配置贴出来。