分享

利用phoenix 查询hbase中大量数据时报错。。。。菜鸟求助

梦~天涯 发表于 2015-12-4 10:38:09 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 4 22034
我利用mapreduce录入了大概几千万的数据到Hbase的一张表中,现在想利用phoenix统计一下总条数,却总报错........
PS:数据应该是没问题的,我用limit可以查出数据   
现在就不知道是什么问题,求大神帮助........


15/12/04 10:09:27 WARN client.ScannerCallable: Ignore, probably already closed
org.apache.hadoop.hbase.UnknownScannerException: org.apache.hadoop.hbase.UnknownScannerException: Name: 958, already closed?
        at org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3221)
        at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:30946)
        at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2109)
        at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
        at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
        at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
        at java.lang.Thread.run(Thread.java:745)

        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
        at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
        at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
        at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:287)
        at org.apache.hadoop.hbase.client.ScannerCallable.close(ScannerCallable.java:303)
        at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:159)
        at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:58)
        at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:115)
        at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:91)
        at org.apache.hadoop.hbase.client.ClientScanner.close(ClientScanner.java:481)
        at org.apache.phoenix.iterate.ScanningResultIterator.close(ScanningResultIterator.java:44)
        at org.apache.phoenix.iterate.TableResultIterator.close(TableResultIterator.java:92)
        at org.apache.phoenix.iterate.SpoolingResultIterator.<init>(SpoolingResultIterator.java:129)
        at org.apache.phoenix.iterate.SpoolingResultIterator.<init>(SpoolingResultIterator.java:75)
        at org.apache.phoenix.iterate.SpoolingResultIterator$SpoolingResultIteratorFactory.newIterator(SpoolingResultIterator.java:69)
        at org.apache.phoenix.iterate.ParallelIterators$1.call(ParallelIterators.java:94)
        at org.apache.phoenix.iterate.ParallelIterators$1.call(ParallelIterators.java:85)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at org.apache.phoenix.job.JobManager$InstrumentedJobFutureTask.run(JobManager.java:172)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.UnknownScannerException): org.apache.hadoop.hbase.UnknownScannerException: Name: 958, already closed?
        at org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3221)
        at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:30946)
        at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2109)
        at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:101)
        at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:130)
        at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:107)
        at java.lang.Thread.run(Thread.java:745)

        at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1457)
        at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1661)
        at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1719)
        at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:31392)
        at org.apache.hadoop.hbase.client.ScannerCallable.close(ScannerCallable.java:301)
        ... 17 more
java.lang.RuntimeException: java.sql.SQLTimeoutException: Operation timed out
        at sqlline.IncrementalRows.hasNext(IncrementalRows.java:73)
        at sqlline.TableOutputFormat.print(TableOutputFormat.java:33)
        at sqlline.SqlLine.print(SqlLine.java:1653)
        at sqlline.Commands.execute(Commands.java:833)
        at sqlline.Commands.sql(Commands.java:732)
        at sqlline.SqlLine.dispatch(SqlLine.java:808)
        at sqlline.SqlLine.begin(SqlLine.java:681)
        at sqlline.SqlLine.start(SqlLine.java:398)
        at sqlline.SqlLine.main(SqlLine.java:292)
0: jdbc:phoenix:cmcc2:2181> java.io.IOException: 输入/输出错误
        at java.io.FileInputStream.read0(Native Method)
        at java.io.FileInputStream.read(FileInputStream.java:210)
        at jline.internal.NonBlockingInputStream.read(NonBlockingInputStream.java:169)
        at jline.internal.NonBlockingInputStream.read(NonBlockingInputStream.java:137)
        at jline.internal.NonBlockingInputStream.read(NonBlockingInputStream.java:246)
        at jline.internal.InputStreamReader.read(InputStreamReader.java:261)
        at jline.internal.InputStreamReader.read(InputStreamReader.java:198)
        at jline.console.ConsoleReader.readCharacter(ConsoleReader.java:2038)
        at jline.console.ConsoleReader.readLine(ConsoleReader.java:2242)
        at jline.console.ConsoleReader.readLine(ConsoleReader.java:2162)
        at sqlline.SqlLine.begin(SqlLine.java:681)
        at sqlline.SqlLine.start(SqlLine.java:398)
        at sqlline.SqlLine.main(SqlLine.java:292)

已有(4)人评论

跳转到指定楼层
here_bigdata 发表于 2015-12-4 12:14:08
1.建个hbase表。丢个10条数据。
2.隐射到phoenix。
3.phoenix -count试下能不能count条数。
以上是确定这个表问题还是phoenix集成hbase问题。
回复

使用道具 举报

lmlm1234 发表于 2015-12-4 19:21:13
利用phoenix 查询hbase中大量数据时报错
回复

使用道具 举报

梦~天涯 发表于 2015-12-9 10:14:18
here_bigdata 发表于 2015-12-4 12:14
1.建个hbase表。丢个10条数据。
2.隐射到phoenix。
3.phoenix -count试下能不能count条数。

数据量小的时候是没问题的,不过在Hbase shell 里面创建的表在phoenix里面看不见,而在phoenix里面创建的表在Hbase shell里面是可以看见的,各种操作也没问题
回复

使用道具 举报

小北酱 发表于 2015-12-23 16:20:46
它本身就是这样的,Phoenix无法查询到其他途径(比如Hbase shell mapreduce等等)进入Hbase的数据,我们公司已经弃用Phoenix了
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条