分享

本地win7 nutch 注册网站到hbase

aqi915 发表于 2015-8-21 15:29:01 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 1 10970
本地win7 nutch2.3 注入到服务器hbase0.98.8
我看了 yarn-hadoop-resourcemanager-ktbigdata1.log  日志,是看这个日志么?还有其它日志需要看看么?

610 2015-08-21 15:14:52,922 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Allocated new applicationId: 4
611 2015-08-21 15:14:53,554 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: Storing application with id application_1440123848885_    0004
612 2015-08-21 15:14:53,555 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1440123848885_0004 State change from NEW t    o NEW_SAVING
613 2015-08-21 15:14:53,555 INFO org.apache.hadoop.yarn.server.resourcemanager.recovery.RMStateStore: Storing info for app: application_1440123848885_    0004
614 2015-08-21 15:14:53,555 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1440123848885_0004 State change from NEW_S    AVING to SUBMITTED
615 2015-08-21 15:14:53,555 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application added - appId: application_    1440123848885_0004 user: hyq leaf-queue of parent: root #applications: 1
616 2015-08-21 15:14:53,555 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Accepted application application_    1440123848885_0004 from user: hyq, in queue: default
617 2015-08-21 15:14:53,561 INFO org.apache.hadoop.yarn.server.resourcemanager.ClientRMService: Application with id 4 submitted by user hyq
618 2015-08-21 15:14:53,561 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAuditLogger: USER=hyq      IP=192.168.3.107        OPERATION=Submit A    pplication Request    TARGET=ClientRMService  RESULT=SUCCESS  APPID=application_1440123848885_0004
619 2015-08-21 15:14:53,581 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.RMAppImpl: application_1440123848885_0004 State change from SUBMI    TTED to ACCEPTED
620 2015-08-21 15:14:53,597 INFO org.apache.hadoop.yarn.server.resourcemanager.ApplicationMasterService: Registering app attempt : appattempt_14401238    48885_0004_000001
621 2015-08-21 15:14:53,598 INFO org.apache.hadoop.yarn.server.resourcemanager.rmapp.attempt.RMAppAttemptImpl: appattempt_1440123848885_0004_000001 St    ate change from NEW to SUBMITTED
622 2015-08-21 15:14:53,598 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application application_1440123848885_000    4 from user: hyq activated in queue: default
@
                                                                                                                                    611,5         80%
731 Diagnostics: Exception from container-launch.
732 Container id: container_1440123848885_0004_02_000001
733 Exit code: 1
734 Stack trace: ExitCodeException exitCode=1:
735         at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
736         at org.apache.hadoop.util.Shell.run(Shell.java:456)
737         at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
738         at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
739         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
740         at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
741         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
742         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
743         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
744         at java.lang.Thread.run(Thread.java:745)
745
746
747 Container exited with a non-zero exit code 1
748 Failing this attempt. Failing the application.  APPID=application_1440123848885_0004
749 2015-08-21 15:15:02,134 INFO org.apache.hadoop.yarn.server.resourcemanager.RMAppManager$ApplicationSummary: appId=application_1440123848885_0004,n    ame=inject /urls/seed.txt,user=hyq,queue=default,state=FAILED,trackingUrl=http://ktbigdata1:8088/cluster/app/application_1440123848885_0004,appMas    terHost=N/A,startTime=1440141293554,finishTime=1440141302133,finalStatus=FAILED,memorySeconds=16420,vcoreSeconds=8,preemptedAMContainers=0,preempt    edNonAMContainers=0,preemptedResources=<memory:0\, vCores:0>,applicationType=MAPREDUCE
750 2015-08-21 15:15:02,134 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.CapacityScheduler: Application Attempt appattempt_14    40123848885_0004_000002 is done. finalState=FAILED
751 2015-08-21 15:15:02,136 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: Application application_1440123848885_0004     requests cleared
752 2015-08-21 15:15:02,136 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.LeafQueue: Application removed - appId: application_    1440123848885_0004 user: hyq queue: default #user-pending-applications: 0 #user-active-applications: 0 #queue-pending-applications: 0 #queue-activ    e-applications: 0
753 2015-08-21 15:15:02,136 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Application removed - appId: applicatio    n_1440123848885_0004 user: hyq leaf-queue of parent: root #applications: 0
754 2015-08-21 15:15:03,324 INFO org.apache.hadoop.ipc.Server: Socket Reader #1 for port 8032: readAndProcess from client 192.168.3.107 threw exceptio    n [java.io.IOException: Connection reset by peer]
755 java.io.IOException: Connection reset by peer
756         at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
757         at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
758         at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
759         at sun.nio.ch.IOUtil.read(IOUtil.java:197)
760         at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:380)
761         at org.apache.hadoop.ipc.Server.channelRead(Server.java:2603)
762         at org.apache.hadoop.ipc.Server.access$2800(Server.java:136)
763         at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1481)
764         at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:771)
765         at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:637)
766         at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:608)


这权限有问题么?

已有(1)人评论

跳转到指定楼层
xuanxufeng 发表于 2015-8-21 16:04:22
应该是hbase的问题。
试试这个帖子

HBase异常:java.io.IOException: Connection reset by peer解决办法汇总
http://www.aboutyun.com/thread-8522-1-1.html



回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条