分享

hbase开发环境搭建及运行hbase小实例(HBase 0.98.3新api)

pig2 2014-7-10 18:55:54 发表于 实操演练 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 35 172396
aqi915 发表于 2015-8-26 10:34:14

本地eclipse 连接 hadoop环境,hadoop2.7.1+hbase0.98.13报错

本帖最后由 aqi915 于 2015-8-26 10:44 编辑

本地eclipse 连接 hadoop环境,hadoop2.7.1+hbase0.98.13
对于MR 本地单独跑hdfs上的MR是可以成功的,但是要用MR的方式到hdfs上读文件入到hbase 报以下错误,会什么原因呢,怎么解决呢,目前自己感觉有可能是jar问题,classpath 问题,但不懂怎么解决?  
ps:之前MR跑hdfs数据也有这个错误,解决的方法是在map-site.xml,yarn-site.xml配置mapreduce.application.classpath路径。

现在本地开发hbase,要怎么修改呢,麻烦贵人相助下,感激不尽!!!
回复

使用道具 举报

Alkaloid0515 发表于 2015-8-26 13:40:40
aqi915 发表于 2015-8-26 10:34
本地eclipse 连接 hadoop环境,hadoop2.7.1+hbase0.98.13
对于MR 本地单独跑hdfs上的MR是可以成功的,但是 ...

会hadoop无插件开发吧,这个会了,hbase同样的道理,把hbase相关包都引用进来就ok了
回复

使用道具 举报

aqi915 发表于 2015-8-26 14:51:16

好烦扰

本帖最后由 aqi915 于 2015-8-26 15:04 编辑
Alkaloid0515 发表于 2015-8-26 13:40
会hadoop无插件开发吧,这个会了,hbase同样的道理,把hbase相关包都引用进来就ok了

额,我是用有插件的方法,run on hadoop ,hadoop可以,要把数据插到hbase ,不行了,hbase下的包是都加进来了


错误日志
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/D:/Software/hadoop-2.7.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/D:/Software/hbase-0.98.13/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
15/08/26 14:58:15 INFO client.RMProxy: Connecting to ResourceManager at ktbigdata1/192.168.100.141:8032
15/08/26 14:58:15 INFO Configuration.deprecation: dfs.socket.timeout is deprecated. Instead, use dfs.client.socket-timeout
15/08/26 14:58:15 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x1692bc4 connecting to ZooKeeper ensemble=192.168.100.142:2181,192.168.100.141:2181,192.168.100.143:2181
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09 GMT
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Client environment:host.name=hyq-PC
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Client environment:java.version=1.7.0_79
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Oracle Corporation
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Client environment:java.home=C:\Program Files (x86)\Java\jdk1.7.0_79\jre
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Client environment:java.class.path=E:\java\workspace\01_hbase_upload_file\bin;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\zookeeper-3.4.6.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\zookeeper-3.4.6-tests.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\xz-1.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\stax-api-1.0-2.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\servlet-api-2.5.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\protobuf-java-2.5.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\netty-3.6.2.Final.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\log4j-1.2.17.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\leveldbjni-all-1.8.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\jsr305-3.0.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\jetty-util-6.1.26.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\jetty-6.1.26.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\jettison-1.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\jersey-server-1.9.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\jersey-json-1.9.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\jersey-guice-1.9.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\jersey-core-1.9.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\jersey-client-1.9.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\jaxb-impl-2.2.3-1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\jaxb-api-2.2.2.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\javax.inject-1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\jackson-xc-1.9.13.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\jackson-mapper-asl-1.9.13.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\jackson-jaxrs-1.9.13.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\jackson-core-asl-1.9.13.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\guice-servlet-3.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\guice-3.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\guava-11.0.2.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\commons-logging-1.1.3.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\commons-lang-2.6.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\commons-io-2.4.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\commons-compress-1.4.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\commons-collections-3.2.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\commons-codec-1.4.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\commons-cli-1.2.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\asm-3.2.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\aopalliance-1.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\lib\activation-1.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\hadoop-yarn-server-web-proxy-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\hadoop-yarn-server-sharedcachemanager-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\hadoop-yarn-server-resourcemanager-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\hadoop-yarn-server-nodemanager-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\hadoop-yarn-server-common-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\hadoop-yarn-server-applicationhistoryservice-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\hadoop-yarn-registry-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\hadoop-yarn-common-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\hadoop-yarn-client-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\hadoop-yarn-applications-unmanaged-am-launcher-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\hadoop-yarn-applications-distributedshell-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\yarn\hadoop-yarn-api-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\xmlenc-0.52.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\xml-apis-1.3.04.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\xercesImpl-2.9.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\servlet-api-2.5.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\protobuf-java-2.5.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\netty-all-4.0.23.Final.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\netty-3.6.2.Final.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\log4j-1.2.17.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\leveldbjni-all-1.8.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\jsr305-3.0.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\jetty-util-6.1.26.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\jetty-6.1.26.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\jersey-server-1.9.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\jersey-core-1.9.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\jackson-mapper-asl-1.9.13.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\jackson-core-asl-1.9.13.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\htrace-core-3.1.0-incubating.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\guava-11.0.2.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\commons-logging-1.1.3.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\commons-lang-2.6.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\commons-io-2.4.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\commons-daemon-1.0.13.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\commons-codec-1.4.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\commons-cli-1.2.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\lib\asm-3.2.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\hadoop-hdfs-nfs-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\hdfs\hadoop-hdfs-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\xz-1.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\snappy-java-1.0.4.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\protobuf-java-2.5.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\paranamer-2.3.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\netty-3.6.2.Final.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\log4j-1.2.17.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\leveldbjni-all-1.8.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\junit-4.11.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\jersey-server-1.9.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\jersey-guice-1.9.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\jersey-core-1.9.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\javax.inject-1.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\jackson-mapper-asl-1.9.13.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\jackson-core-asl-1.9.13.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\hamcrest-core-1.3.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\hadoop-annotations-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\guice-servlet-3.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\guice-3.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\commons-io-2.4.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\commons-compress-1.4.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\avro-1.7.4.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\asm-3.2.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\lib\aopalliance-1.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\hadoop-mapreduce-client-shuffle-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\hadoop-mapreduce-client-jobclient-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\hadoop-mapreduce-client-hs-plugins-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\hadoop-mapreduce-client-hs-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\hadoop-mapreduce-client-core-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\hadoop-mapreduce-client-common-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\mapreduce\hadoop-mapreduce-client-app-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\zookeeper-3.4.6.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\xz-1.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\xmlenc-0.52.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\stax-api-1.0-2.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\snappy-java-1.0.4.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\slf4j-log4j12-1.7.10.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\slf4j-api-1.7.10.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\servlet-api-2.5.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\protobuf-java-2.5.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\paranamer-2.3.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\netty-3.6.2.Final.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\mockito-all-1.8.5.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\log4j-1.2.17.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\junit-4.11.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jsr305-3.0.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jsp-api-2.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jsch-0.1.42.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jetty-util-6.1.26.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jetty-6.1.26.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jettison-1.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jets3t-0.9.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jersey-server-1.9.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jersey-json-1.9.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jersey-core-1.9.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jaxb-impl-2.2.3-1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jaxb-api-2.2.2.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\java-xmlbuilder-0.4.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jackson-xc-1.9.13.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jackson-mapper-asl-1.9.13.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jackson-jaxrs-1.9.13.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\jackson-core-asl-1.9.13.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\httpcore-4.2.5.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\httpclient-4.2.5.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\htrace-core-3.1.0-incubating.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\hamcrest-core-1.3.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\hadoop-auth-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\hadoop-annotations-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\guava-11.0.2.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\gson-2.2.4.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\curator-recipes-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\curator-framework-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\curator-client-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\commons-net-3.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\commons-math3-3.1.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\commons-logging-1.1.3.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\commons-lang-2.6.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\commons-io-2.4.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\commons-httpclient-3.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\commons-digester-1.8.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\commons-configuration-1.6.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\commons-compress-1.4.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\commons-collections-3.2.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\commons-codec-1.4.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\commons-cli-1.2.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\commons-beanutils-core-1.8.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\commons-beanutils-1.7.0.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\avro-1.7.4.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\asm-3.2.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\api-util-1.0.0-M20.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\api-asn1-api-1.0.0-M20.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\apacheds-kerberos-codec-2.0.0-M15.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\apacheds-i18n-2.0.0-M15.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\lib\activation-1.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\hadoop-nfs-2.7.1.jar;D:\Software\hadoop-2.7.1\share\hadoop\common\hadoop-common-2.7.1.jar;D:\Software\hbase-0.98.13\lib\activation-1.1.jar;D:\Software\hbase-0.98.13\lib\aopalliance-1.0.jar;D:\Software\hbase-0.98.13\lib\asm-3.1.jar;D:\Software\hbase-0.98.13\lib\avro-1.7.4.jar;D:\Software\hbase-0.98.13\lib\commons-beanutils-1.7.0.jar;D:\Software\hbase-0.98.13\lib\commons-beanutils-core-1.8.0.jar;D:\Software\hbase-0.98.13\lib\commons-cli-1.2.jar;D:\Software\hbase-0.98.13\lib\commons-codec-1.7.jar;D:\Software\hbase-0.98.13\lib\commons-collections-3.2.1.jar;D:\Software\hbase-0.98.13\lib\commons-compress-1.4.1.jar;D:\Software\hbase-0.98.13\lib\commons-configuration-1.6.jar;D:\Software\hbase-0.98.13\lib\commons-daemon-1.0.13.jar;D:\Software\hbase-0.98.13\lib\commons-digester-1.8.jar;D:\Software\hbase-0.98.13\lib\commons-el-1.0.jar;D:\Software\hbase-0.98.13\lib\commons-httpclient-3.1.jar;D:\Software\hbase-0.98.13\lib\commons-io-2.4.jar;D:\Software\hbase-0.98.13\lib\commons-lang-2.6.jar;D:\Software\hbase-0.98.13\lib\commons-logging-1.1.1.jar;D:\Software\hbase-0.98.13\lib\commons-math-2.1.jar;D:\Software\hbase-0.98.13\lib\commons-net-3.1.jar;D:\Software\hbase-0.98.13\lib\findbugs-annotations-1.3.9-1.jar;D:\Software\hbase-0.98.13\lib\gmbal-api-only-3.0.0-b023.jar;D:\Software\hbase-0.98.13\lib\grizzly-framework-2.1.2.jar;D:\Software\hbase-0.98.13\lib\grizzly-http-2.1.2.jar;D:\Software\hbase-0.98.13\lib\grizzly-http-server-2.1.2.jar;D:\Software\hbase-0.98.13\lib\grizzly-http-servlet-2.1.2.jar;D:\Software\hbase-0.98.13\lib\grizzly-rcm-2.1.2.jar;D:\Software\hbase-0.98.13\lib\guava-12.0.1.jar;D:\Software\hbase-0.98.13\lib\guice-3.0.jar;D:\Software\hbase-0.98.13\lib\guice-servlet-3.0.jar;D:\Software\hbase-0.98.13\lib\hamcrest-core-1.3.jar;D:\Software\hbase-0.98.13\lib\hbase-annotations-0.98.13-hadoop2.jar;D:\Software\hbase-0.98.13\lib\hbase-checkstyle-0.98.13-hadoop2.jar;D:\Software\hbase-0.98.13\lib\hbase-client-0.98.13-hadoop2.jar;D:\Software\hbase-0.98.13\lib\hbase-common-0.98.13-hadoop2.jar;D:\Software\hbase-0.98.13\lib\hbase-common-0.98.13-hadoop2-tests.jar;D:\Software\hbase-0.98.13\lib\hbase-examples-0.98.13-hadoop2.jar;D:\Software\hbase-0.98.13\lib\hbase-hadoop2-compat-0.98.13-hadoop2.jar;D:\Software\hbase-0.98.13\lib\hbase-hadoop-compat-0.98.13-hadoop2.jar;D:\Software\hbase-0.98.13\lib\hbase-it-0.98.13-hadoop2.jar;D:\Software\hbase-0.98.13\lib\hbase-it-0.98.13-hadoop2-tests.jar;D:\Software\hbase-0.98.13\lib\hbase-prefix-tree-0.98.13-hadoop2.jar;D:\Software\hbase-0.98.13\lib\hbase-protocol-0.98.13-hadoop2.jar;D:\Software\hbase-0.98.13\lib\hbase-rest-0.98.13-hadoop2.jar;D:\Software\hbase-0.98.13\lib\hbase-server-0.98.13-hadoop2.jar;D:\Software\hbase-0.98.13\lib\hbase-server-0.98.13-hadoop2-tests.jar;D:\Software\hbase-0.98.13\lib\hbase-shell-0.98.13-hadoop2.jar;D:\Software\hbase-0.98.13\lib\hbase-testing-util-0.98.13-hadoop2.jar;D:\Software\hbase-0.98.13\lib\hbase-thrift-0.98.13-hadoop2.jar;D:\Software\hbase-0.98.13\lib\high-scale-lib-1.1.1.jar;D:\Software\hbase-0.98.13\lib\htrace-core-2.04.jar;D:\Software\hbase-0.98.13\lib\httpclient-4.1.3.jar;D:\Software\hbase-0.98.13\lib\httpcore-4.1.3.jar;D:\Software\hbase-0.98.13\lib\jackson-core-asl-1.8.8.jar;D:\Software\hbase-0.98.13\lib\jackson-jaxrs-1.8.8.jar;D:\Software\hbase-0.98.13\lib\jackson-mapper-asl-1.8.8.jar;D:\Software\hbase-0.98.13\lib\jackson-xc-1.8.8.jar;D:\Software\hbase-0.98.13\lib\jamon-runtime-2.3.1.jar;D:\Software\hbase-0.98.13\lib\jasper-compiler-5.5.23.jar;D:\Software\hbase-0.98.13\lib\jasper-runtime-5.5.23.jar;D:\Software\hbase-0.98.13\lib\javax.inject-1.jar;D:\Software\hbase-0.98.13\lib\javax.servlet-3.1.jar;D:\Software\hbase-0.98.13\lib\javax.servlet-api-3.0.1.jar;D:\Software\hbase-0.98.13\lib\jaxb-api-2.2.2.jar;D:\Software\hbase-0.98.13\lib\jaxb-impl-2.2.3-1.jar;D:\Software\hbase-0.98.13\lib\jcodings-1.0.8.jar;D:\Software\hbase-0.98.13\lib\jersey-client-1.8.jar;D:\Software\hbase-0.98.13\lib\jersey-core-1.8.jar;D:\Software\hbase-0.98.13\lib\jersey-grizzly2-1.9.jar;D:\Software\hbase-0.98.13\lib\jersey-guice-1.9.jar;D:\Software\hbase-0.98.13\lib\jersey-json-1.8.jar;D:\Software\hbase-0.98.13\lib\jersey-server-1.8.jar;D:\Software\hbase-0.98.13\lib\jersey-test-framework-core-1.9.jar;D:\Software\hbase-0.98.13\lib\jersey-test-framework-grizzly2-1.9.jar;D:\Software\hbase-0.98.13\lib\jets3t-0.6.1.jar;D:\Software\hbase-0.98.13\lib\jettison-1.3.1.jar;D:\Software\hbase-0.98.13\lib\jetty-6.1.26.jar;D:\Software\hbase-0.98.13\lib\jetty-sslengine-6.1.26.jar;D:\Software\hbase-0.98.13\lib\jetty-util-6.1.26.jar;D:\Software\hbase-0.98.13\lib\joni-2.1.2.jar;D:\Software\hbase-0.98.13\lib\jruby-complete-1.6.8.jar;D:\Software\hbase-0.98.13\lib\jsch-0.1.42.jar;D:\Software\hbase-0.98.13\lib\jsp-2.1-6.1.14.jar;D:\Software\hbase-0.98.13\lib\jsp-api-2.1-6.1.14.jar;D:\Software\hbase-0.98.13\lib\jsr305-1.3.9.jar;D:\Software\hbase-0.98.13\lib\junit-4.11.jar;D:\Software\hbase-0.98.13\lib\libthrift-0.9.0.jar;D:\Software\hbase-0.98.13\lib\log4j-1.2.17.jar;D:\Software\hbase-0.98.13\lib\management-api-3.0.0-b012.jar;D:\Software\hbase-0.98.13\lib\metrics-core-2.2.0.jar;D:\Software\hbase-0.98.13\lib\netty-3.6.6.Final.jar;D:\Software\hbase-0.98.13\lib\paranamer-2.3.jar;D:\Software\hbase-0.98.13\lib\protobuf-java-2.5.0.jar;D:\Software\hbase-0.98.13\lib\servlet-api-2.5-6.1.14.jar;D:\Software\hbase-0.98.13\lib\slf4j-api-1.6.4.jar;D:\Software\hbase-0.98.13\lib\slf4j-log4j12-1.6.4.jar;D:\Software\hbase-0.98.13\lib\snappy-java-1.0.4.1.jar;D:\Software\hbase-0.98.13\lib\xmlenc-0.52.jar;D:\Software\hbase-0.98.13\lib\xz-1.0.jar;D:\Software\hbase-0.98.13\lib\zookeeper-3.4.6.jar
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Client environment:java.library.path=C:\Program Files (x86)\Java\jdk1.7.0_79\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:/Program Files (x86)/Java/jdk1.7.0_79/bin/../jre/bin/client;C:/Program Files (x86)/Java/jdk1.7.0_79/bin/../jre/bin;C:/Program Files (x86)/Java/jdk1.7.0_79/bin/../jre/lib/i386;D:\Software\hadoop-2.7.1\bin;D:\Software\hbase-0.98.13\bin;C:\Program Files (x86)\Java\jdk1.7.0_79\bin;C:\Program Files (x86)\Java\jdk1.7.0_79\jre\bin;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;D:\Software\TortoiseSVN\bin;D:\Software\eclipse;;.
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=C:\Users\hadoop\AppData\Local\Temp\
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Client environment:os.name=Windows 7
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Client environment:os.arch=x86
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Client environment:os.version=6.1
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Client environment:user.name=hadoop
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Client environment:user.home=C:\Users\hadoop
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Client environment:user.dir=E:\java\workspace\01_hbase_upload_file
15/08/26 14:58:15 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=192.168.100.142:2181,192.168.100.141:2181,192.168.100.143:2181 sessionTimeout=90000 watcher=hconnection-0x1692bc40x0, quorum=192.168.100.142:2181,192.168.100.141:2181,192.168.100.143:2181, baseZNode=/hbase
15/08/26 14:58:15 INFO zookeeper.ClientCnxn: Opening socket connection to server 192.168.100.143/192.168.100.143:2181. Will not attempt to authenticate using SASL (unknown error)
15/08/26 14:58:15 INFO zookeeper.ClientCnxn: Socket connection established to 192.168.100.143/192.168.100.143:2181, initiating session
15/08/26 14:58:15 INFO zookeeper.ClientCnxn: Session establishment complete on server 192.168.100.143/192.168.100.143:2181, sessionid = 0x24f68c5e9cd0004, negotiated timeout = 90000
15/08/26 14:58:15 INFO mapreduce.TableOutputFormat: Created table instance for wlan_log
15/08/26 14:58:15 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
15/08/26 14:58:15 WARN mapreduce.JobResourceUploader: No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
15/08/26 14:58:15 INFO input.FileInputFormat: Total input paths to process : 1
15/08/26 14:58:15 INFO mapreduce.JobSubmitter: number of splits:1
15/08/26 14:58:16 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1440571810751_0002
15/08/26 14:58:16 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
15/08/26 14:58:16 INFO impl.YarnClientImpl: Submitted application application_1440571810751_0002
15/08/26 14:58:16 INFO mapreduce.Job: The url to track the job: http://ktbigdata1:8088/proxy/application_1440571810751_0002/
15/08/26 14:58:16 INFO mapreduce.Job: Running job: job_1440571810751_0002
15/08/26 14:58:23 INFO mapreduce.Job: Job job_1440571810751_0002 running in uber mode : false
15/08/26 14:58:23 INFO mapreduce.Job:  map 0% reduce 0%
15/08/26 14:58:23 INFO mapreduce.Job: Job job_1440571810751_0002 failed with state FAILED due to: Application application_1440571810751_0002 failed 2 times due to AM Container for appattempt_1440571810751_0002_000002 exited with  exitCode: 1
For more detailed output, check application tracking page:http://ktbigdata1:8088/cluster/app/application_1440571810751_0002Then, click on links to logs of each attempt.
Diagnostics: Exception from container-launch.
Container id: container_1440571810751_0002_02_000001
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
        at org.apache.hadoop.util.Shell.run(Shell.java:456)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
        at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
        at java.util.concurrent.FutureTask.run(FutureTask.java:262)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)


Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
15/08/26 14:58:23 INFO mapreduce.Job: Counters: 0


回复

使用道具 举报

xmhxmhxmh 发表于 2015-8-27 11:44:05
楼主,hbase-1.1.1用的多吗,大部分还是用0.98.3吗?
回复

使用道具 举报

itroad 发表于 2015-10-27 09:28:34
回复

使用道具 举报

Alkaloid0515 发表于 2015-10-27 11:19:38
aqi915 发表于 2015-8-26 14:51
额,我是用有插件的方法,run on hadoop ,hadoop可以,要把数据插到hbase ,不行了,hbase下的包是都加进 ...

版本是否兼容
回复

使用道具 举报

穷得意 发表于 2015-12-24 12:28:46
java.lang.NullPointerException
        at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.getSessionId(RecoverableZooKeeper.java:760)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.closeZooKeeperWatcher(HConnectionManager.java:1959)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.internalClose(HConnectionManager.java:2680)
        at org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(HConnectionManager.java:539)
        at org.apache.hadoop.hbase.client.HConnectionManager.deleteConnection(HConnectionManager.java:524)
        at org.apache.hadoop.hbase.client.HConnectionManager.deleteStaleConnection(HConnectionManager.java:489)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.close(HConnectionManager.java:2694)
        at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.abort(HConnectionManager.java:2624)
        at org.apache.hadoop.hbase.catalog.CatalogTracker.start(CatalogTracker.java:203)
        at org.apache.hadoop.hbase.client.HBaseAdmin.startCatalogTracker(HBaseAdmin.java:259)
        at org.apache.hadoop.hbase.client.HBaseAdmin.getCatalogTracker(HBaseAdmin.java:232)
        at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:303)
        at org.apache.hadoop.hbase.client.HBaseAdmin.tableExists(HBaseAdmin.java:319)
        at cn.com.adcc.test.HbaseUtil.creatTable(HbaseUtil.java:47)
        at cn.com.adcc.test.HbaseUtil.main(HbaseUtil.java:224)


这是什么原因啊?hbase0.98.16.1-hadoop2 在eclipse下,运行API
回复

使用道具 举报

xuliang123789 发表于 2016-2-6 09:22:11
学习一下,谢谢楼主,赞~~
回复

使用道具 举报

ml32 发表于 2016-3-23 20:31:51
hbase开发环境搭建及运行hbase小实例
回复

使用道具 举报

sunshine2813 发表于 2016-5-2 19:08:35
请问楼主,对于已经过时的 方法new HTableDescriptor(String tablename),用ctrl再点击这个方法会出现HTableDescriptor.class这个文件(这里是添加了从官网下载的hbase-src文件夹),里面有对应新的方法
[mw_shl_code=java,true]public HTableDescriptor(final TableName name) {
    super();
  }[/mw_shl_code]
但是再用ctrl+点击TableName就显示“source not found change attached source”等等。请问,这里该怎么添加source?非常感谢~
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条