分享

安装配置Hive时报错

bbbbb001 发表于 2013-10-16 13:38:44 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 4 9493
安装配置Hive时报错:
FAILED: Error in metadata: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask
用调试模式报错如下:
[root@hadoop1 bin]# hive -hiveconf hive.root.logger=DEBUG,console
13/10/09 16:16:27 DEBUG common.LogUtils: Using hive-site.xml found on CLASSPATH at /opt/hive-0.11.0/conf/hive-site.xml
13/10/09 16:16:27 DEBUG conf.Configuration: java.io.IOException: config()
        at org.apache.hadoop.conf.Configuration.[i](Configuration.java:227)
        at org.apache.hadoop.conf.Configuration.[i](Configuration.java:214)
        at org.apache.hadoop.hive.conf.HiveConf.[i](HiveConf.java:1039)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:636)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
13/10/09 16:16:27 DEBUG conf.Configuration: java.io.IOException: config()
        at org.apache.hadoop.conf.Configuration.[i](Configuration.java:227)
        at org.apache.hadoop.conf.Configuration.[i](Configuration.java:214)
        at org.apache.hadoop.mapred.JobConf.[i](JobConf.java:330)
        at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:1073)
        at org.apache.hadoop.hive.conf.HiveConf.[i](HiveConf.java:1040)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:636)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Logging initialized using configuration in file:/opt/hive-0.11.0/conf/hive-log4j.properties
13/10/09 16:16:27 INFO SessionState:
Logging initialized using configuration in file:/opt/hive-0.11.0/conf/hive-log4j.properties
13/10/09 16:16:27 DEBUG parse.VariableSubstitution: Substitution is on: hive
Hive history file=/tmp/root/hive_job_log_root_4666@hadoop1_201310091616_1069706211.txt
13/10/09 16:16:27 INFO exec.HiveHistory: Hive history file=/tmp/root/hive_job_log_root_4666@hadoop1_201310091616_1069706211.txt
13/10/09 16:16:27 DEBUG conf.Configuration: java.io.IOException: config()
        at org.apache.hadoop.conf.Configuration.[i](Configuration.java:227)
        at org.apache.hadoop.conf.Configuration.[i](Configuration.java:214)
        at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:187)
        at org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:239)
        at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:438)
        at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:424)
        at org.apache.hadoop.hive.shims.HadoopShimsSecure.getUGIForConf(HadoopShimsSecure.java:491)
        at org.apache.hadoop.hive.ql.security.HadoopDefaultAuthenticator.setConf(HadoopDefaultAuthenticator.java:51)
        at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)
        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
        at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthenticator(HiveUtils.java:365)
        at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:270)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:670)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
13/10/09 16:16:27 DEBUG security.Groups:  Creating new Groups object
13/10/09 16:16:27 DEBUG security.Groups: Group mapping impl=org.apache.hadoop.security.ShellBasedUnixGroupsMapping; cacheTimeout=300000
13/10/09 16:16:27 DEBUG security.UserGroupInformation: hadoop login
13/10/09 16:16:27 DEBUG security.UserGroupInformation: hadoop login commit
13/10/09 16:16:27 DEBUG security.UserGroupInformation: using local user:UnixPrincipal锛?root
13/10/09 16:16:27 DEBUG security.UserGroupInformation: UGI loginUser:root
13/10/09 16:16:27 DEBUG security.Groups: Returning fetched groups for 'root'
13/10/09 16:16:27 DEBUG security.Groups: Returning cached groups for 'root'
13/10/09 16:16:27 DEBUG conf.Configuration: java.io.IOException: config(config)
        at org.apache.hadoop.conf.Configuration.[i](Configuration.java:260)
        at org.apache.hadoop.hive.conf.HiveConf.[i](HiveConf.java:1044)
        at org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider.init(DefaultHiveAuthorizationProvider.java:30)
        at org.apache.hadoop.hive.ql.security.authorization.HiveAuthorizationProviderBase.setConf(HiveAuthorizationProviderBase.java:108)
        at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)
        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
        at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:339)
        at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:272)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:670)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
13/10/09 16:16:27 DEBUG conf.Configuration: java.io.IOException: config()
        at org.apache.hadoop.conf.Configuration.[i](Configuration.java:227)
        at org.apache.hadoop.conf.Configuration.[i](Configuration.java:214)
        at org.apache.hadoop.mapred.JobConf.[i](JobConf.java:330)
        at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:1073)
        at org.apache.hadoop.hive.conf.HiveConf.[i](HiveConf.java:1045)
        at org.apache.hadoop.hive.ql.security.authorization.DefaultHiveAuthorizationProvider.init(DefaultHiveAuthorizationProvider.java:30)
        at org.apache.hadoop.hive.ql.security.authorization.HiveAuthorizationProviderBase.setConf(HiveAuthorizationProviderBase.java:108)
        at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:62)
        at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
        at org.apache.hadoop.hive.ql.metadata.HiveUtils.getAuthorizeProviderManager(HiveUtils.java:339)
        at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:272)
        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:670)
        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:614)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
              
               
                    hive
                    hadoop
                    metadata
               

已有(4)人评论

跳转到指定楼层
s060403072 发表于 2013-10-16 13:39:27

            这个错误应该是你集成了mysql,从而报错。解决方法是修改hive-site.xml,参照:
  javax.jdo.option.ConnectionURL
  jdbc:mysql://192.168.1.101:3306/hive?createDatabaseIfNotExist=true
  JDBC connect string for a JDBC metastore
也可参考:http://write.blog.csdn.net/postlist
        
回复

使用道具 举报

jxlhc09 发表于 2013-10-16 13:40:15

            引用 1 楼 s060403072 的回复:这个错误应该是你集成了mysql,从而报错。解决方法是修改hive-site.xml,参照:
  javax.jdo.option.ConnectionURL
  jdbc:mysql://192.168.1.101:3306/hive?createDatabaseIfNotExist=true
  JDBC connect string for a JDBC metastore
也可参考:http://write.blog.csdn.net/postlist

嗯 +1  看错误应该是元数据库配置有问题。
        
回复

使用道具 举报

bbbbb001 发表于 2013-10-16 13:40:51

            hite-site.xml已经配置过了,如下:
                hive.metastore.warehouse.dir
                /user/hive/warehouse
                locationof default database for the warehouse
        
        
                hive.exec.scratchdir
                /usr/hive/temp
                Scratchspace for Hive jobs
        
        
                javax.jdo.option.ConnectionURL
                jdbc:mysql://hadoop4:3306/hive?characterEncoding=UTF-8
        
        
                javax.jdo.option.ConnectionDriverName
                com.mysql.jdbc.Driver
        
        
                javax.jdo.option.ConnectionUserName
                hive
        
        
                javax.jdo.option.ConnectionPassword
                password
        
        
回复

使用道具 举报

s060403072 发表于 2013-10-16 13:41:48

            检查一下MySQL的hive用户(avax.jdo.option.ConnectionUserName:hive)在Hive安装的机器的IP上是否有足够的权限。
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条