分享

sqoop 将oracle数据导入hive报错,报错信息如下

yangyufans 发表于 2016-6-30 10:07:47 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 4 10342
[root@node28 logs]#  sqoop import --connect jdbc:oracle:thin:@10.211.55.38:1522:orcl --username YY --password yy --table TEST -m 1 --hive-import --hive-table "TEST"
Warning: /usr/local/sqoop-1.4.6/bin/../../hcatalog does not exist! HCatalog jobs will fail.
Please set $HCAT_HOME to the root of your HCatalog installation.
Warning: /usr/local/sqoop-1.4.6/bin/../../accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
Warning: /usr/local/sqoop-1.4.6/bin/../../zookeeper does not exist! Accumulo imports will fail.
Please set $ZOOKEEPER_HOME to the root of your Zookeeper installation.
16/06/29 22:03:48 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6
16/06/29 22:03:48 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
16/06/29 22:03:48 INFO tool.BaseSqoopTool: Using Hive-specific delimiters for output. You can override
16/06/29 22:03:48 INFO tool.BaseSqoopTool: delimiters with --fields-terminated-by, etc.
16/06/29 22:03:48 INFO oracle.OraOopManagerFactory: Data Connector for Oracle and Hadoop is disabled.
16/06/29 22:03:48 INFO manager.SqlManager: Using default fetchSize of 1000
16/06/29 22:03:48 INFO tool.CodeGenTool: Beginning code generation
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/local/hadoop-2.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/local/hbase-0.9.8/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
16/06/29 22:03:49 INFO manager.OracleManager: Time zone has been set to GMT
16/06/29 22:03:49 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM TEST t WHERE 1=0
16/06/29 22:03:49 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/local/hadoop-2.5.1/share/hadoop/mapreduce
Note: /tmp/sqoop-root/compile/8d072365d7e320829dbe4fa7cbd894a5/TEST.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
16/06/29 22:03:51 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-root/compile/8d072365d7e320829dbe4fa7cbd894a5/TEST.jar
16/06/29 22:03:51 INFO manager.OracleManager: Time zone has been set to GMT
16/06/29 22:03:51 INFO manager.OracleManager: Time zone has been set to GMT
16/06/29 22:03:51 INFO mapreduce.ImportJobBase: Beginning import of TEST
16/06/29 22:03:51 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
16/06/29 22:03:51 INFO manager.OracleManager: Time zone has been set to GMT
16/06/29 22:03:52 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
16/06/29 22:03:55 INFO db.DBInputFormat: Using read commited transaction isolation
16/06/29 22:03:55 INFO mapreduce.JobSubmitter: number of splits:1
16/06/29 22:03:55 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1467249797849_0007
16/06/29 22:03:56 INFO impl.YarnClientImpl: Submitted application application_1467249797849_0007
16/06/29 22:03:56 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/root/.staging/job_1467249797849_0007
Exception in thread "main" java.lang.NoSuchMethodError: org.apache.hadoop.http.HttpConfig.getSchemePrefix()Ljava/lang/String;
        at org.apache.hadoop.mapred.ClientServiceDelegate.getJobStatus(ClientServiceDelegate.java:428)
        at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:302)
        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:430)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1286)
        at org.apache.sqoop.mapreduce.ImportJobBase.doSubmitJob(ImportJobBase.java:196)
        at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:169)
        at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:266)
        at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:673)
        at org.apache.sqoop.manager.OracleManager.importTable(OracleManager.java:444)
        at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:497)
        at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
        at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
        at org.apache.sqoop.Sqoop.main(Sqoop.java:236)

已有(4)人评论

跳转到指定楼层
easthome001 发表于 2016-6-30 16:36:38
出现这个问题,应该是版本不兼容
回复

使用道具 举报

langke93 发表于 2016-7-1 15:06:45
sqoop 与hive版本不兼容,可能需要编译
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条