分享

报 [org.apache.oozie.action.hadoop.HiveMain], exit code [40000]]

starrycheng 发表于 2015-6-10 20:19:56 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 0 32815
我运行的oozie版本:3.3.2-cdh4.5.0

我使用oozie自带的运行hive的示例,在oozie界面,任务killed,errcode:40000

在hue中查看job日志,stdout:
>>> Invoking Hive command line now >>>

Hadoop Job IDs executed by Hive:

Intercepting System.exit(40000)

<<< Invocation of Main class completed <<<

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.HiveMain], exit code [40000]

Oozie Launcher failed, finishing Hadoop job gracefully


Oozie Launcher ends

stderr的日志如下:
Logging initialized using configuration in jar:file:/online/data/2/mapred/local/taskTracker/distcache/-8918856701426255996_-1806165528_38729214/TelDB1/user/oozie/share/lib/hive/hive-common-0.10.0-cdh4.5.0.jar!/hive-log4j.properties
Hive history file=/tmp/mapred/hive_job_log_01684610-2996-4b5a-af9c-c50a6332ec74_1059317739.txt
OK
Time taken: 4.003 seconds
FAILED: SemanticException Error creating temporary folder on: /user/oozie/examples/output-data/hive
Log file: /online/data/3/mapred/local/taskTracker/oozie/jobcache/job_201405061357_0020/attempt_201405061357_0020_m_000000_0/work/hive-oozie-job_201405061357_0020.log  not present. Therefore no Hadoop jobids found
Intercepting System.exit(40000)
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.HiveMain], exit code [40000]

syslog的日志如下:
2014-05-07 17:15:40,567 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
2014-05-07 17:15:40,977 INFO org.apache.hadoop.mapred.TaskRunner: Creating symlink: /online/data/3/mapred/local/taskTracker/distcache/-1267092568995481482_-1071306822_1332872245/TelDB1/user/oozie/examples/apps/hive/script.q <- /online/data/3/mapred/local/taskTracker/oozie/jobcache/job_201405061357_0020/attempt_201405061357_0020_m_000000_0/work/script.q
2014-05-07 17:15:41,023 WARN org.apache.hadoop.conf.Configuration: session.id is deprecated. Instead, use dfs.metrics.session-id
2014-05-07 17:15:41,024 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=MAP, sessionId=
2014-05-07 17:15:41,289 INFO org.apache.hadoop.util.ProcessTree: setsid exited with exit code 0
2014-05-07 17:15:41,293 INFO org.apache.hadoop.mapred.Task:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@333d314e
2014-05-07 17:15:41,514 INFO org.apache.hadoop.mapred.MapTask: Processing split: hdfs://TelDB1:8020/user/oozie/oozie-oozi/0000013-140506143427421-oozie-oozi-W/hive-node--hive/input/dummy.txt:0+5
2014-05-07 17:15:41,528 WARN mapreduce.Counters: Counter name MAP_INPUT_BYTES is deprecated. Use FileInputFormatCounters as group name and  BYTES_READ as counter name instead
2014-05-07 17:15:41,531 INFO org.apache.hadoop.mapred.MapTask: numReduceTasks: 0

且job的状态均是succeeded,请高人指点一下,我这是哪出的错吗?

################################
这个问题不知道什么原因,但是我在workflow.xml中,configuration节点中加入
[mw_shl_code=xml,true]<property>
<name>hive.metastore.uris</name>
<value>thrift://TelDB1:9083</value>
</property>[/mw_shl_code]
再执行,就成功了




没找到任何评论,期待你打破沉寂

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条