Hive 使用常见错误汇总--持续更新中

1.yarn 配置问题

yarn.nodemanager.resource.memory-mb

yarn.scheduler.maximum-allocation-mb

hive中执行

select disitnct col from table 或者 select count(*) from table
运行不出结果：
Hadoop job information for Stage-1: number of mappers: 8; number of reducers: 12017-02-01 18:36:45,901 Stage-1 map = 100%,  reduce = 100%Ended Job = job_1485875591763_0011 with errorsError during job, obtaining debugging information...FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask
通过作业地址查看详细的日志http://master:8088/proxy/application_1485947277468_0005/
发现以下错误日志信息：org.apache.hadoop.mapreduce.v2.app.rm.RMContainerAllocator: Could not deallocate container for task attemptId
从错误信息上来看是跟yarn容器资源的问题有关
想起来有两个配置项我自己手动调整过

yarn.nodemanager.resource.memory-mb=2G

yarn.scheduler.maximum-allocation-mb=4G

于是进入CM查看相应的配置信息，将配置信息恢复默认值，重启hive，问题解决。

默认值如下：

yarn.nodemanager.resource.memory-mb=8G

yarn.scheduler.maximum-allocation-mb=64G