新手搭建hadoop集群错误总结

about云日志分析项目准备6：Hadoop、Spark集群搭建
http://www.aboutyun.com/forum.php?mod=viewthread&tid=20620


跟着文章搭建了hadoop，这次没有复制果然出现了问题，总结如下：问题1
FATAL org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices: Failed to initialize mapreduce-shuffle
java.lang.IllegalArgumentException: The ServiceName: mapreduce-shuffle set in yarn.nodemanager.aux-services is invalid.The valid service name should o
nly contain a-zA-Z0-9_ and can not start with numbers
        at com.google.common.base.Preconditions.checkArgument(Preconditions.java:88)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices.serviceInit(AuxServices.java:114)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.serviceInit(ContainerManagerImpl.java:237)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:107)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceInit(NodeManager.java:256)
        at org.apache.hadoop.service.AbstractService.init(AbstractService.java:163)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:490)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:537)
2017-01-18 19:25:32,715 INFO org.apache.hadoop.service.AbstractService: Service org.apache.hadoop.yarn.server.nodemanager.containermanager.AuxServices
failed in state INITED; cause: java.lang.IllegalArgumentException: The ServiceName: mapreduce-shuffle set in yarn.nodemanager.aux-services is invalid
.The valid service name should only contain a-zA-Z0-9_ and can not start with numbers
java.lang.IllegalArgumentException: The ServiceName: mapreduce-shuffle set in yarn.nodemanager.aux-services is invalid.The valid service name should o
nly contain a-zA-Z0-9_ and can not start with numbers
        at com.google.common.base.Preconditions.checkArgument(Preconditions.java:88)

这里主要配置文件错误
本来为<value></value>
却写成了<value><value>没有了结束标记

问题2
17/01/18 19:22:46 INFO namenode.NameNode: registered UNIX signal handlers for [TERM, HUP, INT]
17/01/18 19:22:46 INFO namenode.NameNode: createNameNode [-format]
[Fatal Error] core-site.xml:30:12: The element type "valye" must be terminated by the matching end-tag "</valye>".
17/01/18 19:22:46 FATAL conf.Configuration: error parsing conf core-site.xml
org.xml.sax.SAXParseException; systemId: file:/data/hadoop/etc/hadoop/core-site.xml; lineNumber: 30; columnNumber: 12; The element type "valye" must be terminated by the matching end-tag "</valye>".
        at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
        at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
        at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:150)
        at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2432)
        at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2420)
        at org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2491)
        at org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2444)
        at org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2361)
        at org.apache.hadoop.conf.Configuration.set(Configuration.java:1099)
        at org.apache.hadoop.conf.Configuration.set(Configuration.java:1071)
        at org.apache.hadoop.conf.Configuration.setBoolean(Configuration.java:1409)
        at org.apache.hadoop.util.GenericOptionsParser.processGeneralOptions(GenericOptionsParser.java:319)
        at org.apache.hadoop.util.GenericOptionsParser.parseGeneralOptions(GenericOptionsParser.java:485)
        at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:170)
        at org.apache.hadoop.util.GenericOptionsParser.<init>(GenericOptionsParser.java:153)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1375)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1512)
17/01/18 19:22:46 FATAL namenode.NameNode: Failed to start namenode.

修改yarn-site文件：
yarn.nodemanager.aux-services
值为： mapreduce-shuffle
非mapreduce_shuffle

好好学习，天天向上