求助: 搭建hadoop集群后，可以访问到HDFS管理界面，但MR管理界面访问不...

jps看进程ResourceManager也有 但就是进不了MR管理界面。。。不知道是什么问题。。。求助大神

我的主要配置文件core-site.xml、hdfs-site.xml、mapred-site.xml、yarn-site.xml如下：

core-site.xml

hdfs-site.xml

mapred-site.xml

yarn-site.xml

防火墙也都是关闭的  jps进程也是正常的。。有三台机器 一台namenode 两台datdanode。。跑mapreduce任务运行到running job就卡住

canqing 发表于 2018-5-30 21:17
防火墙也都是关闭的  jps进程也是正常的。。有三台机器 一台namenode 两台datdanode。。跑mapreduce任务运 ...

去日志目录下面，看下yarn的相关日志，包括nodemanger和resourcemanager.
replication最好改为3

我遇到过一样的问题，主要是yarn配置问题导致的，可参考附件

做ssh互信了吗

fly2015 发表于 2018-5-31 10:44
做ssh互信了吗

ssh免密登录么  做了的   

canqing 发表于 2018-5-31 20:20
ssh免密登录么  做了的

去看日志log下面的 关于nodemanager和resourcemanager

desehawk 发表于 2018-5-31 20:23
去看日志log下面的 关于nodemanager和resourcemanager

现在 MR管理界面 可以进去了  但运行Job任务报错了
错误信息：2018-06-01 02:54:44,320 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Setting up container Container: [ContainerId: container_1527792705592_0001_01_000001, NodeId: localhost:34587, NodeHttpAddress: localhost:8042, Resource: <memory:2048, vCores:1>, Priority: 0, Token: Token { kind: ContainerToken, service: 127.0.0.1:34587 }, ] for AM appattempt_1527792705592_0001_0000012018-06-01 02:54:44,320 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Command to launch container container_1527792705592_0001_01_000001 : $JAVA_HOME/bin/java -Dlog4j.configuration=container-log4j.properties -Dyarn.app.container.log.dir=<LOG_DIR> -Dyarn.app.container.log.filesize=0 -Dhadoop.root.logger=INFO,CLA  -Xmx1024m org.apache.hadoop.mapreduce.v2.app.MRAppMaster 1><LOG_DIR>/stdout 2><LOG_DIR>/stderr 2018-06-01 02:54:44,358 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Create AMRMToken for ApplicationAttempt: appattempt_1527792705592_0001_0000012018-06-01 02:54:44,360 INFO org.apache.hadoop.yarn.server.resourcemanager.security.AMRMTokenSecretManager: Creating password for appattempt_1527792705592_0001_0000012018-06-01 02:57:44,443 INFO org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher: Error launching appattempt_1527792705592_0001_000001. Got exception: java.net.ConnectException: Call From mini1/127.0.0.1 to localhost:34587 failed on connection exception: java.net.ConnectException: 拒绝连接; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused        at sun.reflect.GeneratedConstructorAccessor38.newInstance(Unknown Source)        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)        at java.lang.reflect.Constructor.newInstance(Constructor.java:526)        at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:791)        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:731)        at org.apache.hadoop.ipc.Client.call(Client.java:1473)        at org.apache.hadoop.ipc.Client.call(Client.java:1400)        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)        at com.sun.proxy.$Proxy79.startContainers(Unknown Source)        at org.apache.hadoop.yarn.api.impl.pb.client.ContainerManagementProtocolPBClientImpl.startContainers(ContainerManagementProtocolPBClientImpl.java:96)        at sun.reflect.GeneratedMethodAccessor15.invoke(Unknown Source)        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)        at java.lang.reflect.Method.invoke(Method.java:606)        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)        at com.sun.proxy.$Proxy80.startContainers(Unknown Source)        at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.launch(AMLauncher.java:119)        at org.apache.hadoop.yarn.server.resourcemanager.amlauncher.AMLauncher.run(AMLauncher.java:251)        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)        at java.lang.Thread.run(Thread.java:745)Caused by: java.net.ConnectException: 拒绝连接        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:530)        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:494)        at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:608)        at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:706)        at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:369)        at org.apache.hadoop.ipc.Client.getConnection(Client.java:1522)        at org.apache.hadoop.ipc.Client.call(Client.java:1439)        ... 15 more
不知道是啥问题   百度也没有找到解决方案

canqing 发表于 2018-5-31 22:00
现在 MR管理界面 可以进去了  但运行Job任务报错了
错误信息：2018-06-01 02:54:44,320 INFO org.apache ...

hosts贴出来看下