分享

新手求教,在运行一个wordcount 提示如下错误,请帮忙看看什么问题。

fzu3144 发表于 2015-6-23 15:31:05 [显示全部楼层] 只看大图 回帖奖励 阅读模式 关闭右栏 9 27095
2015-06-23 15:24:29,181 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-06-23 15:24:30,144 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1173)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2015-06-23 15:24:30,146 INFO  [main] jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2015-06-23 15:24:50,331 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.65.150:9000. Already tried 0 time(s); maxRetries=45



已有(9)人评论

跳转到指定楼层
fzu3144 发表于 2015-6-23 16:09:21
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/I:/%e5%ae%89%e8%a3%85%e9%83%a8%e7%bd%b2/%e5%bc%95%e5%85%a5jar%e5%8c%85/hadoop-eclipse-plugin-2.2.0%e4%be%9d%e8%b5%96%e5%8c%85/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/I:/%e5%ae%89%e8%a3%85%e9%83%a8%e7%bd%b2/%e5%bc%95%e5%85%a5jar%e5%8c%85/hadoop-2.7.0/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2015-06-23 16:04:28,415 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-06-23 16:04:29,293 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1173)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2015-06-23 16:04:29,294 INFO  [main] jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2015-06-23 16:04:49,427 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.65.150:9000. Already tried 0 time(s); maxRetries=45
2015-06-23 16:05:09,429 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.65.150:9000. Already tried 1 time(s); maxRetries=45
2015-06-23 16:05:29,430 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.65.150:9000. Already tried 2 time(s); maxRetries=45
2015-06-23 16:05:49,431 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.65.150:9000. Already tried 3 time(s); maxRetries=45
2015-06-23 16:06:09,433 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.65.150:9000. Already tried 4 time(s); maxRetries=45
2015-06-23 16:06:29,439 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.65.150:9000. Already tried 5 time(s); maxRetries=45
2015-06-23 16:06:49,442 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.65.150:9000. Already tried 6 time(s); maxRetries=45
2015-06-23 16:07:09,453 WARN  [main] ipc.Client (Client.java:updateAddress(571)) - Address change detected. Old: master.localdomain/218.85.65.150:9000 New: master.localdomain/218.85.148.250:9000
2015-06-23 16:07:09,453 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.148.250:9000. Already tried 0 time(s); maxRetries=45
Exception in thread "main" java.net.ConnectException: Call From chuiting-PC/192.168.217.1 to master.localdomain:9000 failed on connection exception: java.net.ConnectException: Connection refused: no further information; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
        at java.lang.reflect.Constructor.newInstance(Unknown Source)
        at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:792)
        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:732)
        at org.apache.hadoop.ipc.Client.call(Client.java:1480)
        at org.apache.hadoop.ipc.Client.call(Client.java:1407)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
        at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source)
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:771)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
        at java.lang.reflect.Method.invoke(Unknown Source)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
        at com.sun.proxy.$Proxy10.getFileInfo(Unknown Source)
        at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2113)
        at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1305)
        at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1301)
        at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
        at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1301)
        at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1389)
        at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:145)
        at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:269)
        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:142)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Unknown Source)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
        at com.linewell.hadoop.hdfs.WordCount.main(WordCount.java:73)
Caused by: java.net.ConnectException: Connection refused: no further information
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(Unknown Source)
        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:495)
        at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:609)
        at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:707)
        at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:370)
        at org.apache.hadoop.ipc.Client.getConnection(Client.java:1529)
        at org.apache.hadoop.ipc.Client.call(Client.java:1446)
        ... 28 more
回复

使用道具 举报

fzu3144 发表于 2015-6-23 16:10:15
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/I:/%e5%ae%89%e8%a3%85%e9%83%a8%e7%bd%b2/%e5%bc%95%e5%85%a5jar%e5%8c%85/hadoop-eclipse-plugin-2.2.0%e4%be%9d%e8%b5%96%e5%8c%85/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/I:/%e5%ae%89%e8%a3%85%e9%83%a8%e7%bd%b2/%e5%bc%95%e5%85%a5jar%e5%8c%85/hadoop-2.7.0/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
2015-06-23 16:04:28,415 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2015-06-23 16:04:29,293 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1173)) - session.id is deprecated. Instead, use dfs.metrics.session-id
2015-06-23 16:04:29,294 INFO  [main] jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
2015-06-23 16:04:49,427 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.65.150:9000. Already tried 0 time(s); maxRetries=45
2015-06-23 16:05:09,429 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.65.150:9000. Already tried 1 time(s); maxRetries=45
2015-06-23 16:05:29,430 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.65.150:9000. Already tried 2 time(s); maxRetries=45
2015-06-23 16:05:49,431 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.65.150:9000. Already tried 3 time(s); maxRetries=45
2015-06-23 16:06:09,433 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.65.150:9000. Already tried 4 time(s); maxRetries=45
2015-06-23 16:06:29,439 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.65.150:9000. Already tried 5 time(s); maxRetries=45
2015-06-23 16:06:49,442 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.65.150:9000. Already tried 6 time(s); maxRetries=45
2015-06-23 16:07:09,453 WARN  [main] ipc.Client (Client.java:updateAddress(571)) - Address change detected. Old: master.localdomain/218.85.65.150:9000 New: master.localdomain/218.85.148.250:9000
2015-06-23 16:07:09,453 INFO  [main] ipc.Client (Client.java:handleConnectionTimeout(832)) - Retrying connect to server: master.localdomain/218.85.148.250:9000. Already tried 0 time(s); maxRetries=45
Exception in thread "main" java.net.ConnectException: Call From chuiting-PC/192.168.217.1 to master.localdomain:9000 failed on connection exception: java.net.ConnectException: Connection refused: no further information; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(Unknown Source)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(Unknown Source)
        at java.lang.reflect.Constructor.newInstance(Unknown Source)
        at org.apache.hadoop.net.NetUtils.wrapWithMessage(NetUtils.java:792)
        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:732)
        at org.apache.hadoop.ipc.Client.call(Client.java:1480)
        at org.apache.hadoop.ipc.Client.call(Client.java:1407)
        at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:229)
        at com.sun.proxy.$Proxy9.getFileInfo(Unknown Source)
        at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getFileInfo(ClientNamenodeProtocolTranslatorPB.java:771)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
        at java.lang.reflect.Method.invoke(Unknown Source)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
        at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
        at com.sun.proxy.$Proxy10.getFileInfo(Unknown Source)
        at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2113)
        at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1305)
        at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1301)
        at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
        at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1301)
        at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1389)
        at org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.checkOutputSpecs(FileOutputFormat.java:145)
        at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:269)
        at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:142)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
        at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Unknown Source)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
        at com.linewell.hadoop.hdfs.WordCount.main(WordCount.java:73)
Caused by: java.net.ConnectException: Connection refused: no further information
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(Unknown Source)
        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:531)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:495)
        at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:609)
        at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:707)
        at org.apache.hadoop.ipc.Client$Connection.access$2800(Client.java:370)
        at org.apache.hadoop.ipc.Client.getConnection(Client.java:1529)
        at org.apache.hadoop.ipc.Client.call(Client.java:1446)
        ... 28 more
回复

使用道具 举报

muyannian 发表于 2015-6-23 17:13:17
连接不上集群,看看集群是否启动
回复

使用道具 举报

fzu3144 发表于 2015-6-23 18:09:59
muyannian 发表于 2015-6-23 17:13
连接不上集群,看看集群是否启动

集群是连接的
26.jpg




QQ图片20150623180415.png
1.png
回复

使用道具 举报

muyannian 发表于 2015-6-23 18:23:20

master.localdomain/218.85.65.150:9000.

master是哪个ip,看到你好像有两个
回复

使用道具 举报

fzu3144 发表于 2015-6-24 08:14:15
muyannian 发表于 2015-6-23 18:23
master.localdomain/218.85.65.150:9000.

master是哪个ip,看到你好像有两个

这个IP也不知道哪里设的,正确的master:192.168.37.134 ,由于连接的是master.localdomain/218.85.65.150:9000. 导致连接不了,不知道哪里可以修改过来,eclipse连接虚拟机上的hadoop
回复

使用道具 举报

linbowei 发表于 2015-6-24 18:03:13
elipse能不能看到hadoop的文件目录,有可能是eclips版本的问题
回复

使用道具 举报

fzu3144 发表于 2015-6-25 09:30:27
linbowei 发表于 2015-6-24 18:03
elipse能不能看到hadoop的文件目录,有可能是eclips版本的问题

可以在hadoop下看到hdfs目录
回复

使用道具 举报

linbowei 发表于 2015-6-25 11:29:08
fzu3144 发表于 2015-6-25 09:30
可以在hadoop下看到hdfs目录

你查看一下在配置hadoop的jar包时,hadoop的存放路径是不是有中文的文件夹或者文件夹含有空格,比如你把hadoop解压在Program Files这个文件夹下面。就有可能报错。

回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条