分享

myeclipse连接hadoop 运行程序报错 Unable to load native-hadoop library for yo...

hyj 发表于 2014-7-9 21:21:42 [显示全部楼层] 只看大图 回帖奖励 阅读模式 关闭右栏 1 14790


myeclipse连接hadoop  运行程序报错

  1. 014-07-09 13:52:11,755 WARN  [main] util.NativeCodeLoader (NativeCodeLoader.java:<clinit>(62)) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
  2. 2014-07-09 13:52:12,088 INFO  [main] Configuration.deprecation (Configuration.java:warnOnceIfDeprecated(1009)) - session.id is deprecated. Instead, use dfs.metrics.session-id
  3. 2014-07-09 13:52:12,088 INFO  [main] jvm.JvmMetrics (JvmMetrics.java:init(76)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
  4. 2014-07-09 13:52:12,340 WARN  [main] mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(150)) - Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
  5. 2014-07-09 13:52:12,431 WARN  [main] mapreduce.JobSubmitter (JobSubmitter.java:copyAndConfigureFiles(259)) - No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
  6. 2014-07-09 13:52:12,476 INFO  [main] input.FileInputFormat (FileInputFormat.java:listStatus(280)) - Total input paths to process : 3
  7. 2014-07-09 13:52:12,866 INFO  [main] mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(396)) - number of splits:3
  8. 2014-07-09 13:52:13,099 INFO  [main] mapreduce.JobSubmitter (JobSubmitter.java:printTokens(479)) - Submitting tokens for job: job_local83804529_0001
  9. 2014-07-09 13:52:13,134 WARN  [main] conf.Configuration (Configuration.java:loadProperty(2358)) - file:/tmp/hadoop-Administrator/mapred/staging/Administrator83804529/.staging/job_local83804529_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.retry.interval;  Ignoring.
  10. 2014-07-09 13:52:13,139 WARN  [main] conf.Configuration (Configuration.java:loadProperty(2358)) - file:/tmp/hadoop-Administrator/mapred/staging/Administrator83804529/.staging/job_local83804529_0001/job.xml:an attempt to override final parameter: mapreduce.job.end-notification.max.attempts;  Ignoring.
  11. 2014-07-09 13:52:13,199 INFO  [main] mapreduce.JobSubmitter (JobSubmitter.java:submitJobInternal(441)) - Cleaning up the staging area file:/tmp/hadoop-Administrator/mapred/staging/Administrator83804529/.staging/job_local83804529_0001
  12. Exception in thread "main" java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Ljava/lang/String;I)Z
  13.         at org.apache.hadoop.io.nativeio.NativeIO$Windows.access0(Native Method)
  14.         at org.apache.hadoop.io.nativeio.NativeIO$Windows.access(NativeIO.java:570)
  15.         at org.apache.hadoop.fs.FileUtil.canRead(FileUtil.java:977)
  16.         at org.apache.hadoop.util.DiskChecker.checkAccessByFileMethods(DiskChecker.java:173)
  17.         at org.apache.hadoop.util.DiskChecker.checkDirAccess(DiskChecker.java:160)
  18.         at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:94)
  19.         at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.confChanged(LocalDirAllocator.java:285)
  20.         at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:344)
  21.         at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:150)
  22.         at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:131)
  23.         at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:115)
  24.         at org.apache.hadoop.mapred.LocalDistributedCacheManager.setup(LocalDistributedCacheManager.java:131)
  25.         at org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(LocalJobRunner.java:163)
  26.         at org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:731)
  27.         at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)
  28.         at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
  29.         at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
  30.         at java.security.AccessController.doPrivileged(Native Method)
  31.         at javax.security.auth.Subject.doAs(Subject.java:396)
  32.         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
  33.         at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
  34.         at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303)
  35.         at test.WordCount.main(WordCount.java:71)
复制代码



已有(1)人评论

跳转到指定楼层
nettman 发表于 2014-7-9 21:22:15
本帖最后由 nettman 于 2014-7-9 21:34 编辑
缺组件,参考这个 QQ截图20140709213411.png
windows通过hadoop-eclipse-plugin插件远程开发hadoop运行mapreduce遇到问题及解决
http://www.aboutyun.com/thread-8311-1-1.html



回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条