hadoop（2.x）以hadoop2.2为例完全分布式最新高可靠安装文档

这是一系列的好帖，赞一个

请问我的data文件夹里为什么没有文件啊  ，子节点的datanode 都启动不起来

11111111

翻了一下，这帖子里链接的链接的链接都是作者君写的，要不要这么牛逼。。。。。。。。。。。。。。。。。。。。。。

看完了  很详细

您好，我搭建好环境之后，计算一直卡着。
提示：17/03/18 16:37:14 INFO mapreduce.Job: Running job: job_1489822785960_0008
请问这个是什么原因呢

楼主，我的applications的时间跟外部时间不一致，会影响运算么？而且，在控制台里面看到的时间和applications里面的时间也不一样？请问这种应该怎么解决呢？

tan_323 发表于 2017-3-18 18:15
楼主，我的applications的时间跟外部时间不一致，会影响运算么？而且，在控制台里面看到的时间和applicatio ...

您好，我设置好了时区，也没用呢。

17/03/20 10:40:53 INFO mapreduce.Job: Job job_1489976045893_0001 running in uber mode : false
17/03/20 10:40:53 INFO mapreduce.Job:  map 0% reduce 0%
17/03/20 10:40:53 INFO mapreduce.Job: Job job_1489976045893_0001 failed with state FAILED due to: Application application_1489976045893_0001 failed 2 times due to ApplicationMaster for attempt appattempt_1489976045893_0001_000002 timed out. Failing the application.
17/03/20 10:40:53 INFO mapreduce.Job: Counters: 0
17/03/20 10:40:53 ERROR streaming.StreamJob: Job not Successful!
Streaming Command Failed!
您好，请问这个问题，应该怎么解决呢？在网上看了一下，都是说的代码错误，但是代码，我在单片机上面运行是没有问题的。

运行这个命令出现了以下信息：bin/hadoop jar share/hadoop/mapreduce/hadoop-mapreducexamples-2.2.0.jar pi 10 5
：
Number of Maps  = 10
Samples per Map = 5
Wrote input for Map #0
Wrote input for Map #1
Wrote input for Map #2
Wrote input for Map #3
Wrote input for Map #4
Wrote input for Map #5
Wrote input for Map #6
Wrote input for Map #7
Wrote input for Map #8
Wrote input for Map #9
Starting Job
17/03/23 16:54:56 INFO client.RMProxy: Connecting to ResourceManager at master/192.168.217.139:8032
17/03/23 16:54:56 INFO input.FileInputFormat: Total input paths to process : 10
17/03/23 16:54:56 INFO mapreduce.JobSubmitter: number of splits:10
17/03/23 16:54:56 INFO Configuration.deprecation: user.name is deprecated. Instead, use mapreduce.job.user.name
17/03/23 16:54:56 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
17/03/23 16:54:56 INFO Configuration.deprecation: mapred.map.tasks.speculative.execution is deprecated. Instead, use mapreduce.map.speculative
17/03/23 16:54:56 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
17/03/23 16:54:56 INFO Configuration.deprecation: mapred.output.value.class is deprecated. Instead, use mapreduce.job.output.value.class
17/03/23 16:54:56 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative
17/03/23 16:54:56 INFO Configuration.deprecation: mapreduce.map.class is deprecated. Instead, use mapreduce.job.map.class
17/03/23 16:54:56 INFO Configuration.deprecation: mapred.job.name is deprecated. Instead, use mapreduce.job.name
17/03/23 16:54:56 INFO Configuration.deprecation: mapreduce.reduce.class is deprecated. Instead, use mapreduce.job.reduce.class
17/03/23 16:54:56 INFO Configuration.deprecation: mapreduce.inputformat.class is deprecated. Instead, use mapreduce.job.inputformat.class
17/03/23 16:54:56 INFO Configuration.deprecation: mapred.input.dir is deprecated. Instead, use mapreduce.input.fileinputformat.inputdir
17/03/23 16:54:56 INFO Configuration.deprecation: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir
17/03/23 16:54:56 INFO Configuration.deprecation: mapreduce.outputformat.class is deprecated. Instead, use mapreduce.job.outputformat.class
17/03/23 16:54:56 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
17/03/23 16:54:56 INFO Configuration.deprecation: mapred.output.key.class is deprecated. Instead, use mapreduce.job.output.key.class
17/03/23 16:54:56 INFO Configuration.deprecation: mapred.working.dir is deprecated. Instead, use mapreduce.job.working.dir
17/03/23 16:54:56 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1490253778814_0004
17/03/23 16:54:57 INFO impl.YarnClientImpl: Submitted application application_1490253778814_0004 to ResourceManager at master/192.168.217.139:8032
17/03/23 16:54:57 INFO mapreduce.Job: The url to track the job: http://master:8088/proxy/application_1490253778814_0004/
17/03/23 16:54:57 INFO mapreduce.Job: Running job: job_1490253778814_0004
17/03/23 17:43:01 INFO mapreduce.Job: Job job_1490253778814_0004 running in uber mode : false
17/03/23 17:43:01 INFO mapreduce.Job:  map 0% reduce 0%
17/03/23 17:43:01 INFO mapreduce.Job: Job job_1490253778814_0004 failed with state FAILED due to: Application application_1490253778814_0004 failed 2 times due to ApplicationMaster for attempt appattempt_1490253778814_0004_000002 timed out. Failing the application.
17/03/23 17:43:01 INFO mapreduce.Job: Counters: 0
Job Finished in 2885.249 seconds
java.io.FileNotFoundException: File does not exist: hdfs://master:8020/user/test/QuasiMonteCarlo_1490259294583_1359990819/out/reduce-out
        at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1110)
        at org.apache.hadoop.hdfs.DistributedFileSystem$17.doCall(DistributedFileSystem.java:1102)
        at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
        at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1102)
        at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1749)
        at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1773)
        at org.apache.hadoop.examples.QuasiMonteCarlo.estimatePi(QuasiMonteCarlo.java:314)
        at org.apache.hadoop.examples.QuasiMonteCarlo.run(QuasiMonteCarlo.java:354)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.hadoop.examples.QuasiMonteCarlo.main(QuasiMonteCarlo.java:363)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72)
        at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
        at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:74)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
请问是怎么回事呢？十分感谢。