分享

hadoop-2.7.0 启动hdfs出错?

mvs2008 发表于 2015-7-7 10:00:10 [显示全部楼层] 回帖奖励 阅读模式 关闭右栏 4 23803
本帖最后由 mvs2008 于 2015-7-7 10:03 编辑

Hi,各位hadoop大牛,我刚接触hadoop。所有的学习都是来源于网络。
昨天安装了hadoop,但是启动的时候hdfs报错。
[mw_shl_code=bash,true]This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
15/07/06 18:58:00 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [master.hadoop]
master.hadoop: starting namenode, logging to /home/hadoop/hadoop-2.7.0/logs/hadoop-hadoop-namenode-master.out
slave.hadoop: starting datanode, logging to /home/hadoop/hadoop-2.7.0/logs/hadoop-hadoop-datanode-slave.out
15/07/06 18:58:12 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
starting yarn daemons
starting resourcemanager, logging to /home/hadoop/hadoop-2.7.0/logs/yarn-hadoop-resourcemanager-master.out
slave.hadoop: starting nodemanager, logging to /home/hadoop/hadoop-2.7.0/logs/yarn-hadoop-nodemanager-slave.out
[/mw_shl_code]

master jps
[mw_shl_code=bash,true]
[hadoop@master native]$ jps
5129 ResourceManager
5467 Jps
[/mw_shl_code]

slave jps
[mw_shl_code=bash,true][hadoop@slave hadoop]$ jps
30615 NodeManager
30745 Jps
30511 DataNode
[/mw_shl_code]
查了下资料说是libhadoop.so.1.0.0, libhdfs.so.0.0.0是64位的。因为我Linux是32位的。要重新编译什么的,到底是不是真的呢?
若真是这样我根本不会编译额,请教。。。。。

已有(4)人评论

跳转到指定楼层
jixianqiuxue 发表于 2015-7-7 10:31:31
把你的包,换成这个
链接:http://pan.baidu.com/s/1kTgobOV 密码:1rhw

再不行,就是配置问题了。
伪分布建议参考这个:

hadoop2.7【单节点】单机、伪分布、分布式安装指导


回复

使用道具 举报

mvs2008 发表于 2015-7-7 15:31:42
本帖最后由 mvs2008 于 2015-7-7 15:36 编辑
jixianqiuxue 发表于 2015-7-7 10:31
把你的包,换成这个
链接:http://pan.baidu.com/s/1kTgobOV 密码:1rhw

谢谢您的回答,我按照你给我发的安装帖子去重新对比了下几个xml文件的配置。
重新启动hadoop之后发现多了一个SecondaryNameNode。
[mw_shl_code=bash,true]
[hadoop@master sbin]$ jps
9461 Jps
8965 ResourceManager
8806 SecondaryNameNode
[/mw_shl_code]
但是启动的时候还是有Warning
[mw_shl_code=bash,true][hadoop@master ~]$ sh /home/hadoop/switch_hadoop.sh start
This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
15/07/07 00:19:04 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [master.hadoop]
master.hadoop: starting namenode, logging to /home/hadoop/hadoop-2.7.0/logs/hadoop-hadoop-namenode-master.out
slave.hadoop: starting datanode, logging to /home/hadoop/hadoop-2.7.0/logs/hadoop-hadoop-datanode-slave.out
Starting secondary namenodes [master.hadoop]
master.hadoop: starting secondarynamenode, logging to /home/hadoop/hadoop-2.7.0/logs/hadoop-hadoop-secondarynamenode-master.out
15/07/07 00:19:22 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
starting yarn daemons
starting resourcemanager, logging to /home/hadoop/hadoop-2.7.0/logs/yarn-hadoop-resourcemanager-master.out
slave.hadoop: starting nodemanager, logging to /home/hadoop/hadoop-2.7.0/logs/yarn-hadoop-nodemanager-slave.out
[/mw_shl_code]
我的JDK是1.8.0,会有影响么?


补充内容 (2015-7-8 08:27):
查看了下,应该就是62位和32位的问题。
回复

使用道具 举报

bob007 发表于 2015-7-8 12:17:47
mvs2008 发表于 2015-7-7 15:31
谢谢您的回答,我按照你给我发的安装帖子去重新对比了下几个xml文件的配置。
重新启动hadoop之后发现多 ...

最好使用jdk1.7,1.8目前还没有被普及。
缺进程,查看下日志。最有可能是权限出问题。

回复

使用道具 举报

mvs2008 发表于 2015-7-8 15:07:06
经过不同的尝试,在仍然有warn的情况下,我重新hadoop namenode -format。然后重启hadoop,最后成功!
[mw_shl_code=bash,true]
[hadoop@master ~]$ jps
16785 ResourceManager
16628 SecondaryNameNode
17685 Jps
16431 NameNode
[/mw_shl_code]

[mw_shl_code=bash,true]
[hadoop@slave native]$ jps
3113 DataNode
3228 NodeManager
4029 Jps
[/mw_shl_code]

1.虽然说是成功,能正常运行。但是在启动或者执行hadoop命令的时候都会有warn,但是不影响。
[mw_shl_code=bash,true]
[hadoop@master ~]$ hadoop dfs -ls /
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

Java HotSpot(TM) Server VM warning: You have loaded library /home/hadoop/hadoop-2.7.0/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
15/07/08 00:04:10 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Found 1 items
drwxr-xr-x   - hadoop supergroup          0 2015-07-07 23:58 /user
[/mw_shl_code]

2.还有一点我不是很明白,用file命令查看libhadoop.so.1.0.0显示的是64位(本机CentOS 32位)。这难道就是warn的原因?
[mw_shl_code=bash,true]
[hadoop@master ~]$ file ~/hadoop-2.7.0/lib/native/libhadoop.so.1.0.0
/home/hadoop/hadoop-2.7.0/lib/native/libhadoop.so.1.0.0: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, not stripped
[/mw_shl_code]
回复

使用道具 举报

您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

关闭

推荐上一条 /2 下一条