在线等！！！！CDH5.10集群搭建的问题！

搞了很久，求大神解答：启动agent报错：
Failed rack peer update: [Errno 111] Connection refused

[26/Apr/2018 22:57:30 +0000] 71798 Monitor-HostMonitor throttling_logger ERROR    (359 skipped) Error getting directory attributes for /opt/cl
oudera-manager/cm-5.10.0/log/cloudera-scm-agent
Traceback (most recent call last):
  File "/opt/cloudera-manager/cm-5.10.0/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.10.0-py2.7.egg/cmf/monitor/dir_monitor.py"
, line 90, in _get_directory_attributes
    name = pwd.getpwuid(uid)[0]
KeyError: 'getpwuid(): uid not found: 1106'





Centos7.2
python2.7.5
jdk1.8
mysql5.5
cdh5.10


死活搞不定！！求指教！在线等！！！

抛出这么个问题来，相信有很多解决办法。
需要说下，在搞什么事情。启动agent，这个agent是什么？？？
是 flume agent，还是你启动客户端，还是你启动hadoop，还是你启动什么？
问题需要根据环境和操作有关系的。特别是这种异常，非方案类问题。

w123aw 发表于 2018-4-27 11:14
抛出这么个问题来，相信有很多解决办法。
需要说下，在搞什么事情。启动agent，这个agent是什么？？？
是 ...

感谢回帖！

cloudera-scm-agent start

我执行这个命令，看到log里的这些ERROR


望解答！

ohano_javaee 发表于 2018-4-27 11:18
感谢回帖！

cloudera-scm-agent start

我在搞集群搭建！

cloudera-scm-server start 这个已经启动成功了

现在要在5个节点上启动cloudera-scm-agent

w123aw 发表于 2018-4-27 11:14
抛出这么个问题来，相信有很多解决办法。
需要说下，在搞什么事情。启动agent，这个agent是什么？？？
是 ...

我在搞集群搭建！

cloudera-scm-server start 这个已经启动成功了

现在要在5个节点上启动cloudera-scm-agent

ohano_javaee 发表于 2018-4-27 11:18
感谢回帖！

cloudera-scm-agent start

cloudera的安装是比较简单的，如果你的前提准备工作都做的好，不会有问题的。所以你需要想想自己前面工作，那里没有做好。

参考这个文档
http://www.aboutyun.com/forum.php?mod=viewthread&tid=20345

w123aw 发表于 2018-4-27 11:22
cloudera的安装是比较简单的，如果你的前提准备工作都做的好，不会有问题的。所以你需要想想自己前面工作 ...

完全照着做的，不管用。还是几个错！

ohano_javaee 发表于 2018-4-27 12:05
完全照着做的，不管用。还是几个错！

为什么会装Python

w123aw 发表于 2018-4-27 12:09
为什么会装Python

Python系统自带的2.7.5，我没装。
cdh依赖Python呗。

[27/Apr/2018 12:16:41 +0000] 116215 MainThread agent        INFO     SCM Agent Version: 5.10.0
[27/Apr/2018 12:16:41 +0000] 116215 MainThread agent        INFO     Agent Protocol Version: 4
[27/Apr/2018 12:16:41 +0000] 116215 MainThread agent        INFO     Using Host ID: 6980c801-a273-4e7b-b507-6c1d0b4605d9
[27/Apr/2018 12:16:41 +0000] 116215 MainThread agent        INFO     Using directory: /opt/cloudera-manager/cm-5.10.0/run/cloudera-scm-agent
[27/Apr/2018 12:16:41 +0000] 116215 MainThread agent        INFO     Using supervisor binary path: /opt/cloudera-manager/cm-5.10.0/lib64/cmf/agent/build/env/bin/supervisord
[27/Apr/2018 12:16:41 +0000] 116215 MainThread agent        INFO     Neither verify_cert_file nor verify_cert_dir are configured. Not performing validation of server certificates in HTTPS communication. These options can be configured in this agent's config.ini file to enable certificate validation.
[27/Apr/2018 12:16:41 +0000] 116215 MainThread agent        INFO     Agent Logging Level: INFO
[27/Apr/2018 12:16:41 +0000] 116215 MainThread agent        INFO     No command line vars
[27/Apr/2018 12:16:41 +0000] 116215 MainThread agent        INFO     Found database jar: /usr/share/java/mysql-connector-java.jar
[27/Apr/2018 12:16:41 +0000] 116215 MainThread agent        INFO     Missing database jar: /usr/share/java/oracle-connector-java.jar (normal, if you're not using this database type)
[27/Apr/2018 12:16:41 +0000] 116215 MainThread agent        INFO     Found database jar: /opt/cloudera-manager/cm-5.10.0/share/cmf/lib/postgresql-9.0-801.jdbc4.jar
[27/Apr/2018 12:16:41 +0000] 116215 MainThread agent        INFO     Agent starting as pid 116215 user root(0) group root(0).
[27/Apr/2018 12:16:43 +0000] 116215 MainThread agent        INFO     Re-using pre-existing directory: /opt/cloudera-manager/cm-5.10.0/run/cloudera-scm-agent/cgroups
[27/Apr/2018 12:16:43 +0000] 116215 MainThread cgroups      INFO     Found existing subsystem cpuacct at /sys/fs/cgroup/cpu,cpuacct
[27/Apr/2018 12:16:43 +0000] 116215 MainThread cgroups      INFO     Found existing subsystem cpu at /sys/fs/cgroup/cpu,cpuacct
[27/Apr/2018 12:16:43 +0000] 116215 MainThread cgroups      INFO     Found existing subsystem blkio at /sys/fs/cgroup/blkio
[27/Apr/2018 12:16:43 +0000] 116215 MainThread cgroups      INFO     Found existing subsystem memory at /sys/fs/cgroup/memory
[27/Apr/2018 12:16:43 +0000] 116215 MainThread cgroups      INFO     Found cgroups subsystem: cpu
[27/Apr/2018 12:16:43 +0000] 116215 MainThread cgroups      INFO     Found cgroups subsystem: cpuacct
[27/Apr/2018 12:16:43 +0000] 116215 MainThread cgroups      INFO     Found cgroups subsystem: memory
[27/Apr/2018 12:16:43 +0000] 116215 MainThread cgroups      INFO     Found cgroups subsystem: blkio
[27/Apr/2018 12:16:43 +0000] 116215 MainThread agent        INFO     Found cgroups capabilities: {'has_memory': True, 'default_memory_limit_in_bytes': -1, 'default_memory_soft_limit_in_bytes': -1, 'writable_cgroup_dot_procs': True, 'default_cpu_rt_runtime_us': 950000, 'has_cpu': True, 'default_blkio_weight': 1000, 'default_cpu_shares': 1024, 'has_cpuacct': True, 'has_blkio': True}
[27/Apr/2018 12:16:43 +0000] 116215 MainThread agent        INFO     Setting up supervisord event monitor.
[27/Apr/2018 12:16:43 +0000] 116215 MainThread filesystem_map INFO     Monitored nodev filesystem types: ['nfs', 'nfs4', 'tmpfs']
[27/Apr/2018 12:16:43 +0000] 116215 MainThread filesystem_map INFO     Using timeout of 2.000000
[27/Apr/2018 12:16:43 +0000] 116215 MainThread filesystem_map INFO     Using join timeout of 0.100000
[27/Apr/2018 12:16:43 +0000] 116215 MainThread filesystem_map INFO     Using tolerance of 60.000000
[27/Apr/2018 12:16:43 +0000] 116215 MainThread filesystem_map INFO     Local filesystem types whitelist: ['ext2', 'ext3', 'ext4', 'xfs']
[27/Apr/2018 12:16:43 +0000] 116215 MainThread kt_renewer   INFO     Agent wide credential cache set to /opt/cloudera-manager/cm-5.10.0/run/cloudera-scm-agent/krb5cc_cm_agent_0
[27/Apr/2018 12:16:43 +0000] 116215 MainThread agent        INFO     Using metrics_url_timeout_seconds of 30.000000
[27/Apr/2018 12:16:43 +0000] 116215 MainThread agent        INFO     Using task_metrics_timeout_seconds of 5.000000
[27/Apr/2018 12:16:43 +0000] 116215 MainThread agent        INFO     Using max_collection_wait_seconds of 10.000000
[27/Apr/2018 12:16:43 +0000] 116215 MainThread metrics      INFO     Importing tasktracker metric schema from file /opt/cloudera-manager/cm-5.10.0/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.10.0-py2.7.egg/cmf/monitor/tasktracker/schema.json
[27/Apr/2018 12:16:43 +0000] 116215 MainThread ntp_monitor  INFO     Using timeout of 2.000000
[27/Apr/2018 12:16:44 +0000] 116215 MainThread dns_names    INFO     Using timeout of 30.000000
[27/Apr/2018 12:16:44 +0000] 116215 MainThread __init__     INFO     Created DNS monitor.
[27/Apr/2018 12:16:44 +0000] 116215 MainThread stacks_collection_manager INFO     Using max_uncompressed_file_size_bytes: 5242880
[27/Apr/2018 12:16:44 +0000] 116215 MainThread __init__     INFO     Importing metric schema from file /opt/cloudera-manager/cm-5.10.0/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.10.0-py2.7.egg/cmf/monitor/schema.json
[27/Apr/2018 12:16:44 +0000] 116215 MainThread agent        INFO     Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/opt/cloudera-manager/cm-5.10.0/lib64/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/opt/cloudera-manager/cm-5.10.0/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/sbin:/usr/sbin:/bin:/usr/bin', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUSTEE_SERVER_HOME': '/usr/lib/keytrustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/opt/cloudera-manager/cm-5.10.0/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'ROOT': '/opt/cloudera-manager/cm-5.10.0/lib64/cmf', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[27/Apr/2018 12:16:44 +0000] 116215 MainThread agent        INFO     To override these variables, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels.
[27/Apr/2018 12:16:44 +0000] 116215 MainThread agent        INFO     Re-using pre-existing directory: /opt/cloudera-manager/cm-5.10.0/run/cloudera-scm-agent/process
[27/Apr/2018 12:16:44 +0000] 116215 MainThread agent        INFO     Re-using pre-existing directory: /opt/cloudera-manager/cm-5.10.0/run/cloudera-scm-agent/supervisor
[27/Apr/2018 12:16:44 +0000] 116215 MainThread agent        INFO     Re-using pre-existing directory: /opt/cloudera-manager/cm-5.10.0/run/cloudera-scm-agent/flood
[27/Apr/2018 12:16:44 +0000] 116215 MainThread agent        INFO     Re-using pre-existing directory: /opt/cloudera-manager/cm-5.10.0/run/cloudera-scm-agent/supervisor/include
[27/Apr/2018 12:16:44 +0000] 116215 MainThread agent        ERROR    Failed to connect to previous supervisor.
Traceback (most recent call last):
  File "/opt/cloudera-manager/cm-5.10.0/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.10.0-py2.7.egg/cmf/agent.py", line 2057, in find_or_start_supervisor
    self.get_supervisor_process_info()
  File "/opt/cloudera-manager/cm-5.10.0/lib64/cmf/agent/build/env/lib/python2.7/site-packages/cmf-5.10.0-py2.7.egg/cmf/agent.py", line 2201, in get_supervisor_process_info
    self.identifier = self.supervisor_client.supervisor.getIdentification()
  File "/usr/lib64/python2.7/xmlrpclib.py", line 1233, in __call__
    return self.__send(self.__name, args)
  File "/usr/lib64/python2.7/xmlrpclib.py", line 1587, in __request
    verbose=self.__verbose
  File "/opt/cloudera-manager/cm-5.10.0/lib64/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/xmlrpc.py", line 460, in request
    self.connection.request('POST', handler, request_body, self.headers)
  File "/usr/lib64/python2.7/httplib.py", line 1017, in request
    self._send_request(method, url, body, headers)
  File "/usr/lib64/python2.7/httplib.py", line 1051, in _send_request
    self.endheaders(body)
  File "/usr/lib64/python2.7/httplib.py", line 1013, in endheaders
    self._send_output(message_body)
  File "/usr/lib64/python2.7/httplib.py", line 864, in _send_output
    self.send(msg)
  File "/usr/lib64/python2.7/httplib.py", line 826, in send
    self.connect()
  File "/usr/lib64/python2.7/httplib.py", line 807, in connect
    self.timeout, self.source_address)
  File "/usr/lib64/python2.7/socket.py", line 571, in create_connection
    raise err
error: [Errno 111] Connection refused
[27/Apr/2018 12:16:44 +0000] 116215 MainThread tmpfs        INFO     Reusing mounted tmpfs at /opt/cloudera-manager/cm-5.10.0/run/cloudera-scm-agent/process
[27/Apr/2018 12:16:44 +0000] 116215 MainThread agent        INFO     Deleting stale supervisor include /opt/cloudera-manager/cm-5.10.0/run/cloudera-scm-agent/supervisor/include/flood.conf.
[27/Apr/2018 12:16:45 +0000] 116215 MainThread agent        INFO     Trying to connect to newly launched supervisor (Attempt 1)
[27/Apr/2018 12:16:45 +0000] 116215 MainThread agent        INFO     Supervisor version: 3.0, pid: 116235
[27/Apr/2018 12:16:45 +0000] 116215 MainThread agent        INFO     Successfully connected to supervisor
[27/Apr/2018 12:16:45 +0000] 116215 MainThread status_server INFO     Using maximum impala profile bundle size of 1073741824 bytes.
[27/Apr/2018 12:16:45 +0000] 116215 MainThread status_server INFO     Using maximum stacks log bundle size of 1073741824 bytes.
[27/Apr/2018 12:16:45 +0000] 116215 MainThread _cplogging   INFO     [27/Apr/2018:12:16:45] ENGINE Bus STARTING
[27/Apr/2018 12:16:45 +0000] 116215 MainThread _cplogging   INFO     [27/Apr/2018:12:16:45] ENGINE Started monitor thread '_TimeoutMonitor'.
[27/Apr/2018 12:16:45 +0000] 116215 MainThread _cplogging   INFO     [27/Apr/2018:12:16:45] ENGINE Serving on master1.cdh:9000
[27/Apr/2018 12:16:45 +0000] 116215 MainThread _cplogging   INFO     [27/Apr/2018:12:16:45] ENGINE Bus STARTED
[27/Apr/2018 12:16:45 +0000] 116215 MainThread __init__     INFO     New monitor: (<cmf.monitor.host.HostMonitor object at 0x2d1fcd0>,)
[27/Apr/2018 12:16:45 +0000] 116215 MonitorDaemon-Scheduler __init__     INFO     Monitor ready to report: ('HostMonitor',)
[27/Apr/2018 12:16:45 +0000] 116215 MainThread agent        INFO     Setting default socket timeout to 30
[27/Apr/2018 12:16:45 +0000] 116215 Monitor-HostMonitor network_interfaces INFO     NIC iface eth0 doesn't support ETHTOOL (95)
[27/Apr/2018 12:16:45 +0000] 116215 MainThread heartbeat_tracker INFO     HB stats (seconds): num:1 LIFE_MIN:0.03 min:0.03 mean:0.03 max:0.03 LIFE_MAX:0.03
[27/Apr/2018 12:16:45 +0000] 116215 MainThread agent        INFO     CM server guid: 19474e50-8ab2-404e-8b3e-4c4976eac82f
[27/Apr/2018 12:16:45 +0000] 116215 MainThread agent        INFO     Using parcels directory from server provided value: /opt/cloudera/parcels
[27/Apr/2018 12:16:45 +0000] 116215 MainThread agent        WARNING  Expected user root for /opt/cloudera/parcels but was cloudera-scm
[27/Apr/2018 12:16:45 +0000] 116215 MainThread agent        WARNING  Expected group root for /opt/cloudera/parcels but was cloudera-scm
[27/Apr/2018 12:16:45 +0000] 116215 MainThread parcel       INFO     Agent does create users/groups and apply file permissions
[27/Apr/2018 12:16:45 +0000] 116215 MainThread downloader   INFO     Downloader path: /opt/cloudera/parcel-cache
[27/Apr/2018 12:16:45 +0000] 116215 MainThread parcel_cache INFO     Using /opt/cloudera/parcel-cache for parcel cache
[27/Apr/2018 12:16:45 +0000] 116215 MainThread agent        INFO     Flood daemon (re)start attempt
[27/Apr/2018 12:16:45 +0000] 116215 MainThread agent        INFO     Triggering supervisord update.
[27/Apr/2018 12:16:45 +0000] 116215 MainThread downloader   ERROR    Failed rack peer update: [Errno 111] Connection refused
[27/Apr/2018 12:16:45 +0000] 116215 MainThread agent        INFO     Active parcel list updated; recalculating component info.
[27/Apr/2018 12:16:45 +0000] 116215 MainThread throttling_logger WARNING  CMF_AGENT_JAVA_HOME environment variable host override will be deprecated in future. JAVA_HOME setting configured from CM server takes precedence over host agent override. Configure JAVA_HOME setting from CM server.
[27/Apr/2018 12:16:45 +0000] 116215 MainThread throttling_logger INFO     Identified java component java8 with full version JAVA_HOME=/usr/java/latest java version "1.8.0_101" Java(TM) SE Runtime Environment (build 1.8.0_101-b13) Java HotSpot(TM) 64-Bit Server VM (build 25.101-b13, mixed mode)  for requested version .
[27/Apr/2018 12:17:15 +0000] 116215 DnsResolutionMonitor throttling_logger INFO     Using java location: '/usr/java/latest/bin/java'.