Cloudera Manager5 在线bin安装遇到无法检测到 Agent 发出的检测信号总结

分痴_mak3c · 发表于 2016-1-26 14:57:24

pig2 发表于 2014-11-21 17:49
网友分享给我的，分享给大家

[26/Jan/2016 12:43:34 +0000] 11300 MainThread agent       ERROR Failed to connect to previous supervisor.
Traceback (most recent call last):
  File "/opt/cloudera-manager/cm-5.5.1/lib64/cmf/agent/src/cmf/agent.py", line 1636, in find_or_start_supervisor
self.get_supervisor_process_info()
  File "/opt/cloudera-manager/cm-5.5.1/lib64/cmf/agent/src/cmf/agent.py", line 1845, in get_supervisor_process_info
self.identifier = self.supervisor_client.supervisor.getIdentification()
  File "/usr/lib64/python2.7/xmlrpclib.py", line 1240, in __call__
return self.__send(self.__name, args)
  File "/usr/lib64/python2.7/xmlrpclib.py", line 1599, in __request
verbose=self.__verbose
  File "/opt/cloudera-manager/cm-5.5.1/lib64/cmf/agent/build/env/lib/python2.7/site-packages/supervisor-3.0-py2.7.egg/supervisor/xmlrpc.py", line 460, in request
self.connection.request('POST', handler, request_body, self.headers)
  File "/usr/lib64/python2.7/httplib.py", line 1053, in request
self._send_request(method, url, body, headers)
  File "/usr/lib64/python2.7/httplib.py", line 1093, in _send_request
self.endheaders(body)
  File "/usr/lib64/python2.7/httplib.py", line 1049, in endheaders
self._send_output(message_body)
  File "/usr/lib64/python2.7/httplib.py", line 893, in _send_output
self.send(msg)
  File "/usr/lib64/python2.7/httplib.py", line 855, in send
self.connect()
  File "/usr/lib64/python2.7/httplib.py", line 832, in connect
self.timeout, self.source_address)
  File "/usr/lib64/python2.7/socket.py", line 575, in create_connection
raise err
error: [Errno 111] Connection refused

我并没有copy的操作，求助原因！

wscl1213 · 发表于 2016-1-26 21:28:21

分痴_mak3c 发表于 2016-1-26 14:57
[26/Jan/2016 12:43:34 +0000] 11300 MainThread agent ERROR Failed to connect to previous ...

可能也是心跳的问题，找到哪两个文件看看

1000306116 · 发表于 2016-2-1 17:54:07

老师，你好，我安装完成CDH之后，在修改CM管理界面上修改参数，出现“与服务器通信时出错”的错误，看到Navigator Audit Server页面出现“该角色的进程状态为正在启动。该角色的预期状态为已启动。”的进程状态。请问老师知道该问题的解决办法吗？

ray · 发表于 2016-3-1 16:24:32

[01/Mar/2016 16:07:02 +0000] 111682 MainThread agent       INFO    Re-using pre-existing directory: /var/run/cloudera-scm-agent/process
[01/Mar/2016 16:07:02 +0000] 111682 MainThread agent       INFO    Re-using pre-existing directory: /var/run/cloudera-scm-agent/supervisor
[01/Mar/2016 16:07:02 +0000] 111682 MainThread agent       INFO    Re-using pre-existing directory: /var/run/cloudera-scm-agent/supervisor/include
[01/Mar/2016 16:07:02 +0000] 111682 MainThread agent       ERROR Failed to connect to previous supervisor.
Traceback (most recent call last):
  File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 1452, in find_or_start_supervisor
self.get_supervisor_process_info()
  File "/usr/lib64/cmf/agent/src/cmf/agent.py", line 1653, in get_supervisor_process_info
self.identifier = self.supervisor_client.supervisor.getIdentification()
  File "/usr/lib64/python2.6/xmlrpclib.py", line 1199, in __call__
return self.__send(self.__name, args)
  File "/usr/lib64/python2.6/xmlrpclib.py", line 1489, in __request
verbose=self.__verbose
  File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/supervisor-3.0-py2.6.egg/supervisor/xmlrpc.py", line 460, in request
self.connection.request('POST', handler, request_body, self.headers)
  File "/usr/lib64/python2.6/httplib.py", line 936, in request
self._send_request(method, url, body, headers)
  File "/usr/lib64/python2.6/httplib.py", line 973, in _send_request
self.endheaders()
  File "/usr/lib64/python2.6/httplib.py", line 930, in endheaders
self._send_output()
  File "/usr/lib64/python2.6/httplib.py", line 802, in _send_output
self.send(msg)
  File "/usr/lib64/python2.6/httplib.py", line 761, in send
self.connect()
  File "/usr/lib64/python2.6/httplib.py", line 742, in connect
self.timeout)
  File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
error: [Errno 111] Connection refused
[01/Mar/2016 16:07:02 +0000] 111682 MainThread tmpfs       INFO    Reusing mounted tmpfs at /var/run/cloudera-scm-agent/process

这个是错误吗？

wscl1213 · 发表于 2016-3-1 16:34:20

ray 发表于 2016-3-1 16:24
[01/Mar/2016 16:07:02 +0000] 111682 MainThread agent INFO Re-using pre-existing directory ...

如果不是这个，只能自己找解决办法了

小伙425 · 发表于 2016-5-4 11:41:11

LZ您好，有个问题麻烦您下，我使用的tar.bz安装的cdh5.7 安装后我在master的机器上启动server没问题，但是启动agent时就提示Unable to create the pidfile.我不明白这个是怎么回事，不知道该怎么处理，能给点建议吗？有人说是权限问题，但是我启动的时候就是用的sudo的

不期而遇 · 发表于 2016-10-26 11:22:07

楼主那个我按照你说的执行service cloudera-scm-agent restart之后
file:///C:/Users/qiao/AppData/Local/YNote/data/qq3367342BDFC9E256EEF14BECBB652C64/22e2e3ea7a50405fac7f57e97d45cf5f/wps2551.tmp.jpeg显示cloudera-agent.pid存在但是启动失败。然后删除了/etc/yum.repos.d/目录下文件
cloudera-manager.repo.*，然后重试，但是问题依然显示安装agent失败。
这是我的cloudera-scm-agent.log日志。百度上上的方法都试了一遍还是不行，主机名和ip没错，防火墙已将。cm和cdh的版本都是对应的。不知道这么办了，关键是找错误找不出来

file:///E:\2596014663\Image\C2C\G}IP@H2C6J3`R96FRCRGHSE.png

不期而遇 · 发表于 2016-10-27 16:27:21

pig2 发表于 2014-11-21 17:49
网友分享给我的，分享给大家

你解决了吗，我也出现你同样的问题，如何解决我按照网上的好像都不成功，请问如何解决，另外我好想没有你说的那两个文件

不期而遇 · 发表于 2016-10-28 11:56:53

我试过楼主的方法，但是依然提示无法检测agent信号，以下是我的cloudera-scm-agent的日志信息：[28/Oct/2016 10:58:17 +0000] 8600 MainThread ntp_monitor  INFO    Using timeout of 2.000000
[28/Oct/2016 10:58:17 +0000] 8600 MainThread dns_names INFO    Using timeout of 30.000000
[28/Oct/2016 10:58:17 +0000] 8600 MainThread __init__    INFO    Created DNS monitor.
[28/Oct/2016 10:58:17 +0000] 8600 MainThread stacks_collection_manager INFO    Using max_uncompressed_file_size_bytes: 5242880
[28/Oct/2016 10:58:17 +0000] 8600 MainThread __init__    INFO    Importing metric schema from file /usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.7.2-py2.6.egg/cmf/monitor/schema.json
[28/Oct/2016 10:58:18 +0000] 8600 MainThread agent       INFO    Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/usr/lib64/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/usr/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/sbin:/usr/sbin:/bin:/usr/bin', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUSTEE_SERVER_HOME': '/usr/lib/keytrustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/usr/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/share/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[28/Oct/2016 10:58:18 +0000] 8600 MainThread agent       INFO    To override these variables, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels.
[28/Oct/2016 10:58:18 +0000] 8600 MainThread agent       INFO    Re-using pre-existing directory: /var/run/cloudera-scm-agent/process
[28/Oct/2016 10:58:18 +0000] 8600 MainThread agent       INFO    Re-using pre-existing directory: /var/run/cloudera-scm-agent/supervisor
[28/Oct/2016 10:58:18 +0000] 8600 MainThread agent       INFO    Re-using pre-existing directory: /var/run/cloudera-scm-agent/flood
[28/Oct/2016 10:58:18 +0000] 8600 MainThread agent       INFO    Re-using pre-existing directory: /var/run/cloudera-scm-agent/supervisor/include
[28/Oct/2016 10:58:18 +0000] 8600 MainThread agent       INFO    Supervisor version: 3.0
[28/Oct/2016 10:58:18 +0000] 8600 MainThread agent       INFO    Connecting to previous supervisor: agent-1423-1477564898.
[28/Oct/2016 10:58:18 +0000] 8600 MainThread status_server INFO    Using maximum impala profile bundle size of 1073741824 bytes.
[28/Oct/2016 10:58:18 +0000] 8600 MainThread status_server INFO    Using maximum stacks log bundle size of 1073741824 bytes.
[28/Oct/2016 10:58:18 +0000] 8600 MainThread _cplogging INFO    [28/Oct/2016:10:58:18] ENGINE Bus STARTING
[28/Oct/2016 10:58:18 +0000] 8600 MainThread _cplogging INFO    [28/Oct/2016:10:58:18] ENGINE Started monitor thread '_TimeoutMonitor'.
[28/Oct/2016 10:58:18 +0000] 8600 HTTPServer Thread-2 _cplogging ERROR [28/Oct/2016:10:58:18] ENGINE Error in HTTP server: shutting down
Traceback (most recent call last):
  File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/CherryPy-3.2.2-py2.6.egg/cherrypy/process/servers.py", line 187, in _start_http_thread
self.httpserver.start()
  File "/usr/lib64/cmf/agent/build/env/lib/python2.6/site-packages/CherryPy-3.2.2-py2.6.egg/cherrypy/wsgiserver/wsgiserver2.py", line 1825, in start
raise socket.error(msg)
error: No socket could be created on ('work3', 9000) -- [Errno 99] Cannot assign requested address

[28/Oct/2016 10:58:18 +0000] 8600 HTTPServer Thread-2 _cplogging INFO    [28/Oct/2016:10:58:18] ENGINE Bus STOPPING
[28/Oct/2016 10:58:18 +0000] 8600 HTTPServer Thread-2 _cplogging INFO    [28/Oct/2016:10:58:18] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('work3', 9000)) already shut down
[28/Oct/2016 10:58:18 +0000] 8600 HTTPServer Thread-2 _cplogging INFO    [28/Oct/2016:10:58:18] ENGINE Stopped thread '_TimeoutMonitor'.
[28/Oct/2016 10:58:18 +0000] 8600 HTTPServer Thread-2 _cplogging INFO    [28/Oct/2016:10:58:18] ENGINE Bus STOPPED
[28/Oct/2016 10:58:18 +0000] 8600 HTTPServer Thread-2 _cplogging INFO    [28/Oct/2016:10:58:18] ENGINE Bus EXITING
[28/Oct/2016 10:58:18 +0000] 8600 HTTPServer Thread-2 _cplogging INFO    [28/Oct/2016:10:58:18] ENGINE Bus EXITED
求助如何解决呢