When deploying a cluster, some services fail to start with the following symptoms in Ambari:
The error message is displayed below:
resource_management.core.exceptions.Fail: Execution of 'curl -sS -L -w '%{http_code}' -X GET 'http://clpqn1pdhdbmn01.infosolco.net:50070/webhdfs/v1/ats/done?op=GETFILESTATUS&user.name=hdfs'' returned status_code=503. <HTML><HEAD> <TITLE>Network Error</TITLE> </HEAD> <BODY> <FONT face="Helvetica"> <big><strong></strong></big><BR> </FONT> <blockquote> <TABLE border=0 cellPadding=1 width="80%"> <TR><TD> <FONT face="Helvetica"> <big>Network Error (tcp_error)</big>
An HTTP proxy environment variable is set on one or more cluster hosts. This can be confirmed by checking env
on the affected node using the following command:
[root@NAMENODE ~]# env | grep -i proxy http_proxy=http://user:password@prox-server:3128 https_proxy=http://user:password@prox-server:3128 [root@NAMENODE ~]#
1. Manually remove HTTP_PROXY
and HTTPS_PROXY
settings from the root (or the configured Ambari agent user) profile and restart Ambari Agent. The places where the settings are located include the following:
/etc/bashrc /etc/profile ~root/.bashrc ~root/.bash_profile2. Restart the Ambari Server and Ambari Agent daemons. In CentOS and Red Hat 6.x, execute the following command as root:
service ambari-agent restart service ambari-server restart