Hadoop components fail to start
search cancel

Hadoop components fail to start

book

Article ID: 294638

calendar_today

Updated On:

Products

Services Suite

Issue/Introduction

Symptoms:

When deploying a cluster, some services fail to start with the following symptoms in Ambari:


The error message is displayed below:

resource_management.core.exceptions.Fail: Execution of 'curl -sS -L -w '%{http_code}' -X GET 'http://clpqn1pdhdbmn01.infosolco.net:50070/webhdfs/v1/ats/done?op=GETFILESTATUS&user.name=hdfs'' returned status_code=503. 
<HTML><HEAD>
<TITLE>Network Error</TITLE>
</HEAD>
<BODY>
<FONT face="Helvetica">
<big><strong></strong></big><BR>
</FONT>
<blockquote>
<TABLE border=0 cellPadding=1 width="80%">
<TR><TD>
<FONT face="Helvetica">
<big>Network Error (tcp_error)</big>

Environment


Cause

An HTTP proxy environment variable is set on one or more cluster hosts. This can be confirmed by checking env on the affected node using the following command:

[root@NAMENODE ~]# env | grep -i proxy
http_proxy=http://user:password@prox-server:3128
https_proxy=http://user:password@prox-server:3128
[root@NAMENODE ~]#

Resolution

1. Manually remove HTTP_PROXY and HTTPS_PROXY settings from the root (or the configured Ambari agent user) profile and restart Ambari Agent. The places where the settings are located include the following:

/etc/bashrc
/etc/profile
~root/.bashrc
~root/.bash_profile
2. Restart the Ambari Server and Ambari Agent daemons. In CentOS and Red Hat 6.x, execute the following command as root:
service ambari-agent restart
service ambari-server restart