External Table Query with GPHDFS Error "sh: GPHOME/lib//hadoop/hadoop_env.sh: No such file or directory"
search cancel

External Table Query with GPHDFS Error "sh: GPHOME/lib//hadoop/hadoop_env.sh: No such file or directory"

book

Article ID: 295462

calendar_today

Updated On: 06-02-2018

Products

VMware Tanzu Greenplum

Issue/Introduction

Symptoms:

A simple query on an external table with GPHDFS protocol failed.

Error Message:

gpadmin=# CREATE EXTERNAL TABLE cmp_extract_test 
gpadmin-# ( 
gpadmin(# survey_id text, 
gpadmin(# criteria text, 
gpadmin(# value text 
gpadmin(# ) 
gpadmin-# LOCATION ('gphdfs://nameservice1/user/gpadmin/h.csv') 
gpadmin-# FORMAT 'CSV' (DELIMITER ','); 
CREATE EXTERNAL TABLE 
gpadmin=# select * from cmp_extract_test limit 1; 
ERROR: external table gphdfs protocol command ended with error. sh: GPHOME/lib//hadoop/hadoop_env.sh: No such file or directory (seg6 slice1 sdw-2.gdn.hitwise.com:40000 pid=9873) 
DETAIL:
Exception in thread "main" java.lang.NoClassDefFoundError: 6 
Caused by: java.lang.ClassNotFoundException: 6 
at java.net.URLClassLoader$1.run(URLClassLoader.java:202) 
at java.security.AccessController.doPrivileged(Native Method) 
at java.net.URLClassLoader.findClass(URLClassLoader.java:190) 
at java.lang.ClassLoader.loadClass(ClassLoader.java:306) 
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301) 
at java.lang.ClassLoad 
Command: source $GPHOME/lib//hadoop/hadoop_env.sh;java $GP_JAVA_OPT -classpath $CLASSPATH com.emc.greenplum.gpdb.hdfsconnector.HDFSReader $GP_SEGMENT_ID $GP_SEGMENT_COUNT TEXT cdh4.1-gnet-1.2.0.0 'gphdfs://nameservice1/user/gpadmin/h.csv' '000000002500044000000002500044000000002500044' 'survey_id,criteria,value,' 
External table cmp_extract_test, file gphdfs://nameservice1/user/gpadmin/h.csv 
gpadmin=#

Environment


Cause

This is caused by a software defect in 4.3.13.0 and 4.3.14.0 which will break the normal functionality of GPHDFS.

 

Resolution

The software defect will be fixed in 4.3.14.1. Before the fix is ready, please avoid upgrading to Greenplum releases 4.3.13.0 and 4.3.14.0 if GPHDFS is used.

If an upgrade to those 2 releases has already been done on the system where GPHDFS functionality is mandatory, then consider downgrading the system to 4.3.12.0 or an older release.