PXF fails with OOM killer even though memory settings increased on Tanzu Greenplum

Products

• VMware Tanzu Greenplum
• Greenplum
• VMware Tanzu Data Suite
• VMware Tanzu Data Suite

Issue/Introduction

PXF failing with OOM killer described in the PXF troubleshooting notes:

See Troubleshooting in the PXF documentation.

=====> Tue Nov 30 16:06:14 EST 2021 PXF Out of memory detected <======
=====> Tue Nov 30 16:06:14 EST 2021 PXF shutdown scheduled <======
=====> Tue Nov 30 16:06:15 EST 2021 Stopping PXF <====== 

1. Changing/increasing the memory settings in pxf-env.sh file as describe in the above document

2. PXF configuration is using a JDBC driver.

Environment

Product Version: 6.17

Resolution

Fix

Set the fetchSize to -2147483648 which is Java’s Integer.MIN_VALUE.

In the PXF configuration server’s jdbc-site.xml, uncomment the following property and set the specified value:

<property>
<name>jdbc.statement.fetchSize</name>
<value>-2147483648</value>
<description>Number of rows that should be fetched at a time during read. Default is 1000</description>
</property>