gppkg fails to clean package if gppkg file is corrupted on one host - gppkg failed (Reason='CRC check failed 0xd5754ee0 != 0xb1bcb3c4L') exiting
search cancel

gppkg fails to clean package if gppkg file is corrupted on one host - gppkg failed (Reason='CRC check failed 0xd5754ee0 != 0xb1bcb3c4L') exiting

book

Article ID: 296659

calendar_today

Updated On:

Products

VMware Tanzu Greenplum Greenplum Pivotal Data Suite Non Production Edition VMware Tanzu Data Suite VMware Tanzu Data Suite

Issue/Introduction

The installation of a gppkg failed on a segment host because the /usr FileSystem was full. In the example below the package installed is DataScience which is a large package.

After the failed install the package cannot ne removed. This error can happen with gppkg -c and -r.

Below is an example of gppkg -c -v:

20210312:11:59:51:084425 gppkg:mdw:gpadmin-[DEBUG]:-Running Command: $GPHOME/sbin/gpoperation.py
20210312:11:59:54:084425 gppkg:mdw:gpadmin-[DEBUG]:-Output on host sdw7: cexceptions
IOError
p0
(S'CRC check failed 0x12fc0fae != 0x6ccf8d8aL'
p1
tp2
Rp3
.
20210312:11:59:54:084425 gppkg:mdw:gpadmin-[DEBUG]:-Ending RemoteOperation
20210312:11:59:54:084425 gppkg:mdw:gpadmin-[DEBUG]:-Ending SyncPackages
20210312:11:59:54:084425 gppkg:mdw:gpadmin-[ERROR]:-CRC check failed 0x12fc0fae != 0x6ccf8d8aL
Traceback (most recent call last):
  File "/usr/local/greenplum-db-6.15.0/lib/python/gppylib/commands/base.py", line 278, in run
    self.cmd.run()
  File "/usr/local/greenplum-db-6.15.0/lib/python/gppylib/operations/__init__.py", line 53, in run
    self.ret = self.execute()
  File "/usr/local/greenplum-db-6.15.0/lib/python/gppylib/operations/package.py", line 1059, in execute
    RemoteOperation(UninstallPackageLocally(package), self.host).run()
  File "/usr/local/greenplum-db-6.15.0/lib/python/gppylib/operations/__init__.py", line 53, in run
    self.ret = self.execute()
  File "/usr/local/greenplum-db-6.15.0/lib/python/gppylib/operations/utils.py", line 57, in execute
    raise ret
IOError: CRC check failed 0x12fc0fae != 0x6ccf8d8aL
20210312:11:59:54:084425 gppkg:mdw:gpadmin-[DEBUG]:-[worker7] finished cmd with exception: SyncPackages


Below is an example of gppkg -r:

[gpadmin@mdw archive]$ gppkg -r DataSciencePython-2.0.3
20210311:05:55:42:013141 gppkg:mdw:gpadmin-[INFO]:-Starting gppkg with args: -r DataSciencePython-2.0.3
20210311:05:55:47:013141 gppkg:mdw:gpadmin-[INFO]:-Uninstalling package DataSciencePython-2.0.3-gp6-rhel7_x86_64.gppkg
20210311:05:55:50:013141 gppkg:mdw:gpadmin-[INFO]:-Validating rpm uninstallation cmdStr='rpm --test -e DataSciencePython-0.0-0 --dbpath /usr/local/greenplum-db-6.14.0/share/packages/database'
20210311:05:56:16:013141 gppkg:mdw:gpadmin-[ERROR]:-CRC check failed 0xd5754ee0 != 0xb1bcb3c4L
Traceback (most recent call last):
  File "/usr/local/greenplum-db-6.14.0/lib/python/gppylib/commands/base.py", line 278, in run
    self.cmd.run()
  File "/usr/local/greenplum-db-6.14.0/lib/python/gppylib/operations/__init__.py", line 53, in run
    self.ret = self.execute()
  File "/usr/local/greenplum-db-6.14.0/lib/python/gppylib/operations/utils.py", line 57, in execute
    raise ret
IOError: CRC check failed 0xd5754ee0 != 0xb1bcb3c4L
20210311:05:56:25:013141 gppkg:mdw:gpadmin-[CRITICAL]:-gppkg failed. (Reason='CRC check failed 0xd5754ee0 != 0xb1bcb3c4L') exiting...


Resolution

This issue comes from a fact that the gppkg file was corrupted on one of the hosts due to a space issue. 
[gpadmin@mdw archive]$ gpssh -f /home/gpadmin/hostfile
=> ls -l /usr/local/greenplum-db-6.14.0/share/packages/archive/
[mdw ] total 409512
[mdw ] -rw-r--r--. 1 gpadmin gpadmin 419339314 Mar 11 03:53 DataSciencePython-2.0.3-gp6-rhel7_x86_64.gppkg
[sdw2] total 409512
[sdw2] -rw-r--r--. 1 gpadmin gpadmin 419339314 Mar 12 12:55 DataSciencePython-2.0.3-gp6-rhel7_x86_64.gppkg
[smdw] total 409512
[smdw] -rw-r--r--. 1 gpadmin gpadmin 419339314 Mar 12 10:49 DataSciencePython-2.0.3-gp6-rhel7_x86_64.gppkg
[sdw1] total 409512
[sdw1] -rw-r--r--. 1 gpadmin gpadmin 317234433 Mar 12 12:55 DataSciencePython-2.0.3-gp6-rhel7_x86_64.gppkg


Workaround

Increase the free space on the filesystem by deleting unwanted files or increasing the capacity of the filesystem.
Copy over the uncorrupted package to the host and try again: 
[gpadmin@gmdw archive]$ scp /usr/local/greenplum-db-6.14.0/share/packages/archive/DataSciencePython-2.0.3-gp6-rhel7_x86_64.gppkg sdw1:/usr/local/greenplum-db-6.14.0/share/packages/archive/DataSciencePython-2.0.3-gp6-rhel7_x86_64.gppkg
DataSciencePython-2.0.3-gp6-rhel7_x86_64.gppkg                                                                                                100%  400MB  52.6MB/s   00:07

[gpadmin@mdw archive]$ gppkg -r DataSciencePython-2.0.3
20210311:06:08:56:014038 gppkg:mdw:gpadmin-[INFO]:-Starting gppkg with args: -r DataSciencePython-2.0.3
20210311:06:09:01:014038 gppkg:mdw:gpadmin-[INFO]:-Uninstalling package DataSciencePython-2.0.3-gp6-rhel7_x86_64.gppkg
20210311:06:09:05:014038 gppkg:mdw:gpadmin-[INFO]:-Validating rpm uninstallation cmdStr='rpm --test -e DataSciencePython-0.0-0 --dbpath /usr/local/greenplum-db-6.14.0/share/packages/database'
20210311:06:09:37:014038 gppkg:mdw:gpadmin-[INFO]:-Validating rpm uninstallation cmdStr='rpm --test -e DataSciencePython-0.0-0 --dbpath /usr/local/greenplum-db-6.14.0/share/packages/database'
20210311:06:09:37:014038 gppkg:mdw:gpadmin-[INFO]:-Uninstalling rpms cmdStr='rpm -e DataSciencePython-0.0-0 --dbpath /usr/local/greenplum-db-6.14.0/share/packages/database'
20210311:06:09:45:014038 gppkg:mdw:gpadmin-[INFO]:-Completed local uninstallation of DataSciencePython-2.0.3-gp6-rhel7_x86_64.gppkg.
20210311:06:09:46:014038 gppkg:mdw:gpadmin-[INFO]:-DataSciencePython-2.0.3-gp6-rhel7_x86_64.gppkg successfully uninstalled.


Powered by Wolken Software