How to troubleshot the error message `pq: formatter function kafka_in` for gpkafka and gpss
search cancel

How to troubleshot the error message `pq: formatter function kafka_in` for gpkafka and gpss

book

Article ID: 296511

calendar_today

Updated On:

Products

VMware Tanzu Greenplum

Issue/Introduction

While configuring the gpkafka, you notice the below error message: 
07:38:28 kafkagpuser ~/test > gpsscli load --verbose  --quit-at-eof  good_account_challenges.yaml --gpss-port 50007
20200128:07:38:35.108 gpsscli:kafkagpuser:den-phi-gpfdist01:017220-[CRITICAL]:-rpc error: code = Unknown desc = InitJob: InitJob: Check executor failed: pq: formatter function kafka_in of type readable was not found.
github.com/pivotal/gp-stream-server/vendor/github.com/greenplum-db/gp-common-go-libs/gplog.FatalOnError
    /tmp/build/3114bf15/gopath/src/github.com/pivotal/gp-stream-server/vendor/github.com/greenplum-db/gp-common-go-libs/gplog/gplog.go:275
main.glob..func6
    /tmp/build/3114bf15/gopath/src/github.com/pivotal/gp-stream-server/cli/command_load.go:50
github.com/pivotal/gp-stream-server/vendor/github.com/spf13/cobra.(*Command).execute
    /tmp/build/3114bf15/gopath/src/github.com/pivotal/gp-stream-server/vendor/github.com/spf13/cobra/command.go:766
github.com/pivotal/gp-stream-server/vendor/github.com/spf13/cobra.(*Command).ExecuteC
    /tmp/build/3114bf15/gopath/src/github.com/pivotal/gp-stream-server/vendor/github.com/spf13/cobra/command.go:852
github.com/pivotal/gp-stream-server/vendor/github.com/spf13/cobra.(*Command).Execute
    /tmp/build/3114bf15/gopath/src/github.com/pivotal/gp-stream-server/vendor/github.com/spf13/cobra/command.go:800
main.entry
    /tmp/build/3114bf15/gopath/src/github.com/pivotal/gp-stream-server/cli/gpsscli.go:67
main.main
    /tmp/build/3114bf15/gopath/src/github.com/pivotal/gp-stream-server/cli/gpsscli.go:44

However, you can still create the table in Pivotal Greenplum with .json format already: 
gpadmin=# create table d(c json);
NOTICE:  Table doesn't have 'DISTRIBUTED BY' clause, and no column type is suitable for a distribution key. Creating a NULL policy entry.
CREATE TABLE
Time: 61.572 ms
gpadmin=#


Environment

Product Version: 5.25

Resolution

Analyze and look into the extensions installed in database: 
gpadmin-# \dx
     List of installed extensions
 Name | Version | Schema | Description
------+---------+--------+-------------
(0 rows)

If you don't see the GPSS extension, you need to install it as shown below: 
gpadmin=# CREATE EXTENSION gpss;
CREATE EXTENSION
Time: 55.386 ms
gpadmin=# \dx
                                   List of installed extensions
 Name | Version | Schema |                              Description
------+---------+--------+------------------------------------------------------------------------
 gpss | 0.1     | public | Extension which implements kinds of gpss formaters and protocol buffer

The issue should be resolved after installing the extension.