Problem Identification:
Run the command:
grep OutOfMemoryError /var/log/arkin/esreindexer_workflow.logIf the command returns any output, proceed to the steps in the Workaround below.
Workaround:
- Reduce scanBatchSize parameter from 50 to 10 in the following file on the platform nodes where reindexing failed.
/home/ubuntu/build-target/common-utils
Note: Reducing scanBatchSize parameter reduces the amount of heap memory required to process the objects and reduces heap memory consumption and prevents OOM errors. This change also reduces the reindexing rate.
- Stop launcher service on all the nodes
/home/ubuntu/run_all.sh sudo systemctl stop launcher-service
- Perform a grep for reindexer.sh script and kill the processes on all the platform nodes
ps -ef | grep reindexer.sh
kill -9 <process ids returned by above command>
- Start launcher service on all the nodes
/home/ubuntu/run_all.sh sudo systemctl start launcher-service