Error : redis.exceptions.ConnectionError on RAAS service on Aria Automation Config (Saltstack)

Products

• VMware Aria Suite

Issue/Introduction

Scheduled jobs stuck in running state in Aria Automation Config

When viewing raas.log with debug logging enabled, we see error similar to:
redis. exceptions. ConnectionError: Error 111 connecting to <redis_ip_address>:6379. Connection refused.

Environment

Aria Automation Config 8.x

Cause

This is caused when the raas service is unable to establish connectivity to the redis database server

Resolution

• Validate Redis service health
  
  •  systemctl status redis.service  // on the redis server
• if the service is not running healthily or in stopped status, restart the redis service
  • systemctl restart redis.service  // on the Redis Server
• Confirm that the redis.service is now running healthily. 
• The raas service might need a restart to be able to process the stuck queued tasks to the redis server 
  • systemctl restart raas.serivce  // on the Raas Server
• The queued jobs now get processed gradually

Additional Information

The Redis Service crashing due to almost 100% memory utilization