Unable to query Elastic, exception "Could not read repository data because the contents of the repository do not match its expected state"

Products

• DX Operational Intelligence
• DX Application Performance Management
• DX Operational Observability

Issue/Introduction

We noticed that we are unable to access to the ES snapshots as per documentation : 

" Run the following Elasticsearch query to check the snapshots.
          GET http://ES_ROUTE/_snapshot/Repository/_all"

we get the below error 

" repository_exception Could not read repository data because the contents of the repository do not match its expected state. This is likely the result of either concurrently modifying the contents of the repository by a process other than this cluster or an issue with the repository's underlying storage. The repository has been disabled to prevent corrupting its contents. To re-enable it and continue using it please remove the repository from the cluster and add it again to make the cluster revoer the known state of the repository from its physical contents"

 

Environment

DX O2 2*

Cause

Jarvis Health pages is reporting some services are malfunctioning:

 

Resolution

Suggestions:

Option 1) Restart the Jarvis services, see: AIOps - How to restart Jarvis services?

Option 2) Restart all DX Platform Services using <DX-HOME>/tools/dx-admin.sh stop and start :