Aria Operation for Networks VM Experiencing Performance Problems

Products

• VMware Aria Operations for Networks

Issue/Introduction

You may be experiencing one or more of the following symptoms related to performance:

• Multiple services not running or healthy
• Database is unhealthy
• Upgrade bundle failing to upload
• Support bundles failing to create or download
• Slow response with Query Search

Environment

vRealize Network Insight 6.9

vRealize Network Insight 6.10

Aria Operations for Networks 6.11

Aria Operations for Networks 6.12

Aria Operations for Networks 6.13

Aria Operations for Networks 6.14

Cause

You may be experiencing disk latency issues that is effecting performance and health of your system.

Resolution

For a clustered environment, the IOPS response number should be similar between all of your platforms. In the example below, you can see Read and Write IOPS are similar for Platform 1 and 2 but Platform 3 is extremely higher. This means Platform 3 is having storage performance issues.

To check for storage performance problems, please run these commands below. Recommended IOPS for read and write should be 7500 and above for good performance.

ub (to get into ubuntu prompt)

Read Disk IOPS:

./run_all.sh 'file="/var/lib/ubuntu/fio-tmp"; fio --filename=$file --direct=1 --ioengine=libaio --bs=4K --name=bw-test --rw=randread --iodepth=4 --size=100M | grep -i IOPS; rm -f $file'

Disk Write IOPS:

./run_all.sh 'file="/var/lib/ubuntu/fio-tmp"; fio --filename=$file --direct=1 --ioengine=libaio --bs=4K --name=bw-test --rw=randwrite --iodepth=4 --size=100M | grep -i IOPS; rm -f $file'

To check storage performance issues on single Platform, run below command. 

iostat -x

IOWAIT should be below %1. Above screenshots show storage latency. 

To resolve this, check your backend storage performance and possible disk issues. Storage VMotion may be necessary