Troubleshooting issues with the vSphere Storage Appliance Cluster service
search cancel

Troubleshooting issues with the vSphere Storage Appliance Cluster service

book

Article ID: 309649

calendar_today

Updated On:

Products

VMware vSphere ESXi

Issue/Introduction

Symptoms:
  • In the vSphere Storage Appliance Manager, the vSphere Storage Appliance cluster service is in an offline state
  • Selecting Repair VSA cluster service does not resolve the issue

Note: The vSphere Storage Appliance Cluster service runs on vCenter Server and acts as the third node on a two node vSphere Storage Appliance cluster. It must be online before putting any node in maintenance mode. Otherwise, the vSphere Storage Appliance storage goes offline. It is not used on three node clusters.

Environment

VMware vSphere Storage Appliance 1.0.x
VMware vSphere Storage Appliance 5.1.x

Cause

This issue may occur due to changes in the vCenter Server configuration. Networking issues may break the communication between the service and the vSphere Storage Appliance cluster.

Resolution

To resolve this issue, start the vSphere Storage Appliance Cluster service if it is not running, and repair the connection with the service if necessary.

Verifying if the vSphere Storage Appliance Cluster service is running

To verify if the service is running, check the Windows service manager.

Alternatively, run this command to check if the service is running:

sc query vsaclusterservice

To start the service, run this command:

net start vsaclusterservice

Confirming that the VSA Cluster Service (VCS) IP is started on vCenter Server

To confirm that VSA Cluster Service is started, run this command:
# ipconfig /all

If the VSA Cluster Service is not started, you must add it.

Note: You can add it to the same NIC that vCenter Server is using or to a different NIC.

For more information on adding another IP address, see How do I add an additional IP address in Windows 2000/2003 Server?

Note: The preceding link was correct as of February 1, 2013. If you find the link is broken, provide feedback and a VMware employee will update the link.

To obtain the service details, search the VSA Manager logs for entries similar to:

2011-09-22 13:22:31,814 334 [CreateClusterThread] [Thread-122] INFO - Dump VSA Cluster Configuration

VSA Management Network Settings
IP Address Netmask Gateway/Interface
Cluster : 10.42.16.42 255.255.240.0 10.42.16.1

VSAManager Service: 10.42.16.43 255.255.240.0 Local Area Connection 2

VSA VM Network Settings : host-17
IP Address Netmask Gateway Vlan ID
Management: 10.42.16.44 255.255.240.0 10.42.16.1 0
NFS : 10.42.16.45 255.255.240.0 10.42.16.1 0
Backend : 192.168.0.1 255.255.255.0 - 0
Feature : 10.42.16.46 255.255.240.0 10.42.16.1 0


If the VSA Cluster Service IP is started, try to ping the other elements in the cluster:
  • Ping the VSA Cluster IP from vCenter Server.
  • Ping the VSA Cluster service from any of the VSA nodes.

    Note: By default, the firewall on Windows machines can block ICMP requests. Therefore, it needs to be enabled via the firewall to do this test because the VCS machine does not require ICMP to function.
If they are up, but not reachable, investigate if there is a network problem.

If these steps do not resolve the issue, try repairing the connection with the service using the GUI (VSA Manager tab).

Alternatively, run this command:

C:\Program Files\VMware\Infrastructure\VSA Manager\tools> "C:\Program Files\VMware\Infrastructure\jre\bin\java.exe" -jar WSCLI.jar VSA-Cluster-IP repairPseudoSva

Where VSA-Cluster-IP is the VSA Cluster IP (visible from VSA Manager).

For more information, see Finding the VSA Cluster IP address after a vCenter failure (2003890).

Note: This command might return the same exception.


If the issue continues to exist after trying the steps in this article:


Additional Information

VSA Cluster Service FAQ


Can VSA 5.1 have the VMware VirtualCenter Server service and VSA Cluster Service on the same IP?

Yes, that is the default behavior.

Unlike 1.0, VSA Manager does not add an IP specifically for the VSA Cluster Service.

Also, during the VSA Cluster Service installation (transparent if performed together with VSA Manager installation), the user is not prompted for the IP address to use for the VSA Cluster service.


Can vCenter Server and VSA Cluster service IPs be different?

If you want vCenter Server and VSA Cluster service to use different IP addresses, you need to create a computer with that IP and install the VSA Cluster Service.

Installing multiple VSA Cluster services on the same computer is not supported.


Can I change the IP address to which the VSA Cluster service is listening to? For example, I may want to separate the IP addresses of vCenter Server and VCS because there are problems with other products.

No. VCS listens to a certain port on the host on which it is running. Therefore, the fact that the host has multiple adapters configured should not matter. In fact, when the manager requests VCS for information about its networking, the IP address that is used to communicate with it is sent, so that it can send the information about the correct adapter.

It may be possible to use different IPs for vCenter Server and VCS on the same box. This is not recommended.


Is it possible to reconfigure VSA Cluster to work with a different VSA Cluster Service IP? If so, what is the procedure?

Yes. You should be able to run reconfigure network and provide the correct cluster service IP for 5.1.


Can the VSA Cluster Service be offline when you reconfigure network?

This is possible in VSA 5.1. VSA 5.1 does not check if the current VCS is online when you reconfigure the network. However, the VCS must be online and ready at the new IP address.

In VSA 1.0, VCS is assumed to be on vCenter Server and VSA Manager adds the new IP address itself. Therefore, you do not have this issue of VCS running on a different IP address than the one expected.


How can I obtain the VSA Cluster Service IP address that the Cluster is using?

You can find this information from the VSA tab or logs. You can also find this information using the WSCLI getStorageCluster command.


How can I obtain the specific IP address that a VSA Cluster service is working on?

This information is available in the VSA Manager UI.

Alternatively, you can use the WSCLI getStorageCluster command and look for a line similar to:

VSA Cluster Service address = 10.17.117.50

This is the VCS IP address from the cluster perspective.

To verify whether VCS itself is configured correctly, open the $VCSDIR/etc/zookeeper/zoo.cfg file, where $VCSDIR is the VSA Cluster service installation directory.

By default, the value of $VCSDIR is:
  • Linux:/home/vmwarevcsadmin/VSAClusterService-5.1
  • Windows: C:\Program Files\VMware\Infrastructure\VSA Manager\VSAClusterService-1.5
This file contains the IP addresses of all cluster members. For example:

server.0=10.17.117.50\:4331\:4332
server.1=10.17.119.233\:4331\:4332
server.2=10.17.119.235\:4331\:4332

These are the IPs that VCS uses to connect to other members of the cluster. One of them is the local VCS IP.

To find the VCS IP address, open the ID file that is located at $VCSDIR/var/zookeeper/myid. For example, value 0 in the file indicates that VCS uses 10.17.117.50 as the local cluster IP.
Collecting diagnostic information for VMware products
How to file a Support Request in Customer Connect