search cancel

CORBA/Netcool heartbeat timeout error messages

book

Article ID: 256706

calendar_today

Updated On:

Products

DX NetOps CA Spectrum

Issue/Introduction

We have Spectrum integrated with Netcool. We have enabled secure CORBA and worked with Netcool to be able to use Netcool with secure CORBA enabled.

This has been working. However, we recently see the following errors in the VNM.OUT file:

Dec 19 04:20:51 CORBA TRACE at CModelDomainItcN.cc(1153): Heartbeat callback thread for client [email protected] has been started.
Dec 19 04:20:51 CORBA TRACE at CModelDomainItcN.cc(1439): Heartbeat callback thread for client [email protected] has been stopped.
Dec 19 04:21:26 CORBA TRACE at CModelDomainItcN.cc(1345): An exception was raised by a heartbeat callback to client [email protected]: CORBA::NO_PERMISSION - trying again...
Dec 19 04:21:26 CORBA TRACE at CModelDomainItcN.cc(1336): An exception was raised by a heartbeat callback to client [email protected]: CORBA::NO_PERMISSION
Dec 19 04:21:36 CORBA TRACE at CModelDomainItcN.cc(1345): An exception was raised by a heartbeat callback to client [email protected]: CORBA::NO_PERMISSION - trying again...
Dec 19 04:21:36 CORBA TRACE at CModelDomainItcN.cc(1336): An exception was raised by a heartbeat callback to client [email protected]: CORBA::NO_PERMISSION

A check of the logs on Netcool show the following:

2022-12-20T01:22:48: Debug: D-JPR-000-000: com.ibm.tivoli.netcool.omnibus.probe.ProbeException: org.omg.CORBA.OBJECT_NOT_EXIST:   vmcid: 0x0  minor code: 0  completed: No

        at com.ibm.tivoli.netcool.integrations.ca.spectrum.head.conn.Head.start(Unknown Source)

        at com.ibm.tivoli.netcool.integrations.ca.spectrum.head.conn.CORBAHandler.start(Unknown Source)

        at com.ibm.tivoli.oidk.ProbeImpl.connect(Unknown Source)

        at com.ibm.tivoli.netcool.omnibus.probe.framework.ProbeRunner.connect(Unknown Source)

        at com.ibm.tivoli.netcool.omnibus.probe.framework.ProbeRunner.connectAndRun(Unknown Source)

        at com.ibm.tivoli.netcool.omnibus.probe.framework.ProbeRunner.retry(Unknown Source)

        at com.ibm.tivoli.netcool.omnibus.probe.framework.ProbeRunner.resetForRetr

        at com.ibm.tivoli.netcool.omnibus.probe.framework.ProbeRunner.resetForRetry(Unknown Source)

        at com.ibm.tivoli.netcool.omnibus.probe.framework.ProbeRunner.messageReceived(Unknown Source)

        at com.ibm.tivoli.netcool.omnibus.probe.services.impl.SimpleMessageService$SenderThread.send(Unknown Source)

        at com.ibm.tivoli.netcool.omnibus.probe.services.impl.SimpleMessageService$SenderThread.run(Unknown Source)

Caused by: org.omg.CORBA.OBJECT_NOT_EXIST:   vmcid: 0x0  minor code: 0  completed: No

        at com.aprisma.visibroker.VBrokerCORBAHelper.getObjectImplementation(VBrokerCORBAHelper.java:934)

        at com.aprisma.visibroker.VBrokerCORBAHelper.getObjectImplementation(VBrokerCORBAHelper.java:706)

        at com.aprisma.util.corba.CORBAHelper.getObjectImplementation(CORBAHelper.java:426)

        at com.ibm.tivoli.netcool.integrations.ca.spectrum.head.conn.Head.bindToModelDomain(Unknown Source)

        at com.ibm.tivoli.netcool.integrations.ca.spectrum.head.conn.Head.setupCorbaConnection(Unknown Source)

        ... 10 more

 

2022-12-20T01:22:48: Debug: D-JPR-000-000: com.ibm.tivoli.netcool.omnibus.probe.framework.ProbeRunner.connect EXITING

2022-12-20T01:22:48: Debug: D-JPR-000-000: com.ibm.tivoli.netcool.omnibus.probe.framework.ProbeRunner.retry EXITING

2022-12-20T01:22:48: Debug: D-JPR-000-000: com.ibm.tivoli.netcool.omnibus.probe.framework.ProbeRunne:

r.resetForRetry EXITING

2022-12-20T01:22:48: Information: I-JPR-000-000: DISCONNECT 'Unable to connect'

2022-12-20T01:22:48: Debug: D-JPR-000-000: com.ibm.tivoli.netcool.omnibus.probe.framework.ProbeRunner.resetForRetry ENTERING

2022-12-20T01:22:48: Debug: D-JPR-000-000: com.ibm.tivoli.netcool.omnibus.probe.framework.ProbeRunner.disconnectProbe ENTERING

2022-12-20T01:22:48: Debug: D-JPR-000-000: [ResyncManager] Stopping ResyncManager ...

Environment

Release : 21.2

Component: Integrations

Cause

Secure CORBA certificate has expired. Verify by doing the following:

- Check to verify if the nameserv is running on the SpectroSERVER system

- If the nameserv is not running, check the $SPECROOT/bin/VBNS/NAMINGSERVICE.OUT file file for a message similar to the following:

 ExtFactory fails! 
org.omg.CORBA.INITIALIZE: Could not initialize java.security.cert.CertificateExpiredException: NotAfter: Sun Dec 18 05:09:53 EST 2022  vmcid: 0x0  minor code: 0  completed: No
        at com.borland.security.core.Init.pre_init(Init.java:672)
        at com.inprise.vbroker.orb.ORB.initialize(Unknown Source)
        at com.inprise.vbroker.orb.ORB.set_parameters(Unknown Source)
        at org.omg.CORBA.ORB.init(ORB.java:353)
        at com.inprise.vbroker.naming.ExtFactory.main(Unknown Source)

Resolution

Following the directions outlined in the "DX NetOps Spectrum Configuration Page" section of the documentation to create a new certificate for secure corba.