After upgrading SRM from version 8.4 to 8.5 we have a problem with the storage replication adapter (ver 2.3.0). SRA for DELL RP. SRM can not see from the console that SRA adapter is installed but when we go to SRM appliance we can see that SRA is installed.
The sra:docker may not make the connection back to the SRM after the upgrade.
Remove the SRA docker from the SRM VAMI Storage Replication Adapters screen and then re-install it. No need of reboot.
in vmware-dr logs
2023-10-18T22:56:51.779Z info vmware-dr[01842] [SRM@6876 sub=Storage] Command queryInfo's stdout:
--> EMC RecoverPoint Storage Replication Adapter Version 2.2.0.3
--> Command is: java -classpath "/srm/sra///lib//jsr173_1.0_api.jar:/srm/sra///lib//xbean.jar:/srm/sra///jar//RP.jar:/srm/sra///lib//santorini.jar:/srm/sra///lib//resolver.jar:/srm/sra///lib//xbean_xpath.jar:/srm/sra///lib//xmlbeans-qname.jar:/srm/sra///lib//xmlpublic.jar" com.emc.santorini.main.SantoriniMain /srm/sra/Log location: /srm/sra/log/santorini.log
-->
--> Log mode: true
-->
--> EMC RecoverPoint Storage Replication Adapter 2.3.0.0, build 11102013
-->
-->
2023-10-18T22:56:51.779Z error vmware-dr[01842] [SRM@6876 sub=Storage] Command queryInfo's stderr:
--> /srm/sra/command: line 18: can't create input.xml: Permission denied
--> org.apache.xmlbeans.XmlException: error: Unexpected end of file after null
--> at org.apache.xmlbeans.impl.store.Locale$SaxLoader.load(Locale.java:3471)
--> at org.apache.xmlbeans.impl.store.Locale.parse(Locale.java:706)
--> at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:690)
--> at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:677)
--> at org.apache.xmlbeans.impl.schema.SchemaTypeLoaderBase.parse(SchemaTypeLoaderBase.java:208)
--> at com.emc.santorini.xdo.request.CommandDocument$Factory.parse(Unknown Source)
--> at com.emc.santorini.parse.SantoriniCommandParser.parseCommandXdo(SantoriniCommandParser.java:40)
--> at com.emc.santorini.main.SantoriniMain.main(SantoriniMain.java:51)
--> Caused by: org.xml.sax.SAXParseException; systemId: file:; lineNumber: 1; columnNumber: 1; Unexpected end of file after null
--> at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.reportFatalError(Piccolo.java:1038)
--> at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.parse(Piccolo.java:723)
--> at org.apache.xmlbeans.impl.store.Locale$SaxLoader.load(Locale.java:3439)
--> ... 7 more
-->
2023-10-18T22:56:51.779Z error vmware-dr[01842] [SRM@6876 sub=Storage] queryInfo exited with no response
2023-10-18T22:56:51.779Z verbose vmware-dr[01842] [SRM@6876 sub=Storage] Removing locale file '/opt/vmware/srm/conf//storage/locale/78814f38-52ff-32a5-806c-73000467afca/en/sraString.vmsg'
2023-10-18T22:56:51.780Z verbose vmware-dr[01842] [SRM@6876 sub=Storage] Removing locale file '/opt/vmware/srm/conf//storage/locale/78814f38-52ff-32a5-806c-73000467afca/en/sraError.vmsg'
2023-10-18T22:56:51.780Z verbose vmware-dr[01842] [SRM@6876 sub=Storage] Posting event to VC: (dr.eventEx.StorageAdaptReloadFailEvent) {
--> installPath = "sradocker:latest",
--> fault = (dr.storage.fault.CannotLoadAdapter) {
--> faultCause = (dr.storage.fault.CommandResponseMissing) {
--> faultCause = (vmodl.MethodFault) null,
--> faultMessage = <unset>,
--> commandName = "queryInfo"
--> msg = ""
--> },
--> faultMessage = <unset>,
--> installPath = "sradocker:latest"
--> msg = ""
--> }
--> }
followed by
2023-10-19T00:02:40.907Z info vmware-dr[01863] [SRM@6876 sub=Storage opID=12e90989-05ef-4dbf-b4c9-a4f356578103-reloadAdapters:a32c] Command line for queryInfo: /usr/bin/docker exec -i -u 660:660 -e PerlPaths=D:\Program Files\VMware\VMware vCenter Site Recovery Manager\external\perl\perl\bin;D:\Program Files\VMware\VMware vCenter Site Recovery Manager\external\perl\c\bin;D:\Program Files\VMware\VMware vCenter Site Recovery Manager\external\perl\perl\site\bin 16b6c06f783c /srm/sra/command
--> <?xml version="1.0" encoding="UTF-8"?>
--> <Command xmlns="http://www.vmware.com/srm/sra/v2">
--> <Name>queryInfo</Name>
--> <OutputFile>/tmp/sra-output-2-177</OutputFile>
--> <StatusFile>/tmp/sra-status-3-221</StatusFile>
--> <LogLevel>verbose</LogLevel>
--> <LogDirectory>/srm/sra/log</LogDirectory>
--> </Command>
-->
2023-10-19T00:02:40.917Z verbose vmware-dr[01863] [SRM@6876 sub=Storage opID=12e90989-05ef-4dbf-b4c9-a4f356578103-reloadAdapters:a32c] Listening for updates to file '/tmp/vmware-srm/sra-status-3-221'
2023-10-19T00:02:41.063Z verbose vmware-dr[01843] [SRM@6876 sub=PropertyProvider opID=90a29a38-979d-4b5a-9634-b0b2a24b4dc7-waitForUpdatesEx] [52380] [_GetChanges] _GetChanges called on dr.storage.StorageManager.reloadAdapters19 with version 0
2023-10-19T00:02:42.919Z verbose vmware-dr[01868] [SRM@6876 sub=Storage opID=12e90989-05ef-4dbf-b4c9-a4f356578103-reloadAdapters:a32c] Stopped listening for updates to file '/tmp/vmware-srm/sra-status-3-221'
2023-10-19T00:02:42.920Z info vmware-dr[01868] [SRM@6876 sub=Storage opID=12e90989-05ef-4dbf-b4c9-a4f356578103-reloadAdapters:a32c] Command queryInfo's stdout:
--> EMC RecoverPoint Storage Replication Adapter Version 2.2.0.3
--> Command is: java -classpath "/srm/sra///lib//jsr173_1.0_api.jar:/srm/sra///lib//xbean.jar:/srm/sra///jar//RP.jar:/srm/sra///lib//santorini.jar:/srm/sra///lib//resolver.jar:/srm/sra///lib//xbean_xpath.jar:/srm/sra///lib//xmlbeans-qname.jar:/srm/sra///lib//xmlpublic.jar" com.emc.santorini.main.SantoriniMain /srm/sra/Log location: /srm/sra/log/santorini.log
-->
--> Log mode: true
-->
--> EMC RecoverPoint Storage Replication Adapter 2.3.0.0, build 11102013
-->
-->
2023-10-19T00:02:42.920Z error vmware-dr[01868] [SRM@6876 sub=Storage opID=12e90989-05ef-4dbf-b4c9-a4f356578103-reloadAdapters:a32c] Command queryInfo's stderr:
--> /srm/sra/command: line 18: can't create input.xml: Permission denied
--> org.apache.xmlbeans.XmlException: error: Unexpected end of file after null
--> at org.apache.xmlbeans.impl.store.Locale$SaxLoader.load(Locale.java:3471)
--> at org.apache.xmlbeans.impl.store.Locale.parse(Locale.java:706)
--> at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:690)
--> at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:677)
--> at org.apache.xmlbeans.impl.schema.SchemaTypeLoaderBase.parse(SchemaTypeLoaderBase.java:208)
--> at com.emc.santorini.xdo.request.CommandDocument$Factory.parse(Unknown Source)
--> at com.emc.santorini.parse.SantoriniCommandParser.parseCommandXdo(SantoriniCommandParser.java:40)
--> at com.emc.santorini.main.SantoriniMain.main(SantoriniMain.java:51)
--> Caused by: org.xml.sax.SAXParseException; systemId: file:; lineNumber: 1; columnNumber: 1; Unexpected end of file after null
--> at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.reportFatalError(Piccolo.java:1038)
--> at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.parse(Piccolo.java:723)
--> at org.apache.xmlbeans.impl.store.Locale$SaxLoader.load(Locale.java:3439)
--> ... 7 more
-->
2023-10-19T00:02:42.920Z error vmware-dr[01868] [SRM@6876 sub=Storage opID=12e90989-05ef-4dbf-b4c9-a4f356578103-reloadAdapters:a32c] queryInfo exited with no response
2023-10-19T00:02:42.920Z verbose vmware-dr[01868] [SRM@6876 sub=Storage opID=12e90989-05ef-4dbf-b4c9-a4f356578103-reloadAdapters:a32c] Posting event to VC: (dr.eventEx.StorageAdaptReloadFailEvent) {
--> installPath = "sradocker:latest",
--> fault = (dr.storage.fault.CannotLoadAdapter) {
--> faultCause = (dr.storage.fault.CommandResponseMissing) {
--> faultCause = (vmodl.MethodFault) null,
--> faultMessage = <unset>,
--> commandName = "queryInfo"
--> msg = ""
--> },
--> faultMessage = <unset>,
--> installPath = "sradocker:latest"
--> msg = ""
--> }
--> }
And santorini.log file shows:
Oct 4, 2023 1:43:45 AM 1 WARNING: Unknown Error:
org.apache.xmlbeans.XmlException: error: Unexpected end of file after null
at org.apache.xmlbeans.impl.store.Locale$SaxLoader.load(Locale.java:3471)
at org.apache.xmlbeans.impl.store.Locale.parse(Locale.java:706)
at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:690)
at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:677)
at org.apache.xmlbeans.impl.schema.SchemaTypeLoaderBase.parse(SchemaTypeLoaderBase.java:208)
at com.emc.santorini.xdo.request.CommandDocument$Factory.parse(Unknown Source)
at com.emc.santorini.parse.SantoriniCommandParser.parseCommandXdo(SantoriniCommandParser.java:40)
at com.emc.santorini.main.SantoriniMain.main(SantoriniMain.java:51)
Caused by: org.xml.sax.SAXParseException; systemId: file:; lineNumber: 1; columnNumber: 1; Unexpected end of file after null
at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.reportFatalError(Piccolo.java:1038)
at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.parse(Piccolo.java:723)
at org.apache.xmlbeans.impl.store.Locale$SaxLoader.load(Locale.java:3439)
... 7 more
Oct 4, 2023 3:15:35 AM 1 WARNING: Unknown Error:
org.apache.xmlbeans.XmlException: error: Unexpected end of file after null
at org.apache.xmlbeans.impl.store.Locale$SaxLoader.load(Locale.java:3471)
at org.apache.xmlbeans.impl.store.Locale.parse(Locale.java:706)
at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:690)
at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:677)
at org.apache.xmlbeans.impl.schema.SchemaTypeLoaderBase.parse(SchemaTypeLoaderBase.java:208)
at com.emc.santorini.xdo.request.CommandDocument$Factory.parse(Unknown Source)
at com.emc.santorini.parse.SantoriniCommandParser.parseCommandXdo(SantoriniCommandParser.java:40)
at com.emc.santorini.main.SantoriniMain.main(SantoriniMain.java:51)
Caused by: org.xml.sax.SAXParseException; systemId: file:; lineNumber: 1; columnNumber: 1; Unexpected end of file after null
at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.reportFatalError(Piccolo.java:1038)
at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.parse(Piccolo.java:723)
at org.apache.xmlbeans.impl.store.Locale$SaxLoader.load(Locale.java:3439)
... 7 more
NOTE: this are examples of logs and the dates may appear differently.
Impact/Risks:
The array manager cannot ping or see the storage to allow it to do a failover or create protection groups with new VM's