Upgrade issues in VMware Tanzu GemFire and VMware Tanzu GemFire for VMs
search cancel

Upgrade issues in VMware Tanzu GemFire and VMware Tanzu GemFire for VMs

book

Article ID: 294391

calendar_today

Updated On:

Products

VMware Tanzu Gemfire

Issue/Introduction

While performing a rolling upgrade of VMware Tanzu GemFire (including VMWare Tanzu GemFire for VMs) on the following versions, cluster members may log error messages similar to the ones below, resulting in the failing upgrades.
  • VMWare Tanzu GemFire for VMs 1.13.0 (which is no longer available in the VMWare network) from any earlier versions
  • VMWare Tanzu Gemfire for VMs 1.10.6
  • VMWare Tanzu GemFire for VMs 1.12.2 from 1.11.3  
  • VMWare Tanzu GemFire 9.9.5 to 9.10.6
  • VMWare Tanzu GemFire 1.13.1 from any earlier versions
Exception in thread "main" org.apache.geode.cache.DiskAccessException: For Region: DiskStore[cluster_config]: Unknown version ordinal 116 found when recovering Oplogs, caused by org.apache.geode.internal.serialization.UnsupportedSerializationVersionException: Peer or client version with ordinal 116 not supported. Highest known version is 1.13.0
or 
Error deserializing message
java.io.IOException: Could not create an instance of org.apache.geode.internal.cache.FunctionStreamingReplyMessage .
        at org.apache.geode.internal.serialization.internal.DSFIDSerializerImpl.invokeFromData(DSFIDSerializerImpl.java:330)
        at org.apache.geode.internal.serialization.internal.DSFIDSerializerImpl.create(DSFIDSerializerImpl.java:368)
        at org.apache.geode.internal.DSFIDFactory.create(DSFIDFactory.java:1031)
        at org.apache.geode.internal.InternalDataSerializer.readDSFID(InternalDataSerializer.java:2391)
        at org.apache.geode.internal.InternalDataSerializer.readDSFID(InternalDataSerializer.java:2403)
        at org.apache.geode.internal.tcp.Connection.readMessage(Connection.java:2979)
        at org.apache.geode.internal.tcp.Connection.processInputBuffer(Connection.java:2797)
        at org.apache.geode.internal.tcp.Connection.readMessages(Connection.java:1651)
        at org.apache.geode.internal.tcp.Connection.run(Connection.java:1482)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.NotSerializableException
        at org.apache.geode.internal.cache.FunctionStreamingReplyMessage.fromData(FunctionStreamingReplyMessage.java:97)
        at org.apache.geode.internal.serialization.internal.DSFIDSerializerImpl.invokeFromData(DSFIDSerializerImpl.java:317)
        ... 11 more
Caused by: java.io.IOException: Unknown header byte 0
        at org.apache.geode.internal.serialization.DscodeHelper.toDSCODE(DscodeHelper.java:40)
        at org.apache.geode.internal.InternalDataSerializer.basicReadObject(InternalDataSerializer.java:2496)
        at org.apache.geode.DataSerializer.readObject(DataSerializer.java:2864)
        at org.apache.geode.DataSerializer.readHashMap(DataSerializer.java:2261)
        at org.apache.geode.management.internal.configuration.messages.ConfigurationResponse.fromData(ConfigurationResponse.java:69)
        at org.apache.geode.internal.DSFIDFactory.readConfigurationResponse(DSFIDFactory.java:1091)
        at org.apache.geode.internal.DSFIDFactory.create(DSFIDFactory.java:1027)
        at org.apache.geode.internal.InternalDataSerializer.basicReadObject(InternalDataSerializer.java:2510)
        at org.apache.geode.DataSerializer.readObject(DataSerializer.java:2864)
        at org.apache.geode.internal.cache.FunctionStreamingReplyMessage.fromData(FunctionStreamingReplyMessage.java:93)
        ... 12 more
or 
[severe 2020/12/18 16:36:12.847 JST cache1 <P2P message reader for 127.0.0.1(locator1:46872:locator)<ec><v21>:41000(version:UNKNOWN[ordinal=115]) shared unordered uid=1 port=49324> tid=0x7f] Error deserializing message
java.lang.ClassNotFoundException: org.apache.geode.management.internal.functions.RebalanceFunction
	at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	at java.lang.Class.forName0(Native Method)
	at java.lang.Class.forName(Class.java:348)
	at java.io.ObjectInputStream.resolveClass(ObjectInputStream.java:686)
	at org.apache.geode.internal.InternalDataSerializer$DSObjectInputStream.resolveClass(InternalDataSerializer.java:3776)
	at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1868)
	at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1751)
	at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2042)
	at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
	at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431)
	at org.apache.geode.internal.InternalDataSerializer.readSerializable(InternalDataSerializer.java:2932)
	at org.apache.geode.internal.InternalDataSerializer.basicReadObject(InternalDataSerializer.java:2876)
	at org.apache.geode.DataSerializer.readObject(DataSerializer.java:2977)
	at org.apache.geode.internal.cache.MemberFunctionStreamingMessage.fromData(MemberFunctionStreamingMessage.java:276)
	at org.apache.geode.internal.InternalDataSerializer.invokeFromData(InternalDataSerializer.java:2470)
	at org.apache.geode.internal.DSFIDFactory.create(DSFIDFactory.java:990)
	at org.apache.geode.internal.InternalDataSerializer.readDSFID(InternalDataSerializer.java:2613)
	at org.apache.geode.internal.InternalDataSerializer.readDSFID(InternalDataSerializer.java:2625)
	at org.apache.geode.internal.tcp.Connection.processNIOBuffer(Connection.java:3501)
	at org.apache.geode.internal.tcp.Connection.runNioReader(Connection.java:1814)
	at org.apache.geode.internal.tcp.Connection.run(Connection.java:1676)
	at java.lang.Thread.run(Thread.java:748)


Environment

Product Version: 10.2

Resolution

We recommend that you do not attempt to upgrade to the following versions of VMWare Tanzu GemFire for VMs
  • 1.13.0  from any earlier versions
  • 1.12.2 from 1.11.3
  • 1.14.0 from 1.10.6
And if you are upgrading VMWare Tanzu GemFire from the following list, then do not perform rolling upgrade, perform offline upgrade [1]
  • 9.9.5 to 9.10.6
  • 1.13.1 from any earlier versions 

[1] https://gemfire.docs.pivotal.io/910/gemfire/getting_started/upgrade/upgrade_offline.html

Powered by Wolken Software