Route Redistribution config is lost post-upgrade when the Route Redistribution is configured via NSX-T "Manager" UI/API.
Article ID: 312591
Updated On:
Products
VMware NSX Networking
Issue/Introduction
Symptoms:
- NSX-T loses the Route Redistribution config post the NSX-T Manager Upgrade when the Route Redistribution is configured via Manager UI/API.
- North/South connectivity issues could be experienced.
- Entries similar to the following could be observed after the upgrade in /var/log/policy/policy.log
2022-03-03T02:24:36.227Z INFO providerTaskExecutor-10 NsxTRestClient - POLICY [nsx@6876 comp="nsx-manager" level="INFO" subcomp="policy"] NSX API PUT http://127.0.0.1:7440/nsxapi/api/v1/logical-routers/bb846372-ae06-4952-a454-32f07fd2f9b1/routing/redistribution/rules is called with RedistributionRuleListDto{rules='[]', logicalRouterId='bb846372-ae06-4952-a454-32f07fd2f9b1', super{ManagedResource{resourceType='RedistributionRuleList', aCreateUser='null', aCreateTime='null', aLastModifiedUser='null', aLastModifiedTime='null', aSystemOwned='null', aProtection='null', id='null', displayName='Tier-0-rt-redistribution-rule-list', description='Routing redistribution rule list for logical router bb846372-ae06-4952-a454-32f07fd2f9b1', tags='null', super{RevisionedResource{aRevision='1', super{Resource{aSelf='null', aLinks='null', aSchema='null'}}}}}}} and [Ljava.lang.Object;@245d06e0
2022-03-03T03:45:08.964Z INFO providerTaskExecutor-31 NsxTRestClient 17185 POLICY [nsx@6876 comp="nsx-manager" level="INFO" subcomp="policy"] NSX API PUT http://127.0.0.1:7440/nsxapi/api/v1/logical-routers/bb846372-ae06-4952-a454-32f07fd2f9b1/routing/redistribution/rules is called with RedistributionRuleListDto{rules='[]', logicalRouterId='bb846372-ae06-4952-a454-32f07fd2f9b1', super{ManagedResource{resourceType='RedistributionRuleList', aCreateUser='null', aCreateTime='null', aLastModifiedUser='null', aLastModifiedTime='null', aSystemOwned='null', aProtection='null', id='null', displayName='Tier-0-rt-redistribution-rule-list', description='Routing redistribution rule list for logical router bb846372-ae06-4952-a454-32f07fd2f9b1', tags='null', super{RevisionedResource{aRevision='5', super{Resource{aSelf='null', aLinks='null', aSchema='null'}}}}}}} and
2022-03-03T03:45:08.964Z INFO providerTaskExecutor-31 NsxTRestClient 17185 POLICY [nsx@6876 comp="nsx-manager" level="INFO" subcomp="policy"] NSX API PUT http://127.0.0.1:7440/nsxapi/api/v1/logical-routers/bb846372-ae06-4952-a454-32f07fd2f9b1/routing/redistribution/rules is called with RedistributionRuleListDto{rules='[]', logicalRouterId='bb846372-ae06-4952-a454-32f07fd2f9b1', super{ManagedResource{resourceType='RedistributionRuleList', aCreateUser='null', aCreateTime='null', aLastModifiedUser='null', aLastModifiedTime='null', aSystemOwned='null', aProtection='null', id='null', displayName='Tier-0-rt-redistribution-rule-list', description='Routing redistribution rule list for logical router bb846372-ae06-4952-a454-32f07fd2f9b1', tags='null', super{RevisionedResource{aRevision='5', super{Resource{aSelf='null', aLinks='null', aSchema='null'}}}}}}} and
Environment
VMware NSX-T
Cause
The route redistribution will not be migrated to the newer version after the upgrade of NSX-T Manager, if the "route_redistribution_types" are not part of locale-services.
Resolution
Currently there is no resolution to this issue.
Workaround:
Reconfigure the Route Redistribution via Policy API/UI before the Upgrade to avoid encountering the issue.
or
Reconfigure the Route Redistribution via Policy API/UI after the Upgrade to remediate the issue.
How to validate whether the issue is present:
Workaround:
Reconfigure the Route Redistribution via Policy API/UI before the Upgrade to avoid encountering the issue.
or
Reconfigure the Route Redistribution via Policy API/UI after the Upgrade to remediate the issue.
How to validate whether the issue is present:
- Run the below API and ensure that the "route_redistribution_types" are present in locale-services
https://<NSX-T-IP>/policy/api/v1/infra/tier-0s/<Tier-0-Name>/locale-services
- Example to show when the system would NOT migrate the Route distribution post upgrade
{
"results" : [ {
"route_redistribution_config" : {
"bgp_enabled" : true,
"redistribution_rules" : [ ] <<<< This absence of an entry is indicative of the issue.
},
"bfd_profile_path" : "/infra/bfd-profiles/default",
"resource_type" : "LocaleServices",
"id" : "2b9994a0-9a96-11ec-8bde-394a1b48172d",
"display_name" : "2b9994a0-9a96-11ec-8bde-394a1b48172d",
"path" : "/infra/tier-0s/Tier-0/locale-services/2b9994a0-9a96-11ec-8bde-394a1b48172d",
"relative_path" : "2b9994a0-9a96-11ec-8bde-394a1b48172d",
"parent_path" : "/infra/tier-0s/Tier-0",
"marked_for_delete" : false,
"overridden" : false,
"_create_user" : "admin",
"_create_time" : 1646273001602,
"_last_modified_user" : "system",
"_last_modified_time" : 1646278272786,
"_system_owned" : false,
"_protection" : "NOT_PROTECTED",
"_revision" : 4
} ],
"result_count" : 1,
"sort_by" : "display_name",
"sort_ascending" : true
}
"results" : [ {
"route_redistribution_config" : {
"bgp_enabled" : true,
"redistribution_rules" : [ ] <<<< This absence of an entry is indicative of the issue.
},
"bfd_profile_path" : "/infra/bfd-profiles/default",
"resource_type" : "LocaleServices",
"id" : "2b9994a0-9a96-11ec-8bde-394a1b48172d",
"display_name" : "2b9994a0-9a96-11ec-8bde-394a1b48172d",
"path" : "/infra/tier-0s/Tier-0/locale-services/2b9994a0-9a96-11ec-8bde-394a1b48172d",
"relative_path" : "2b9994a0-9a96-11ec-8bde-394a1b48172d",
"parent_path" : "/infra/tier-0s/Tier-0",
"marked_for_delete" : false,
"overridden" : false,
"_create_user" : "admin",
"_create_time" : 1646273001602,
"_last_modified_user" : "system",
"_last_modified_time" : 1646278272786,
"_system_owned" : false,
"_protection" : "NOT_PROTECTED",
"_revision" : 4
} ],
"result_count" : 1,
"sort_by" : "display_name",
"sort_ascending" : true
}
- Example to show when the system would migrate the Route distribution post upgrade
{
"results" : [ {
"route_redistribution_types" : [ "TIER0_CONNECTED", "TIER0_STATIC" ], <<<<< Entry when the parameter is present
"resource_type" : "LocaleServices",
"id" : "2c462a80-9aa5-11ec-9036-99f4b6431d1e",
"display_name" : "2c462a80-9aa5-11ec-9036-99f4b6431d1e",
"path" : "/infra/tier-0s/Tier-0/locale-services/2c462a80-9aa5-11ec-9036-99f4b6431d1e",
"relative_path" : "2c462a80-9aa5-11ec-9036-99f4b6431d1e",
"parent_path" : "/infra/tier-0s/Tier-0",
"marked_for_delete" : false,
"_create_user" : "admin",
"_create_time" : 1646279276378,
"_last_modified_user" : "admin",
"_last_modified_time" : 1646279293871,
"_system_owned" : false,
"_protection" : "NOT_PROTECTED",
"_revision" : 1
} ],
"result_count" : 1,
"sort_by" : "display_name",
"sort_ascending" : true
}
"results" : [ {
"route_redistribution_types" : [ "TIER0_CONNECTED", "TIER0_STATIC" ], <<<<< Entry when the parameter is present
"resource_type" : "LocaleServices",
"id" : "2c462a80-9aa5-11ec-9036-99f4b6431d1e",
"display_name" : "2c462a80-9aa5-11ec-9036-99f4b6431d1e",
"path" : "/infra/tier-0s/Tier-0/locale-services/2c462a80-9aa5-11ec-9036-99f4b6431d1e",
"relative_path" : "2c462a80-9aa5-11ec-9036-99f4b6431d1e",
"parent_path" : "/infra/tier-0s/Tier-0",
"marked_for_delete" : false,
"_create_user" : "admin",
"_create_time" : 1646279276378,
"_last_modified_user" : "admin",
"_last_modified_time" : 1646279293871,
"_system_owned" : false,
"_protection" : "NOT_PROTECTED",
"_revision" : 1
} ],
"result_count" : 1,
"sort_by" : "display_name",
"sort_ascending" : true
}
Feedback
Yes
No
Powered by
