SQL upgrade from 2017 to 2019 fails with FIPS mode enabled

Products

• Endpoint Protection

Issue/Introduction

When upgrading a SQL server from 2017 to 2019 which hosts the SEPM database, the error message "The following error has occurred: An error occurred while installing extensibility feature with error message: AppContainer Creation Failed with error message NONE, state This implementation is not part of the Windows Platform FIPS validated cryptographic algorithms.." is received.

Environment

SQL Server 2017
SQL Server 2019
Symantec Endpoint Protection

Cause

Error message:

"The following error has occurred:  An error occurred while installing extensibility feature with error message: AppContainer Creation Failed with error message NONE, state This implementation is not part of the Windows Platform FIPS validated cryptographic algorithms.."

The following may be in place when experiencing this issue:

1. SEPM FIPS mode
2. FIPS mode at the OS level using the System cryptography setting "Use FIPS compliant algorithms for encryption, hashing and signing".

Resolution

Temporarily disable the "Use FIPS compliant algorithsm for encryption, hashing and signing" System cryptography setting then proceed with the upgrade.  Once the upgrade is complete, FIPS can be enabled again.

Additional Information

How to check FIPS mode and toggle it:

For SEPM: Enabling or disabling the FIPS mode for the Symantec Endpoint Protection Manager

At OS level: System cryptography: Use FIPS compliant algorithms for encryption, hashing, and signing