Compliance Scanner is giving error "failed: the following benchmarks are invalid" while doing scan after upgrading to v1.3.0

Products

• Operations Manager

Issue/Introduction

In Compliance Scanner v1.3.0, additional Jammy benchmarks: Jammy CIS - Level 1 v1.0.0 and Jammy CIS - Level 2 v1.0.0 are added. For information about these new benchmarks, see Benchmarks for Compliance Scanner.

After upgrading Compliance Scanner to v1.3.0 from v1.2.x, Compliance Scanner is giving error below in scan_results:

failed: the following benchmarks are invalid: [Xenial-CIS-Level-1 Xenial-CIS-Level-2 Xenial-STIG Jammy-CIS-Level-1 Jammy-CIS-Level-2]

Resolution

It's the reason Compliance Scanner 1.3 docs has a known issue of turning off "Run configured scans ". The scenario users are describing would be the same as the known issue, where some deployments have the new/updated benchmarks where as the others have old benchmarks.

To work around this, users need to apply change on all tiles with Upgrade all service instances errand enabled and re-run scan after upgrading Compliance scanner to v1.3.0 from v1.2.x to get all the deployments to have the same benchmarks.