Character corruption in IDM around ' the single left quote character.

Products

• CA Identity Suite

Issue/Introduction

When creating a PXPolicy with an email body containing French characters, specifically the 'single left quote' (unicode character U+2018), or example in the word "d’emploi" the single quote gets flipped to an upside down question mark:

This example is only showing the single left quote ' character flipped:

Cause

This is due to the database being set to a SINGLE BYTE Character set.   

Identity Manager documentation states that double byte characters can be corrupted if using a single byte character set:

Identity Manager uses multi-byte character encoding (UTF-8). If you specify a single-byte character set, characters may appear corrupted because of insufficient character space. For instructions on setting the NLS_LANG parameter and the database character encoding, see the Oracle documentation.

Resolution

Work with your DBA to migrate the backend Database to a UTF-8 double byte character set. 


The corrupted characters will need to be fixed after the database migration to appear correctly to end users. 

Additional Information

Any and all double byte characters could be impacted by this issue.