Chinese or any non-English characters get converted to a question mark (?) when .xlsx file is saved as .csv to create an EDM profile.

Products

• Data Loss Prevention Network Monitor and Prevent for Email

Issue/Introduction

If a MS Excel file (.xlsx) file is saved in a .csv format, you might see non-English characters getting converted to a question mark ('?'). For e.g. 

Original .xlsx file:

After saving in .csv format it looks like below:

If this .csv file is used to create a EDM profile, detection against this profile does not work.

Environment

Release : 15.7 and above

 

Cause

.csv format does not save non-English characters correctly when saved from MS Excel.

Resolution

First, save the MS excel file as 'Unicode text (*.txt)' then rename .txt file to .csv. If you open .csv file in excel the non-English characters should display correctly. This .csv file can now be used for EDM profile.