Hey there
I'm here to help.
Can you please convert your CSV file to UTF-8 using Microsoft Excel:
In Excel, create a new blank document (workbook).
From the Data menu, select From Text/CSV. Browse to your exported CSV file (you may have to select to display Text Files (....csv) to see it). Select Import.
In the dialog box that appears, under File Origin, choose the encoding that makes the characters in the text appear correctly, for example, Cyrillic Windows 1251, and then select Load.
Check that characters are displayed correctly in Excel.
Select File >Save As. Enter a name for your file, and select CSV UTF-8 (Comma delimited) (*.csv) as your file type.
Select Save.
Now try importing again.
Please find below microsoft page for more details on importing gmail contacts into Outlook
More info from microsoft on importing contacts into Outlook (Web)
https://support.microsoft.com/en-us/topic/bb796340-b58a-46c1-90c7-b549b8f3c5f8
I'm adding import/export guide document here for your reference.
I hope it helps