Cannot convert Text file to ANSI format

(1) Share

Report

Posted on by PriyaDutta

349

Hi ,

I'm trying to create a plain text file in ANSI format. Please see my below code for reference. I used stream reader to check while debugging , but the current encoding still shows UTF8. I need the file in ANSI format.

Please help.

 System.IO.Stream stream1 = streamIO.getStream();
 stream1.Position = 0;
 System.IO.StreamReader reader1 = new System.IO.StreamReader(stream1);
str filecontent = reader1.ReadToEnd();

 System.Text.Encoding encoding = System.Text.Encoding::GetEncoding(1252);

 System.Byte[] byteArray = encoding.GetBytes(fileContent);

 System.IO.Stream stream = new System.IO.MemoryStream(byteArray);
 stream.Position=0;

Initializing streamIO as below:

 streamIO = TextStreamIo::constructForWrite();

 streamIO.outFieldDelimiter("^");
 
 streamIO.inFieldDelimiter("$");

Thanks.

Categories:

Dynamics 365 Finance

I have the same question (0)

All responses (4)

Answers (1)

Verified answer

Martin Dráb 237,987 Most Valuable Professional on at

Like (0)

Report

If fileContent is contains UTF8 data, reading it with Encoding for 1252 is wrong. You should get bytes for the right encoding and then use System.TextEncoding::Convert() to convert the data from one encoding to another.

By the way, be careful with "but the current encoding still shows UTF8". Except of files with BOM, there usually is no information about encoding, therefore text editors can't really tell us which encoding it is. Then often show something, but you can't trust it.

By the way, you've chosen Dynamics AX as the category, but the code looks like F&O. Isn't it the case?

Was this reply helpful? Yes No
PriyaDutta 349 on at

Like (0)

Report
Hi Martin,

Yes you are right its F&O.

I also tried your suggestion and have written the below code. Still I see UTF8 only.

As you said its difficult to check which encoding it is. How to know if the code is working or not ?

System.IO.Stream stream1 = streamIO.getStream(); stream1.Position = 0; System.IO.StreamReader reader1 = new System.IO.StreamReader(stream1); str filecontent = reader1.ReadToEnd(); System.Text.Encoding ansiEncoding = System.Text.Encoding::GetEncoding(1252); System.Text.Encoding utfEncoding = System.Text.Encoding::GetEncoding(65001); System.Byte[] utf8Bytes = utfEncoding.GetBytes(fileContent); System.Byte[] byteArray = System.Text.Encoding::Convert(utfEncoding, ansiEncoding, utf8Bytes); System.IO.Stream stream = new System.IO.MemoryStream(byteArray); stream.Position=0;

Thanks.

Was this reply helpful? Yes No
Martin Dráb 237,987 Most Valuable Professional on at

Like (0)

Report

Could you please tell me what you mean by "I see UTF8"? Where do you see it?

Your code looks correct to me; byteArray contains the bytes of text in 1252 codepage.

You can test that the text is in the correct codepage by including some characters above ASCII and trying to interpretting the data as different codepage (such as 1250), e.g. in Notepad++.

Regarding UTF-8, it includes all characters of 1252 codepage, but you can use a character that isn't included in 1252. The expected result is getting a question mark instead of the character.

By the way, I would use System.Text.Encoding::UTF8 rather than System.Text.Encoding::GetEncoding(65001), because the name is easier to understand than the code.

Was this reply helpful? Yes No
PriyaDutta 349 on at

Like (0)

Report

Hi Martin,

When I add non ANSI characters like "€, ñ" etc and generate the file. Then the file in Notepad++ shows as ANSI. But when I removed these characters and generated the same file then it shows UTF8. Looks like the notepad++ is guessing the encoding and as you said its not accurate.

Thanks for the help , I think it is working fine.

Was this reply helpful? Yes No

Join the conversation

Community site session details

Cannot convert Text file to ANSI format

Helpful resources

Quick Links

Responsible AI policies

Neeraj Kumar – Community Spotlight

Congratulations to the November Top 10 Community Leaders!

Leaderboard > Finance | Project Operations, Human Resources, AX, GP, SL

Featured topics

Product updates

Community site session details

Cannot convert Text file to ANSI format

Helpful resources

Quick Links

Responsible AI policies

Neeraj Kumar – Community Spotlight

Congratulations to the November Top 10 Community Leaders!

Subscribe to this forum!

Select categories

Leaderboard > Finance | Project Operations, Human Resources, AX, GP, SL

Featured topics

Product updates