Add UTF8NoBom property to System.Text.Encoding class

[oliverjanik]

The System.Text.Encoding.UT8 encodes using BOM which is generally not recommended.

Can we have a UTF8NoBom property for convenience ?

[MeikTranel]

There's a constructor that lets you switch off the bom. See https://docs.microsoft.com/en-us/dotnet/api/system.text.utf8encoding.-ctor?view=netcore-3.1#System_Text_UTF8Encoding__ctor_System_Boolean_

[GrabYourPitchforks]

True, it's easy for somebody to construct this themselves. But a devil's advocate argument: we define an internal property UTF8NoBom in around a half-dozen places throughout our codebase. If we're doing this frequently then it stands to reason that our customers are doing it frequently as well.

[MeikTranel]

True. I'm in favor of this as well. It was more me making sure people immediately see that there is an easy workaround when they land on this page via google.

[GrabYourPitchforks]

@tarekgh Do you have any thoughts on this?

[tarekgh]

No objection here. I am just wondering, do we need to add properties like UnicodeNoBom and UTF32NoBom?

Minor issue, regarding naming. I think 'Bom' is ok but, is it better to use UTF8NoBOM? we did a similar thing when we used ISO and UTF. Or use the full name UTF8NoByteOrderMark.

[GrabYourPitchforks]

I don't know if there's much evidence that people use UnicodeEncoding or UTF32Encoding anywhere near as much as UTF8Encoding. But if we had such evidence then an accelerator on those might also make sense.

[tarekgh]

Unicode encoding usually used with System.IO. UTF32 is rarely used. We can wait not exposing any properties for these till we get a demand.

[jkotas]

we define an internal property UTF8NoBom in around a half-dozen

Most of these internal places define this property as NoBom + throwing. Do we want the encoding returned by this property to be non-throwing or throwing? Do we want to have both variants (throwing and non-throwing)?

[tarekgh]

I think providing both options (throwing and non-throwing) would be the best. but the priority would be for non-throwing as users will have more control.

[augustoproiete]

A simple UTF8NoBOM property should be non-throwing for consistency with the other properties in the Encoding class (UTF8, Unicode, BigEndianUnicode, etc...) which are all non-throwing.

My understanding is that a non-throwing instance is always used for reading (relaxed), whilst a throwing instance is always used for writing (strict), so it would be great if both options were available.