Bug 1591265

Summary: Problem with iconv converting ISO8859-1 to IBM273
Product: Red Hat Enterprise Linux 6 Reporter: Paulo Andrade <pandrade>
Component: glibcAssignee: glibc team <glibc-bugzilla>
Status: CLOSED WONTFIX QA Contact: qe-baseos-tools-bugs
Severity: medium Docs Contact:
Priority: medium    
Version: 6.9CC: a.r.welter, ashankar, codonell, dj, fweimer, mnewsome, pfrankli
Target Milestone: rc   
Target Release: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 1591268 (view as bug list) Environment:
Last Closed: 2018-06-14 13:00:28 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1591268    

Description Paulo Andrade 2018-06-14 12:26:02 UTC 
Converting files or characters using iconv (or the iconv library) result in
an "illegal input sequence" error when encountering an "overscore" character
(IS08859-1: Hex "AF"). This happens tough there is a corresponding character
is available in IBM273 (Hex: "BC"). Converting to IBM1141, which is  the same
table as IBM273 except for the EURO-Sign works.

You can reproduce this behavior with the following command:

echo "AF" | xxd -r -p | iconv -f iso8859-1 -t ibm273

In contrast:
echo "AF" | xxd -r -p | iconv -f iso8859-1 -t ibm1141
works.

Using ibm273//TRANSLIT is not an option currently, as it would require a
lot of changes in the user code, and would just not throw an error, but
replace the "overscore" with an "o".

This problem happens in rhel7 and fedora 28.
Comment 1 Florian Weimer 2018-06-14 13:00:20 UTC 
Our IBM273 codepage maps the 0xbc EBCDIC codepoint to the U+203E OVERLINE character:

<U203E>     /xbc         OVERLINE

While this is arguably a mistake (and we will fix it upstream), it is now too late to change this in Red Hat Enterprise Linux 6 because many customers will expect the mappings to remain stable.
Comment 2 Red Hat Bugzilla Rules Engine 2018-06-14 13:00:28 UTC 
Development Management has reviewed and declined this request. You may appeal this decision by reopening this request.