RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1220812 - Console shows non-latin characters (such as from Greek and Japanese) as white rectangles
Summary: Console shows non-latin characters (such as from Greek and Japanese) as white...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Enterprise Linux 7
Classification: Red Hat
Component: systemd
Version: 7.1
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: rc
: ---
Assignee: systemd-maint
QA Contact: qe-baseos-daemons
URL:
Whiteboard:
Depends On:
Blocks: 1182562
TreeView+ depends on / blocked
 
Reported: 2015-05-12 14:00 UTC by Martin Kolman
Modified: 2015-11-19 15:01 UTC (History)
7 users (show)

Fixed In Version: systemd-219-1.el7
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2015-11-19 15:01:18 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
white rectangles are displayed instead of non-latin characters (19.08 KB, image/png)
2015-05-12 14:00 UTC, Martin Kolman
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2015:2092 0 normal SHIPPED_LIVE systemd bug fix and enhancement update 2015-11-19 12:13:57 UTC

Description Martin Kolman 2015-05-12 14:00:54 UTC
Created attachment 1024611 [details]
white rectangles are displayed instead of non-latin characters

Description of problem:
Non-latin characters such as those found in Greek and Japanese (and most probably other languages that are not using a Latin alphabet) show up as undistinguishable white rectangles.

Version-Release number of selected component (if applicable):
systemd 208

How reproducible:
always

Steps to Reproduce:
1. install RHEL 7.1
2. set locale to Japanese or Greek:

export LANG=el_GR.UTF-8

or

export LANG=ja_JP.UTF-8
3. run the date command (or any other console command that returns translated non-latin characters)

Actual results:
The output contains white rectangles instead of non-latin characters.

Expected results:
The non-latin characters in the output are correctly rendered.

Additional info:
This among other things break the Anaconda and Initial Setup text interface when the user has selected an installation language that uses non-latin characters, such as Japanese - users are presented by a console full of numbers and white rectangles. This is tracked as bug 1182562.

Comment 2 Jan Synacek 2015-05-20 11:38:21 UTC
It looks like https://bugzilla.redhat.com/show_bug.cgi?id=1150384. Note that the bug required systemd *and* dracut to be fixed.

Comment 3 Lukáš Nykrýn 2015-05-20 12:14:28 UTC
The dracut patch is in rhel since 7.1.

Comment 4 Lukáš Nykrýn 2015-06-10 12:04:22 UTC
This seems to be working now. Just set (for el_GR) 
FONT="iso07u-16" in /etc/vconsole.conf

For QE I am not sure if this was broken before rebase, but it will be good to have a test for it.

Comment 7 Martin Kolman 2015-06-29 11:28:43 UTC
(In reply to Lukáš Nykrýn from comment #4)
> This seems to be working now. Just set (for el_GR) 
> FONT="iso07u-16" in /etc/vconsole.conf
> 
> For QE I am not sure if this was broken before rebase, but it will be good
> to have a test for it.

I've tried it out on the RHEL-7.2-20150625.n.0 nightly, which has systemd 219-4. Right after installation I would still get the white rectangles in the Greek and Japanese locales. After changing the font to iso07u-16 in /etc/vconsole.conf and rebooting Greek seems to be working but Japanese is still busted:
https://m4rtink.fedorapeople.org/anaconda/screenshots/non-latin_console/console_non-latin_june29.png

Also if I understand it correctly, this fix does not address the fact that without changing the default console font non-latin characters will still be displayed as rectangles ?

This bug has been motivated by bug 1182562 - Anaconda & Initial Setup TUI showing as rectangles when the user selects a language with non-latin characters. It currently looks like this,
for Greek:
https://m4rtink.fedorapeople.org/anaconda/screenshots/non-latin_console/anaconda_tui_greek_june29.png

And for Japanese:
https://m4rtink.fedorapeople.org/anaconda/screenshots/non-latin_console/anaconda_tui_japanese_june29.png

Do I understand it correctly we would need to change the console font at runtime (and somehow map language codes to the proper console font name) to make it show up correctly ? Or is there some "universal" font or other mechanism that could do that (show proper characters instead of rectangles based on locale) automatically ?

Comment 8 Jan Synacek 2015-06-29 12:42:45 UTC
(In reply to Martin Kolman from comment #7)
> Also if I understand it correctly, this fix does not address the fact that
> without changing the default console font non-latin characters will still be
> displayed as rectangles ?

How is the text supposed to be displayed correctly if the font is wrong? Merely changing the locale setting is not enough (in case of Greek or Japanese, that is).

> Do I understand it correctly we would need to change the console font at
> runtime (and somehow map language codes to the proper console font name) to
> make it show up correctly ?

Yes.

> Or is there some "universal" font or other
> mechanism that could do that (show proper characters instead of rectangles
> based on locale) automatically ?

AFAIK systemd uses it's own algorithm to approximate this.

Comment 9 Adam Williamson 2015-09-22 17:15:16 UTC
Some notes here:

1) There is no 'universal' console font. AFAIK there's a limited number of characters you can include in any console font, and it's not enough to cover all scripts.

2) EL 7's default console font is still, I believe, latarcyrheb-sun16 . 'latarcyrheb' is a contract of 'latin arabic cyrillic hebrew' - i.e. those are the scripts it can render. Note that neither 'greek' nor 'japanese' is in that list. Fedora changed its default console font to 'eurlatgr' - 'european-latin-greek' - in F22: see https://fedoraproject.org/wiki/Changes/NewDefaultConsoleFont . That provides better coverage for European languages and includes Greek, but sacrifices Cyrillic, Arabic and Hebrew rendering.

3) systemd-vconsole-setup takes care of loading the 'default' console font during boot. The 'default' font is actually just what's listed in /etc/vconsole.conf : if that file contains a FONT= line, systemd-vconsole-setup will load it. It also looks for a 'vconsole.font' kernel parameter. If neither of those things is set, systemd-vconsole-setup will not load any font, and the console font provided by the system firmware will still be used.

Up till recently Fedora had a bug whereby there was no /etc/vconsole.conf in the anaconda environment, so the 'default' console font was not actually being loaded. Looking at EL 7, I believe it has the same bug: there is no /etc/vconsole.conf file, and Cyrillic characters are rendered as white boxes, even though latarcyrheb should be able to display them. As well as the fix from #1182562 , I think EL 7's lorax should be fixed to include /etc/vconsole.conf in the installer environment, as we did for Fedora 23: https://bugzilla.redhat.com/show_bug.cgi?id=1250260

Comment 10 errata-xmlrpc 2015-11-19 15:01:18 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHBA-2015-2092.html


Note You need to log in before you can comment on or make changes to this bug.