Bug 440992 - [ro] Correct Romanian glyphs in Liberation Fonts.
Summary: [ro] Correct Romanian glyphs in Liberation Fonts.
Keywords:
Status: CLOSED RAWHIDE
Alias: None
Product: Fedora
Classification: Fedora
Component: liberation-fonts
Version: 12
Hardware: All
OS: Linux
low
medium
Target Milestone: ---
Assignee: Caius Chance
QA Contact: Fedora Extras Quality Assurance
URL: http://www.secarica.ro
Whiteboard:
Depends On: 251890 337271 444392
Blocks: 450061
TreeView+ depends on / blocked
 
Reported: 2008-04-04 20:35 UTC by Răzvan Sandu
Modified: 2010-05-10 18:54 UTC (History)
7 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2010-05-10 07:25:20 UTC
Type: ---
Embargoed:


Attachments (Terms of Use)
Screenshot of triage. (122.85 KB, image/png)
2008-04-11 01:09 UTC, Caius Chance
no flags Details
Test Case created and used. (94.50 KB, application/msword)
2008-04-11 01:09 UTC, Caius Chance
no flags Details
Example of right and wrong Romanian characters in DejaVu Serif (41.90 KB, application/pdf)
2008-04-21 05:22 UTC, Răzvan Sandu
no flags Details

Description Răzvan Sandu 2008-04-04 20:35:38 UTC
Description of problem:

When used on a system configured for Romanian language, liberation-fonts
generates wrong characters:

- "T with cedilla below" (Unicode 0162) instead of "T with comma below" (Unicode
021A)
- "t with cedilla below" (Unicode 0163) instead of "t with comma below" (Unicode
021B)
- "S with cedilla below" (Unicode 015E) instead of "S with comma below" (Unicode
0218)
- "s with cedilla below" (Unicode 015F) instead of "s with comma below" (Unicode
0219)

For non-Romanian developers: there is no such thing as „cedilla-below”
characters in Romanian language; please see http://www.secarica.ro

Version-Release number of selected component (if applicable):
liberation-fonts.noarch 0:1.0-4.fc9

How reproducible:
Always.

Steps to Reproduce:

1. Install latest Fedora (development)
2. Configure it for Romanian language
3. Open a new text document in OpenOffice.org
4. Press AltGr+s and AltGr+t (and Shift for capitals) to insert the specific
Romanian characters.
  
Actual results:
Characters with cedilla below are inserted in the document.

Expected results:
Characters with comma below should be inserted.

Additional info:
This is a historical bug for Romanian language implementations, still not solved .

Comment 1 Caius Chance 2008-04-07 07:12:19 UTC
bug#251890 need to be resolved by manufacturer before this one to be handled.

Comment 2 Caius Chance 2008-04-11 00:55:59 UTC
Hi Razvan, I don't have AltGr key on my keyboard to perform the following step:

4. Press AltGr+s and AltGr+t (and Shift for capitals) to insert the specific
Romanian characters.

I used gucharmap to manually check the characters, here are the findings:

- "S with cedilla below" (Unicode 015E) and "s with cedilla below" (Unicode
015F) look alright, it looks like cedilla but not comma (I read the
http://www.secarica.ro).

- "T with cedilla below" (Unicode 0162) and "t with cedilla below" (Unicode
0163) look incorrectly. As you mention, they are like 'T' and 't' with a comma
below but not a cedilla.

Please be aware that, the latest Fedora is using 'Sans', 'Serif', 'Monospace'
alias as its default fonts which they are variable depends on availability of
installed fonts.

I am taking screenshots and reporting to author about this. Thank you very much.

Comment 3 Caius Chance 2008-04-11 01:09:03 UTC
Created attachment 302092 [details]
Screenshot of triage.

The 'T' and 't' have comma below them that is not right. They should look like
the 'S' and 's' on the left the them.

Comment 4 Caius Chance 2008-04-11 01:09:34 UTC
Created attachment 302093 [details]
Test Case created and used.

Comment 5 Răzvan Sandu 2008-04-21 04:49:42 UTC
Hello and thanks !

Please use *the Alt key at right of the spacebar on any US keyboard* to
reproduce this.

Regards,
Răzvan


Comment 6 Răzvan Sandu 2008-04-21 04:56:28 UTC
Hello, Caius & all,


IMPORTANT - regarding comment #3 and attached image, please note that the comma
characters are the *good* ones, the cedilla characters the *wrong* ones ! That
is exactly the reverse of comment #3.

Please see the correct assignements of Unicode codes in the text of my initial bug.


Regards,
Răzvan

Comment 7 Răzvan Sandu 2008-04-21 05:22:12 UTC
Created attachment 303102 [details]
Example of right and wrong Romanian characters in DejaVu Serif

Comment 8 Caius Chance 2008-05-01 00:15:15 UTC
Because the initial manufacturer was not servicing these code points, we will
take care of this bug again after we has hosted this font in fedorahosted.org:

https://fedorahosted.org/liberation-fonts/

Currently, please keep an eye on this bug for our progress:

https://bugzilla.redhat.com/show_bug.cgi?id=444392

Comment 9 Răzvan Sandu 2008-05-08 06:16:36 UTC
The issue about Romanian incorrectly-generated characters was recently corrected
in bug #13277 at freedesktop.org.

Please see comments #82 and #83, with the appropriate patch:

http://bugs.freedesktop.org/show_bug.cgi?id=13277

Would you please include this correction in Red Hat/Fedora ASAP, since it
affects *thousands* of documents and webpages generated in Romanian language ?

Thanks a lot,
Răzvan


Comment 10 Bug Zapper 2008-05-14 08:55:09 UTC
Changing version to '9' as part of upcoming Fedora 9 GA.
More information and reason for this action is here:
http://fedoraproject.org/wiki/BugZappers/HouseKeeping

Comment 11 Răzvan Sandu 2008-05-30 08:46:33 UTC
Hello,

bug #444392 was CLOSED NEXTRELEASE.

Can we expect this issue being fixed in nextrelease, too ?

Thank you very much,
Răzvan


Comment 12 Caius Chance 2008-06-02 00:01:38 UTC
Hi Răzvan, I am looking into this bug. Thank you very much. Caius.

Comment 13 Caius Chance 2008-06-02 00:52:12 UTC
Hi Răzvan,

I've created the 4 glyphs you requested (and fixed the U+0162/0163 which
supposed to be cedilla under) and created this Sans Regular TTF for you to test:

https://fedorahosted.org/liberation-fonts/browser/archive/ttf_1_04c_bz440992_test/LiberationSans-Regular.ttf?format=raw

If you feel that's working alright, then I'll fix the remaining fonts and let
you kindly check out.

Best Regards, Caius.

Comment 14 Răzvan Sandu 2008-06-02 10:44:51 UTC
Caius,

Thank you VERY MUCH for your help (for the whole Romanian community).

Since I'm not a developer myself (I'm just a network admin), I'll contact the
Romanian localization team and see if the proposed patch is OK. Then I'll let
you know ASAP.

Thank you again,
Răzvan

Comment 15 Alexandru Szasz 2008-06-02 16:07:00 UTC
Hi Caius,

We need at least another character:
http://www.fileformat.info/info/unicode/char/2011/index.htm (NON-BREAKING
HYPHEN, U+2011)

Comment 16 Caius Chance 2008-06-02 23:43:27 UTC
Hi, looking into it, cheers.

(In reply to comment #15)
> Hi Caius,
> 
> We need at least another character:
> http://www.fileformat.info/info/unicode/char/2011/index.htm (NON-BREAKING
> HYPHEN, U+2011)



Comment 17 Caius Chance 2008-06-03 00:17:35 UTC
Created the U+2010 and U+2011 in Sans Regular for testing:

https://fedorahosted.org/liberation-fonts/browser/archive/ttf_1_04c_bz440992_test/LiberationSans-Regular.ttf?format=raw

Thank you very much for your info and feedback.

Comment 18 Alexandru Szasz 2008-06-03 05:16:15 UTC
Looks good, I think this bug can be closed.

Comment 19 Caius Chance 2008-06-04 02:23:11 UTC
Hi Alexandru, sorry about this bug is not ready to be closed yet. The above
testing ttf is just a sample to see if the patch is correct. There are still
Liberation Sans/Serif/Mono x Regular/Bold/Italic/BoldItalic (i.e. 11 of them are
remaining) waiting to be fixed.

I will process it and put it available for your further testing very soon. Thank
you very much for your commitment.

Comment 20 Răzvan Sandu 2008-06-04 06:52:12 UTC
Hello, Caius & all,

When system is set to Romanian (by anaconda, at install time or via
system-config-language, afterwards), in /etc/sysconfig/i18n we get a line:

SYSFONT="latarcyrheb-sun16"

Caius, please, do you know from which .rpm package these default fonts come from ?

We must file & resolve a bug regarding the comma/cedilla issue for these default
fonts and I don't know where to adress it, exactly.

This is extremely important, since the "latarcyrheb-sun16" is the first thing
that system "sees" after boot and we've already got some crashes due to
incorrect encoding. In some situations, some programs (including anaconda)
worked OK when set to English, but tracebacks occured when set to Romanian.


Thanks a lot,
Răzvan


Comment 21 Caius Chance 2008-06-04 07:41:26 UTC
Hi Răzvan,

(In reply to comment #20)

Hmm, it looks quite serious, doesn't it?

It's belonged to 'kbd' package in recent Fedora. Please feel free to file
another bug on that package for requesting supports on the issues you kindly
discovered.

Cheers, Caius.

Comment 22 Alexandru Szasz 2008-06-04 09:36:12 UTC
(In reply to comment #20)
> Hello, Caius & all,
> 
> When system is set to Romanian (by anaconda, at install time or via
> system-config-language, afterwards), in /etc/sysconfig/i18n we get a line:
> 
> SYSFONT="latarcyrheb-sun16"
> 

Are you sure? I've installed Fedora 9 i386 and x86_64 several times and
/etc/sysconfig/i18n looks like this:

LANG="ro_RO.UTF-8"
SYSFONT="Lat2-Terminus16"

I did use the graphical installer all the time. It may be only in text mode,
I'll test this.

Meantime here's a list of related bugs where this was addressed:

- comments 23 and 24 in bug 253892

- bug list:
https://bugzilla.redhat.com/buglist.cgi?version=&component=anaconda&bug_status=NEW&bug_status=ASSIGNED&bug_status=NEEDINFO&bug_status=MODIFIED&bug_status=ON_DEV&bug_status=ON_QA&bug_status=VERIFIED&bug_status=FAILS_QA&bug_status=RELEASE_PENDING&bug_status=POST&bug_status=PASSES_QA&bug_status=CLOSED&short_desc_type=allwordssubstr&short_desc=Romanian&long_desc_type=allwordssubstr&long_desc=
before opening a new bug.





Comment 23 Răzvan Sandu 2008-06-04 11:48:47 UTC
Sorry, my fault !

All systems I have at hand, running F9, were *upgraded* from F8, not fresh
installs. So Terminus is now, in F9, the default font when setting system to
Romanian ?


However:

- changing the default font is just a temporary solution, IMHO.
"latarcyrheb-sun16" should also include the correct glyphs for the Romanian
language;

- when upgrading a (*Romanian*) system from F8 to F9, why don't we change that
line in /etc/sysconfig/i18n during the upgrade itself ? Is that the correct
behaviour ?

- as for the keyboard configurator (system-config-keyboard, in both X and text
mode), it seems it dissapeared from the System menu, in F9. And I see no
replacement for it...


Regards,
Răzvan







Comment 24 Răzvan Sandu 2008-06-04 11:51:10 UTC
Regarding comment #23, probably the correct behaviour at point no. 2 is to leave
that line alone, but have the correct glyphs in "latarcyrheb-sun16"  ;-)

Regards,
Răzvan

Comment 25 Alexandru Szasz 2008-06-04 12:00:32 UTC
(In reply to comment #23)
> Sorry, my fault !
> 
> All systems I have at hand, running F9, were *upgraded* from F8, not fresh
> installs. So Terminus is now, in F9, the default font when setting system to
> Romanian ?

Yes, it was the quick solution.

> 
> 
> However:
> 
> - changing the default font is just a temporary solution, IMHO.
> "latarcyrheb-sun16" should also include the correct glyphs for the Romanian
> language;

I head that Fedora is planning to convert the X fonts to terminal fonts and drop
all the terminal fonts, so maybe it's worth investigating this first.

> 
> - when upgrading a (*Romanian*) system from F8 to F9, why don't we change that
> line in /etc/sysconfig/i18n during the upgrade itself ? Is that the correct
> behaviour ?

I'm afraid so, rpm upgrade keeps existing configuration.

> 
> - as for the keyboard configurator (system-config-keyboard, in both X and text
> mode), it seems it dissapeared from the System menu, in F9. And I see no
> replacement for it...

Search bugzilla or ask in the mailing list what plans are there for
system-config-keyboard and system-config-language in the future.

Here is a link: http://translate.fedoraproject.org/module/ that you can use to
find out where to report a bug to a component. Click on the module you want and
see a link to report a bug


Comment 26 Nicolas Mailhot 2008-06-04 12:11:49 UTC
(In reply to comment #25)
> (In reply to comment #23)

> > However:
> > 
> > - changing the default font is just a temporary solution, IMHO.
> > "latarcyrheb-sun16" should also include the correct glyphs for the Romanian
> > language;
> 
> I head that Fedora is planning to convert the X fonts to terminal fonts and drop
> all the terminal fonts, so maybe it's worth investigating this first.

As far as I know what's planned is conversion of X keyboard layouts to console
layouts. I doubt converting complex vector TTF/OTF fonts to dumb bitmap console
fonts is possible without major human involvment.


Comment 27 Caius Chance 2008-06-05 00:38:08 UTC
FYI, The font Alexandru mentioned is also within same console font package:

$ rpm -qf /lib/kbd/consolefonts/Lat2-Terminus16.psf.gz
kbd-1.12-31.fc9.i386

I agree Nicolas about converting complex vector TTF/OTF fonts to dumb bitmap
console fonts. Even if the TTF/OTF embedded bitmap glyphs, font style
consistency/readability might also be an issue.

Comment 28 Caius Chance 2008-06-05 00:57:11 UTC
For the best handling by console font maintainer, file a bug against 'kbd' and
resuming this discussion stream on console font might be appropriate:
https://bugzilla.redhat.com/show_bug.cgi?id=450061

Comment 29 Caius Chance 2008-06-12 06:53:07 UTC
Hi, I have modified all of the fonts same as what I have done on Sans-Regular
for testing:

https://fedorahosted.org/liberation-fonts/browser/sandbox/ttf_1_04c_bz440992_test

Please feel free to have a look. If everything is okay, I will close this bug
and release official ver 1.04.

Thank you very much.

Comment 30 Caius Chance 2008-06-12 06:55:17 UTC
"Created (U+0218..021B, U+2010..2012) and Fixed (U+0162/0163)."

Comment 31 Caius Chance 2008-06-12 07:14:44 UTC
Packaged editions:

https://fedorahosted.org/releases/l/i/liberation-fonts/

Comment 32 Caius Chance 2008-06-17 05:26:37 UTC
Hi Alexandru, I have packed the patched fonts (at comment #31) and some simple
tests are done. Please feel free to let me know if you got problems on that.
Otherwise, I will close this bug as resolved in a week.

Comment 33 Alexandru Szasz 2008-06-17 05:39:58 UTC
It looks great, Caius. Thank you for your work, I now have a new favourite font.
You can close this anytime.

Comment 34 Caius Chance 2008-06-17 06:20:48 UTC
FYI, this version has been pushed to rawhide (nightly development version of
fedora) for public testing, too. Please kindly reopen this bug when you see
anything regarding to these glyphs in the future.

Comment 35 Alexandru Szasz 2009-11-13 11:07:00 UTC
Somehow this change is not present in Fedora 12.

Comment 36 Nicu Buculei 2009-11-13 11:09:50 UTC
confirmed, liberation fonts 1.05 (Fedora 12) and the latest sources from fedorahosted have the glyphs empty (checked with fontforge), it looks like the change was somehow reverted

Comment 38 Caius Chance 2010-05-10 07:25:38 UTC
Fixed:

http://koji.fedoraproject.org/koji/buildinfo?buildID=172693


Note You need to log in before you can comment on or make changes to this bug.