Bug 446154

Summary: improve collation order of languages
Product: [Fedora] Fedora Reporter: Jens Petersen <petersen>
Component: gdmAssignee: jmccann
Status: CLOSED WONTFIX QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: low Docs Contact:
Priority: low    
Version: 9CC: cschalle, i18n-bugs, rstrode
Target Milestone: ---   
Target Release: ---   
Hardware: All   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2009-06-23 05:44:36 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Jens Petersen 2008-05-13 03:43:38 UTC
Description of problem:
When one starts Fedora and goes to the gdm lang menu, the order of languages
listed is a bit unintuitive: seems to start with Thai, Eritrean/Ethiopean,
and Hangul (Korean), before coming to languages starting with 'A' say
at least for en_US.UTF-8.  Can the order be improved and be made more
"natural"?

How reproducible:
every time

Steps to Reproduce:
1. boot fedora 9
2. look in gdm lang menu
  
Actual results:
language order seems somewhat arbitrary

Expected results:
better collation

Comment 1 Bug Zapper 2008-05-14 11:04:33 UTC
Changing version to '9' as part of upcoming Fedora 9 GA.
More information and reason for this action is here:
http://fedoraproject.org/wiki/BugZappers/HouseKeeping

Comment 2 Ulrich Drepper 2008-06-12 17:55:18 UTC
What does this have to do with glibc?

Comment 3 Ray Strode [halfline] 2008-06-12 18:21:07 UTC
nothing afaict

Comment 4 Jens Petersen 2008-06-13 00:40:04 UTC
Isn't the collation order determined by glibc?

Comment 5 Ulrich Drepper 2008-06-13 01:08:43 UTC
Yes, and?  If you sort a list with words from many different languages, you
cannot expect any fixed order.  Only characters of the same script can really be
compared, the rest is up to implementation details.

If the original request was to change the collation definition to fit somebody's
fancy then all I have to say: get lost!

Just sort the list by hand, only then can you get the order you want and never
be surprised.

Comment 6 Jens Petersen 2008-06-13 01:49:39 UTC
(In reply to comment #5)
> If you sort a list with words from many different languages, you
> cannot expect any fixed order.

Ok: you mean different implementations may give different orders?  Hmm, I see.
Why doesn't Unicode define such an ordering for different scripts?
It seems defining such an order would be useful.

> If the original request was to change the collation definition to fit somebody's
> fancy then all I have to say: get lost!
> 
> Just sort the list by hand, only then can you get the order you want and never
> be surprised.

I was just wondering why a few scripts sort before ascii and most after.
Is it the idea not to prefer ascii in the ordering?

Comment 7 Jens Petersen 2008-06-13 01:54:57 UTC
For gdm ((well all apps really;)) I would suggest listing language names using
Latin characters first and then other scripts.  I don't know how to order
non-ascii scripts
relative to each other.  Perhaps either by locale name or by codepoints would
make sense.

Comment 8 Ray Strode [halfline] 2008-06-13 02:18:04 UTC
Looking at the code...

We have a language chooser widget which derives from a chooser widget.  The
chooser widget sorts by it's id column.  For the language chooser widget, we use
locale as the id.

This means we're sorting by locale instead of by the language name.  We should
sort by either translated language names translated in their own language (like
we show to the user in the list) or by the language names translated in the
system locale (like we show in the tooltips)

Comment 9 Ray Strode [halfline] 2008-06-13 02:38:30 UTC
I take that back.  We wrongly set the sort column to the locale column, but then
override it with a custom sort function that sorts by the name column anyway.

Comment 10 Jens Petersen 2008-06-16 01:18:31 UTC
(In reply to comment #5)
> Just sort the list by hand, only then can you get the order you want and never
> be surprised.

Of course this is nothing gdm specific. I remembered I always see the same thing
in Thunderbird when I sort my spam folder by subject, the Thai spam always
appears first.

I would just like to understand why Thai sorts before ASCII?

Comment 11 Tony Fu 2008-09-10 03:15:05 UTC
requested by Jens Petersen (#27995)

Comment 12 Ulrich Drepper 2008-09-11 04:16:28 UTC
(In reply to comment #6)
> Why doesn't Unicode define such an ordering for different scripts?
> It seems defining such an order would be useful.

Think about it.  How should any two people agree on this?  Everybody will want their language to be first because it's the most important.  There will never be a generally acceptable solution based on collation.

If you want something else you have to implement it differently.

Comment 13 Bug Zapper 2009-06-10 00:45:12 UTC
This message is a reminder that Fedora 9 is nearing its end of life.
Approximately 30 (thirty) days from now Fedora will stop maintaining
and issuing updates for Fedora 9.  It is Fedora's policy to close all
bug reports from releases that are no longer maintained.  At that time
this bug will be closed as WONTFIX if it remains open with a Fedora 
'version' of '9'.

Package Maintainer: If you wish for this bug to remain open because you
plan to fix it in a currently maintained version, simply change the 'version' 
to a later Fedora version prior to Fedora 9's end of life.

Bug Reporter: Thank you for reporting this issue and we are sorry that 
we may not be able to fix it before Fedora 9 is end of life.  If you 
would still like to see this bug fixed and are able to reproduce it 
against a later version of Fedora please change the 'version' of this 
bug to the applicable version.  If you are unable to change the version, 
please add a comment here and someone will do it for you.

Although we aim to fix as many bugs as possible during every release's 
lifetime, sometimes those efforts are overtaken by events.  Often a 
more recent Fedora release includes newer upstream software that fixes 
bugs or makes them obsolete.

The process we are following is described here: 
http://fedoraproject.org/wiki/BugZappers/HouseKeeping

Comment 14 Jens Petersen 2009-06-23 05:44:36 UTC
I am happy with the current gdm order :)