Bug 442289 - UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3
Summary: UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3
Alias: None
Product: Fedora
Classification: Fedora
Component: yum
Version: rawhide
Hardware: All
OS: Linux
Target Milestone: ---
Assignee: Seth Vidal
QA Contact: Fedora Extras Quality Assurance
Depends On:
TreeView+ depends on / blocked
Reported: 2008-04-13 23:08 UTC by John Reiser
Modified: 2008-04-15 13:24 UTC (History)
5 users (show)

Clone Of:
Last Closed: 2008-04-15 13:24:38 UTC

Attachments (Terms of Use)

Description John Reiser 2008-04-13 23:08:56 UTC
Description of problem: pungi compose fails at step 'Making repodata' with
message: UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position
1150: ordinal not in range(128)

Version-Release number of selected component (if applicable):

How reproducible:

Steps to Reproduce:
1.pungi -c /usr/share/pungi/rawhide-fedora.ks --destdir=/data/Fedora9 --name
Fedora --ver 9 --discs 6
Actual results:
Pungi.Gather:INFO: Finished downloading packages.
Pungi.Pungi:INFO: Making repodata
Previous repo file missing: 
37/2157 - Packages/hunspell-bn-20050726-2.fc9.noarch.rpmTraceback (most recent
call last):
  File "/usr/bin/pungi", line 189, in <module>
  File "/usr/bin/pungi", line 94, in main
  File "/usr/lib/python2.5/site-packages/pypungi/pungi.py", line 137, in
    self._makeMetadata(self.topdir, self.config.get('default', 'cachedir'),
compsfile, repoview=True, repoviewtitle=repoviewtitle)
  File "/usr/lib/python2.5/site-packages/pypungi/pungi.py", line 96, in
  File "/usr/lib/python2.5/site-packages/createrepo/__init__.py", line 308, in
  File "/usr/lib/python2.5/site-packages/createrepo/__init__.py", line 414, in
  File "/usr/lib/python2.5/site-packages/createrepo/yumbased.py", line 401, in
    msg += self._dump_changelog()
UnicodeDecodeError: 'ascii' codec can't decode byte 0xc3 in position 1150:
ordinal not in range(128)

Expected results:
sucessful compose

Additional info:  What file has the bad character?

Comment 1 Jesse Keating 2008-04-14 02:05:43 UTC
This is actually a bug in yum.  I don't think there is a bug filed on this yet,
so I'll toss it in their queue.

Comment 2 Sergey Kurtsev 2008-04-15 12:03:16 UTC
This is not as low priority as it seems. 

Case 1.
After booting from Rawhide Live CD (build 04/04/08):
1. Select Russian language at login screen
2. Try running liveinst from command line.
It failes due to the same reason.

Case 2.
Latest updates downloaded. (15 apr 08) Trying to install Adobe Flash player:
1. Set "Russian language" in system settings.
3. Go to
3. Select version to download: YUM for Linux
4. After installing repo rpm: "yum search adobe" fails for the same reason.
Details here:

[root@toshiba rc.d]# yum search adobe
Loaded plugins: fedorakmod, refresh-packagekit
livna                                                    | 2.1 kB     00:00    
adobe-linux-i386                                         |  951 B     00:00    
rawhide                                                  | 2.4 kB     00:00    
tigro                                                    | 1.1 kB     00:00    
primary.xml.gz                                           | 4.2 kB     00:00    
tigro     : ################################################## 11/11
================================ Matched: adobe ================================
Traceback (most recent call last):
  File "/usr/bin/yum", line 29, in <module>
    yummain.user_main(sys.argv[1:], exit_code=True)
  File "/usr/share/yum-cli/yummain.py", line 236, in user_main
    errcode = main(args)
  File "/usr/share/yum-cli/yummain.py", line 111, in main
    result, resultmsgs = base.doCommands()
  File "/usr/share/yum-cli/cli.py", line 309, in doCommands
    return self.yum_cli_commands[self.basecmd].doCommand(self, self.basecmd,
  File "/usr/share/yum-cli/yumcommands.py", line 501, in doCommand
    return base.search(extcmds)
  File "/usr/share/yum-cli/cli.py", line 697, in search
    self.matchcallback(po, matched_value, args)
  File "/usr/share/yum-cli/output.py", line 457, in matchcallback
    msg = self.fmtKeyValFill(msg, po.summary)
  File "/usr/share/yum-cli/output.py", line 256, in fmtKeyValFill
    val = str(val)
UnicodeEncodeError: 'ascii' codec can't encode characters in position 22-30:
ordinal not in range(128)

The bug itself probably comes from Python issue: http://bugs.python.org/issue2517

I'd ask you to change issue severity to high since inconsistent unicode support
by yum makes it impossible for user with non-english interface to do some
updates and run install from Live CD.

Comment 3 Seth Vidal 2008-04-15 12:07:42 UTC
are you're still getting this after installing:

Comment 4 Sergey Kurtsev 2008-04-15 12:48:51 UTC
As I figured out - in "Case 2" it previously failed  with (tm) and (r) unicode
characters in package descriptions. 
I don't know in which way it may relate to Russian language interface but it
work's fine with "yum search" now. Thanks. 

No opportunity to check with liveinst though.

Note You need to log in before you can comment on or make changes to this bug.