Bug 1111871 - [rfe] dnf should use sqlite/.xz repodata
Summary: [rfe] dnf should use sqlite/.xz repodata
Keywords:
Status: CLOSED NOTABUG
Alias: None
Product: Fedora
Classification: Fedora
Component: dnf
Version: rawhide
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
Assignee: Packaging Maintenance Team
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2014-06-21 19:54 UTC by Kevin Fenzi
Modified: 2014-06-23 14:28 UTC (History)
6 users (show)

Fixed In Version:
Clone Of:
Environment:
Last Closed: 2014-06-23 08:43:25 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)

Description Kevin Fenzi 2014-06-21 19:54:07 UTC
Rawhide is running with xz repodata enabled, but dnf is still pulling some of the old .gz repodata. 

In particular dnf uses: 

primary.xml.gz
filelists.xml.gz

while there is primary.sqlite.xz and filelists.sqlite.xz available. 
The primary sqlite is actually larger than the primary xml, but 
the filelists sqlite is a good deal smaller than the xml. 

It might make sense to adjust on the createrepo side to xz compress the xml files, but I don't know what that might break compatibility wise.

Comment 1 Ales Kozumplik 2014-06-23 08:43:25 UTC
I'm looking at 

https://ftp.fau.de/fedora/linux/releases/20/Everything/x86_64/os/repodata/

and 

.filelist.xml.gz is 26M while filelist.sqlite.bz2 is is 27MB.

In rawhide where .xz is used there is some saved bandwidth but it is only 12%:

https://ftp.fau.de/fedora/linux/development/rawhide/x86_64/os/repodata/

That doesn't buy us enough to justify more complex handling and additional processing time from .sqlite to the libsolv format. We're moving away from sqlite, perhaps towards distributing the libsolv MD files directly.

Comment 2 Kevin Fenzi 2014-06-23 14:28:23 UTC
ok. 

Perhaps however it's worth getting createrepo to make .xz copies of the xml files?


Note You need to log in before you can comment on or make changes to this bug.