Bug 670666

Summary: Local sync doesn't sync delta_rpms
Product: [Retired] Pulp Reporter: John Matthews <jmatthew>
Component: z_otherAssignee: Pradeep Kilambi <pkilambi>
Status: CLOSED CURRENTRELEASE QA Contact: Preethi Thomas <pthomas>
Severity: medium Docs Contact:
Priority: medium    
Version: unspecifiedCC: pkilambi, skarmark, tsanders
Target Milestone: ---Keywords: Triaged
Target Release: Sprint 20   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2011-08-16 12:08:00 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 647488    

Description John Matthews 2011-01-18 22:46:48 UTC
Local syncs aren't written to synchronize delta_rpms

Comment 1 Pradeep Kilambi 2011-02-02 17:35:32 UTC
commit a0f856a2d7c4876723b4b629ef681d280da3b62e
Author: Pradeep Kilambi <pkilambi>
Date:   Wed Feb 2 12:35:33 2011 -0500

    670666 - DeltaRPM sync support for local syncs

$ sudo pulp-admin -u admin -p admin repo create --id=test_local --feed=local:file:///var/lib/pulp/repos/pub/fedora/linux/updates/13/x86_64/

Successfully created repository [ test_local ]


$ sudo pulp-admin -u admin -p admin repo sync -F --id=test_local
Sync for repository test_local started
Step: Downloading Items
[=                        ] 5%
Rpms: 489/8742
Drpms: 0/6137
Total: 489/14879 items

Sync for repository test_local started
Step: Downloading Items
[=====================    ] 87%
Rpms: 8742/8742
Drpms: 2170/6137
Total: 10912/14879 items


Sync for repository test_local started
Step: Running Modifyrepo for prestodelta metadata
Waiting -

2011-02-02 12:24:25,475 [INFO][Thread-5] modify_repo() @ upload.py:111 - modifyrepo with /var/lib/pulp/repos/test_local/prestodelta.xml on /var/lib/pulp/repos/test_local/repodata finished


$ ls -l /var/lib/pulp/repos/test_local/drpms/
Display all 3130 possibilities? (y or n)
389-adminutil-1.1.9-1.fc13_1.1.13-1.fc13.i686.drpm                                                  lohit-tamil-fonts-2.4.5-3.fc13_2.4.5-6.fc13.noarch.drpm
389-adminutil-1.1.9-1.fc13_1.1.13-1.fc13.x86_64.drpm                                                lshell-0.9.13-1.fc13_0.9.14-1.fc13.noarch.drpm
389-adminutil-devel-1.1.9-1.fc13_1.1.13-1.fc13.x86_64.drpm                                          lua-posix-5.1.4-3.fc12_5.1.7-1.fc13.x86_64.drpm
389-ds-base-1.2.6-0.1.a1.fc13_1.2.7.5-1.fc13.i686.drpm                                              luci-0.22.4-1.0.b9faf868074git.fc13_0.22.4-2.0.b9faf868074git.fc13.x86_64.drpm
389-ds-base-1.2.6-0.1.a1.fc13_1.2.7.5-1.fc13.x86_64.drpm                                            luci-0.22.4-2.0.b9faf868074git.fc13_0.22.6-1.fc13.x86_64.drpm
389-ds-base-1.2.6.1-2.fc13_1.2.7.1-1.fc13.i686.drpm                                                 LuxRender-core-0.6.1-2.fc13_0.7-1.fc13.x86_64.drpm
389-ds-base-devel-1.2.6-0.1.a1.fc13_1.2.7.5-1.fc13.i686.drpm                                        LuxRender-devel-0.6.1-2.fc13_0.7-1.fc13.i686.drpm


$ ls -l /var/lib/pulp/repos/test_local/repodata/
total 21964
-rw-r--r--. 1 apache apache  849665 Feb  2 12:24 15108d6884b8347ac208fd7cc46fee175f2f3fe399c100556a4d96f136d087bb-prestodelta.xml.gz
-rw-r--r--. 1 apache apache 1833718 Feb  2 12:24 5b7e9dc0debb1accf2591b318f061cb2dd78a62a07e441746c224aa56c92adb8-comps-f13.xml
-rw-r--r--. 1 apache apache  418402 Feb  2 12:24 5b7e9dc0debb1accf2591b318f061cb2dd78a62a07e441746c224aa56c92adb8-comps-f13.xml.gz
-rw-r--r--. 1 apache apache 3492197 Feb  2 12:24 6babd82a5b2ae554058085e7318a2f17a9593b86960a717c816e1b7768969fb9-updateinfo.xml
-rw-r--r--. 1 apache apache   19293 Feb  2 12:24 6babd82a5b2ae554058085e7318a2f17a9593b86960a717c816e1b7768969fb9-updateinfo.xml.gz
-rw-r--r--. 1 apache apache 8396059 Feb  2 12:24 filelists.xml.gz
-rw-r--r--. 1 apache apache 4028423 Feb  2 12:24 other.xml.gz
-rw-r--r--. 1 apache apache 3397773 Feb  2 12:24 primary.xml.gz
-rw-r--r--. 1 apache apache    2874 Feb  2 12:24 repomd.xml


repomd.xml:

  <data type="prestodelta">
    <location href="repodata/15108d6884b8347ac208fd7cc46fee175f2f3fe399c100556a4d96f136d087bb-prestodelta.xml.gz"/>
    <checksum type="sha256">15108d6884b8347ac208fd7cc46fee175f2f3fe399c100556a4d96f136d087bb</checksum>
    <timestamp>1296667465.0</timestamp>
    <open-checksum type="sha256">ede7f6d87de5e7cc560b9ba48bb3f52d2ba524e69fd32f300d0a7ae6919791b1</open-checksum>
  </data>

$ sudo pulp-admin consumer bind --id=testcon --repoid=test_local
Successfully subscribed consumer [testcon] to repo [test_local]


$ ls /var/lib/pulp/repos/test_local/drpms/lshell-0.9.13-1.fc13_0.9.14-1.fc13.noarch.drpm 
/var/lib/pulp/repos/test_local/drpms/lshell-0.9.13-1.fc13_0.9.14-1.fc13.noarch.drpm

* See if the client is reconstructing presto delta while install

$ sudo yum install lshell --disablerepo=* --enablerepo=test_local
Loaded plugins: fastestmirror, presto, refresh-packagekit
Loading mirror speeds from cached hostfile
test_local                                                                                                                                                                                                                                              | 2.8 kB     00:00     
test_local/primary                                                                                                                                                                                                                                      | 3.2 MB     00:00     
test_local                                                                                                                                                                                                                                                           8742/8742
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package lshell.noarch 0:0.9.14-1.fc13 set to be installed
--> Finished Dependency Resolution

Dependencies Resolved

===============================================================================================================================================================================================================================================================================
 Package                                                        Arch                                                           Version                                                                Repository                                                          Size
===============================================================================================================================================================================================================================================================================
Installing:
 lshell                                                         noarch                                                         0.9.14-1.fc13                                                          test_local                                                          53 k

Transaction Summary
===============================================================================================================================================================================================================================================================================
Install       1 Package(s)

Total download size: 53 k
Installed size: 153 k
Is this ok [y/N]: y
Downloading Packages:
Setting up and reading Presto delta metadata
test_local/prestodelta                                                                                                                                                                                                                                  | 830 kB     00:00     
Processing delta metadata
Package(s) data still to download: 53 k
lshell-0.9.14-1.fc13.noarch.rpm                                                                                                                                                                                                                         |  53 kB     00:00     
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing     : lshell-0.9.14-1.fc13.noarch                                                                                                                                                                                                                             1/1 

Installed:
  lshell.noarch 0:0.9.14-1.fc13

Comment 2 Jay Dobies 2011-02-02 20:07:11 UTC
Fixed in 0.134.

Comment 3 Preethi Thomas 2011-02-08 16:17:44 UTC
verified

[root@preethi ~]# pulp-admin -u admin -p admin repo sync --id=test_local -FSync for repository test_local started
Step: Downloading Items or Verifying
[=                        ] 6%
Rpms: 520/6013
Drpms: 0/5240
Total: 520/11253 items



2011-02-08 10:47:48,287 [INFO][Thread-124] modify_repo() @ upload.py:111 - modifyrepo with /var/lib/pulp//repos/test_local/prestodelta.xml on /var/lib/pulp//repos/test_local/repodata finished



[root@preethi ~]# ls -l /var/lib/pulp/repos/test_local/drpms/ |more
total 1829096
-rw-r--r--. 1 apache apache   109444 Feb  8 10:42 389-admin-1.1.11-1.fc14_1.1.14-1.fc14.i686.drpm
-rw-r--r--. 1 apache apache   136128 Feb  8 10:42 389-admin-1.1.11-1.fc14_1.1.14-1.fc14.x86_64.drpm
-rw-r--r--. 1 apache apache    46160 Feb  8 10:41 389-adminutil-1.1.10-2.fc14_1.1.13-1.fc14.i686.drpm
-rw-r--r--. 1 apache apache    49316 Feb  8 10:42 389-adminutil-1.1.10-2.fc14_1.1.13-1.fc14.x86_64.drpm
-rw-r--r--. 1 apache apache     9408 Feb  8 10:42 389-adminutil-devel-1.1.10-2.fc14_1.1.13-1.fc14.i686.drpm
-rw-r--r--. 1 apache apache     9404 Feb  8 10:41 389-adminutil-devel-1.1.10-2.fc14_1.1.13-1.fc14.x86_64.drpm
-rw-r--r--. 1 apache apache   384828 Feb  8 10:41 389-ds-base-1.2.7.4-1.fc14_1.2.7.5-1.fc14.i686.drpm
-rw-r--r--. 1 apache apache   403360 Feb  8 10:41 389-ds-base-1.2.7.4-1.fc14_1.2.7.5-1.fc14.x86_64.drpm
-rw-r--r--. 1 apache apache    23180 Feb  8 10:41 389-ds-base-devel-1.2.7.4-1.fc14_1.2.7.5-1.fc14.i686.drpm


[root@preethi ~]# ls -l /var/lib/pulp/repos/test_local/repodata/
total 19024
-rw-r--r--. 1 apache apache 1857043 Feb  8 10:47 07fb253e7210fc0472f03f867462e2d70479c1443de36fc58067aee74f94f19e-comps-f14.xml
-rw-r--r--. 1 apache apache  420354 Feb  8 10:47 07fb253e7210fc0472f03f867462e2d70479c1443de36fc58067aee74f94f19e-comps-f14.xml.gz
-rw-r--r--. 1 apache apache  755794 Feb  8 10:47 f9da07baef1581be5b3eaf96614d7b0ab10239ed17b6473da2dc0228260bdb32-prestodelta.xml.gz
-rw-r--r--. 1 apache apache 4606756 Feb  8 10:48 fbce5fd9ad8f01463f2b158d4a9ebc9a5854cf68e3e4289e8c2e468da2ae17cd-updateinfo.xml
-rw-r--r--. 1 apache apache  434266 Feb  8 10:47 fbce5fd9ad8f01463f2b158d4a9ebc9a5854cf68e3e4289e8c2e468da2ae17cd-updateinfo.xml.gz
-rw-r--r--. 1 apache apache 6331903 Feb  8 10:47 filelists.xml.gz
-rw-r--r--. 1 apache apache 2693191 Feb  8 10:47 other.xml.gz
-rw-r--r--. 1 apache apache 2358493 Feb  8 10:47 primary.xml.gz
-rw-r--r--. 1 apache apache    2874 Feb  8 10:47 repomd.xml


[root@10 ~]# pulp-client -u admin -p admin consumer bind --repoid=test_local
Successfully subscribed consumer [client1] to repo [test_local]

[root@10 ~]# 
[root@10 ~]# 
[root@10 ~]# yum install lshell --disablerepo=* --enablerepo=test_local
test_local                                               | 2.8 kB     00:00     
test_local/primary                                       | 2.2 MB     00:00     
test_local                                                            6013/6013
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package lshell.noarch 0:0.9.14-1.fc14 set to be installed
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package        Arch           Version                 Repository          Size
================================================================================
Installing:
 lshell         noarch         0.9.14-1.fc14           test_local          53 k

Transaction Summary
================================================================================
Install       1 Package(s)

Total download size: 53 k
Installed size: 153 k
Is this ok [y/N]: y
Downloading Packages:
lshell-0.9.14-1.fc14.noarch.rpm                          |  53 kB     00:00     
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
  Installing     : lshell-0.9.14-1.fc14.noarch                              1/1 

Installed:
  lshell.noarch 0:0.9.14-1.fc14                                                 

Complete!

Comment 4 Preethi Thomas 2011-08-16 12:08:00 UTC
Closing with Community Release 15

pulp-0.0.223-4.

Comment 5 Preethi Thomas 2011-08-16 12:21:20 UTC
Closing with Community Release 15

pulp-0.0.223-4.