Bug 1315474

Summary: major rpm regression
Product: [Fedora] Fedora Reporter: Dennis Gilmore <dennis>
Component: rpmAssignee: Packaging Maintenance Team <packaging-team-maint>
Status: CLOSED WORKSFORME QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 23CC: dan, dennis, ffesti, jorton, jzeleny, novyjindrich, packaging-team-maint, pbrobinson, pknirsch
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-10-03 20:01:46 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Dennis Gilmore 2016-03-07 20:42:42 UTC
Description of problem:
koji calls rpm from the host to list all the contents of a buildroot in order to record the information in the database
https://pagure.io/fork/ausil/koji/blob/fedora-infra/f/builder/kojid#_520
is the koji code.

we updated the builders friday to rpm-4.13.0-0.rc1.12.fc23
at which point koji stopped recording the rpms in the buildroot. 

[root@buildhw-10 ~]# ls /var/lib/mock/f25-build-5145204-587453/root/var/lib/rpm
Basenames     __db.001  __db.003  Enhancename      Group       Name          Packages     Recommendname  Sha1header  Suggestname     Transfiletriggername
Conflictname  __db.002  Dirnames  Filetriggername  Installtid  Obsoletename  Providename  Requirename    Sigmd5      Supplementname  Triggername
[root@buildhw-10 ~]# rpm -qa --dbpath /var/lib/mock/f25-build-5145204-587453/root/var/lib/rpm
[root@buildhw-10 ~]# 

trying to query the db resulted in empty data being returned. after we downgraded rpm to rpm-4.13.0-0.rc1.11.fc23 we were able to get the buildroot data again. 

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 1 Ľuboš Kardoš 2016-03-08 10:18:21 UTC
I tested this and I am not able to reproduce this. I tested it on a freshly installed f23:

# dnf install mock
# useradd -G mock tester
# su tester -c "/usr/bin/mock -r fedora-rawhide-x86_64 --init"
# rpm -q rpm
rpm-4.13.0-0.rc1.3.fc23.x86_64
# rpm -qa --dbpath /var/lib/mock/fedora-rawhide-x86_64/root/var/lib/rpm
kernel-headers-4.5.0-0.rc6.git3.1.fc25.x86_64
tzdata-2016a-1.fc24.noarch
fedora-repos-rawhide-25-0.1.noarch
setup-2.10.2-1.fc25.noarch
basesystem-11-2.fc24.noarch
...

# dnf update rpm
# rpm -q rpm
rpm-4.13.0-0.rc1.12.fc23.x86_64
# rpm -qa --dbpath /var/lib/mock/fedora-rawhide-x86_64/root/var/lib/rpm
kernel-headers-4.5.0-0.rc6.git3.1.fc25.x86_64
tzdata-2016a-1.fc24.noarch
fedora-repos-rawhide-25-0.1.noarch
setup-2.10.2-1.fc25.noarch
basesystem-11-2.fc24.noarch
...


Can you provide the content of the directory /var/lib/mock/f25-build-5145204-587453/root/var/lib/rpm which wasn't readable by rpm-4.13.0-0.rc1.12.fc23 ?

Comment 2 Dan Horák 2016-03-18 10:49:57 UTC
Really seems to be more complicated, I can't reproduce the issue manually (using the same mock config as the koji build), while the koji initiated build from the same builder has empty buildroot info in the db. It should be taken to the Fedora staging koji instance for reproduction. The chroot is removed after a successful build under koji so it's hard to capture the /var/lib/rpm content.

Comment 3 Dan Horák 2016-03-18 11:41:53 UTC
Downgrading only rpm to rpm-4.13.0-0.rc1.11.fc23 from an up-to-date system doesn't help.

[root@fedora1 ~]# rpm -q rpm dnf koji mock
rpm-4.13.0-0.rc1.11.fc23.s390x
dnf-1.1.6-2.fc23.noarch
koji-1.10.1-4.fc23.noarch
mock-1.2.15-1.fc23.noarch


koji is from @fedora-infra-builder repo

Comment 4 Ľuboš Kardoš 2016-03-18 11:50:10 UTC
(In reply to Dan Horák from comment #2)
> Really seems to be more complicated, I can't reproduce the issue manually
> (using the same mock config as the koji build), while the koji initiated
> build from the same builder has empty buildroot info in the db. It should be
> taken to the Fedora staging koji instance for reproduction. The chroot is
> removed after a successful build under koji so it's hard to capture the
> /var/lib/rpm content.

I wanted to see the content of /var/lib/rpm to check if the database really contained something because it is very strange that rpm displayed no output, no package names nor error if the database really contained something.

Comment 5 Ľuboš Kardoš 2016-03-18 11:51:18 UTC
(In reply to Dan Horák from comment #3)
> Downgrading only rpm to rpm-4.13.0-0.rc1.11.fc23 from an up-to-date system
> doesn't help.
> 
> [root@fedora1 ~]# rpm -q rpm dnf koji mock
> rpm-4.13.0-0.rc1.11.fc23.s390x
> dnf-1.1.6-2.fc23.noarch
> koji-1.10.1-4.fc23.noarch
> mock-1.2.15-1.fc23.noarch
> 
> 
> koji is from @fedora-infra-builder repo

Then which version of rpm is the last working?

Comment 6 Dan Horák 2016-03-18 17:38:28 UTC
If my experiments were correct, then this problem is result of updating multiple packages including koji & koji-builder and not restarting the koji builder daemon.

I don't see a problem with lost buildroot info with
rpm-4.13.0-0.rc1.12.fc23.s390x (regular f23 updates)
koji-1.10.1-4.fc23.noarch (f23 fedora-infra-builder repo)

Comment 7 Ľuboš Kardoš 2016-04-06 11:10:10 UTC
(In reply to Dan Horák from comment #6)
> If my experiments were correct, then this problem is result of updating
> multiple packages including koji & koji-builder and not restarting the koji
> builder daemon.
> 
> I don't see a problem with lost buildroot info with
> rpm-4.13.0-0.rc1.12.fc23.s390x (regular f23 updates)
> koji-1.10.1-4.fc23.noarch (f23 fedora-infra-builder repo)

So what are the steps to reproduce this problem?

Comment 8 Dennis Gilmore 2016-10-03 20:00:50 UTC
this issue seems to have gone away.