Bug 455387 - mock does not handle BUILDROOT dir from new rpm
Summary: mock does not handle BUILDROOT dir from new rpm
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Fedora Hosted Projects
Classification: Retired
Component: mock
Version: unspecified
Hardware: All
OS: Linux
low
low
Target Milestone: ---
Assignee: Clark Williams
QA Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2008-07-15 10:34 UTC by Till Maas
Modified: 2013-01-10 04:44 UTC (History)
5 users (show)

Fixed In Version: mock-0.9.11-1.fc10.noarch
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2008-09-10 20:57:31 UTC
Embargoed:


Attachments (Terms of Use)

Description Till Maas 2008-07-15 10:34:43 UTC
Description of problem:
The new rpm in Fedora Rawhide uses a buildroot below %{_topdir}/BUILDROOT, e.g. 
/builddir/rpmbuild/BUILDROOT/fatsort-0.9.8.3-1.fc10.i386

The problem is, that the BUILDROOT directory is not created by mock and
therefore a specfile containing this, breaks:

%install
rm -rf $RPM_BUILD_ROOT
mkdir $RPM_BUILD_ROOT

Also for some reason, rpmbuild seems to use /builddir/rpmbuild as %{_topdir},
but afaics it should be /builddir/build, at least on koji, because the (S)RPM,
SPECS and SOURCES directories are also below /builddir/build.

Version-Release number of selected component (if applicable):
The one that currently runs on Fedoras Koji, I cannot find any version
information about mock in the logfiles.

How reproducible:
always

Steps to Reproduce:
1. create a working spec with the following contents:
%install
rm -rf $RPM_BUILD_ROOT
mkdir $RPM_BUILD_ROOT
2. try to build it on Fedoras Koji with dist-f10
  
Actual results:
+ mkdir /builddir/rpmbuild/BUILDROOT/fatsort-0.9.8.3-1.fc10.i386
mkdir: cannot create directory
`/builddir/rpmbuild/BUILDROOT/fatsort-0.9.8.3-1.fc10.i386': No such file or
directory

Expected results:
The mkdir $RPM_BUILD_ROOT should create the directory.

Additional info:

I use intentionally mkdir $RPM_BUILD_ROOT without "-p", to make sure that the
$RPM_BUILD_ROOT directory does not exist with some bad content. Otherwise there
would be a race condition on multi user systems.

Comment 1 Matt Domsch 2008-08-28 16:49:03 UTC
29 packages currently failing due to this, so please fix it in mock to the package owners of these don't get highly confused.

AcetoneISO (mock_bug_455387)
aircrack-ng (mock_bug_455387)
ctrlproxy (mock_bug_455387)
fcgi (mock_bug_455387)
fedorawaves-kdm-theme (mock_bug_455387)
filesystem (mock_bug_455387)
ftplib (mock_bug_455387)
kcoloredit (mock_bug_455387)
kdeaddons (mock_bug_455387)
kdegames3 (mock_bug_455387)
kgrab (mock_bug_455387)
kiconedit (mock_bug_455387)
kmid (mock_bug_455387)
ksig (mock_bug_455387)
libHX (mock_bug_455387)
ocaml-facile (mock_bug_455387)
offlineimap (mock_bug_455387)
pam_mount (mock_bug_455387)
presto (mock_bug_455387)
python-docs (mock_bug_455387)
python-flup (mock_bug_455387)
qimageblitz (mock_bug_455387)
radeontool (mock_bug_455387)
wyrd (mock_bug_455387)
x2vnc (mock_bug_455387)
xbiso (mock_bug_455387)
xchat-ruby (mock_bug_455387)
xmms-cdread (mock_bug_455387)
z88dk (mock_bug_455387)

Comment 2 Clark Williams 2008-08-28 20:41:45 UTC
Till,

So you think a viable fix is for mock just to create BUILDROOT as part of the chroot setup?

Comment 3 Till Maas 2008-08-28 21:04:39 UTC
(In reply to comment #2)
> Till,
> 
> So you think a viable fix is for mock just to create BUILDROOT as part of the
> chroot setup?

Yes.

Comment 4 Jesse Keating 2008-08-28 21:50:26 UTC
Wait a sec, I'm a little unclear how this is a mock problem, and not an rpm or spec problem.  You're trying to create a directory without ensuring the leading paths are there.  Don't.

Arguably we should change mock so that the %_topdir it uses for it's user is rpmbuild rather than build, but it still seems like there is an rpm bug here, not a mock bug in the mismatch.

Comment 5 Jindrich Novy 2008-08-29 06:45:49 UTC
rpm uses %(echo $HOME)/rpmbuild and %_topdir by default. Does mock define _topdir explicitely?

Note that the new rpm doesn't honour Buildroot: tags in spec any more and defines it to %{_buildrootdir}/%{name}-%{version}-%{release}.%{_arch}, where %{_buildrootdir} is %{_topdir}/BUILDROOT. The initial mock setup should create %{_topdir}/BUILDROOT regardless the actual %{_topdir} contents since it is one of the base directories like SPECS, SRPMS, etc now.

Comment 6 Clark Williams 2008-08-29 14:48:34 UTC
does BUILDROOT replace BUILD? Or is it an additional directory?

Currenly mock does this:

 for subdir in [self.makeChrootPath(self.builddir, s) for s in ('RPMS', 'SRPMS', 'SOURCES', 'SPECS', 'BUILD', 'originals')]:
                mock.util.mkdirIfAbsent(subdir)

Easy enough to add BUILDROOT to that array, but wondering if we need to delete BUILD?

Comment 7 Jindrich Novy 2008-08-29 15:12:29 UTC
(In reply to comment #6)
> does BUILDROOT replace BUILD? Or is it an additional directory?

It's an additional directory. Actually, packages are built in BUILD subdir and then installed to buildroot which is in the BUILDROOT directory now.

> Currenly mock does this:
> 
>  for subdir in [self.makeChrootPath(self.builddir, s) for s in ('RPMS',
> 'SRPMS', 'SOURCES', 'SPECS', 'BUILD', 'originals')]:
>                 mock.util.mkdirIfAbsent(subdir)
> 
> Easy enough to add BUILDROOT to that array, but wondering if we need to delete
> BUILD?

Yup, adding BUILDROOT should solve the bug, but please keep BUILD in the array as well.

Comment 8 Matt Domsch 2008-08-29 15:42:36 UTC
for how many years have we been teaching people to create BUILD RPMS SRPMS SPECS SOURCES before running rpmbuild?  Now we're going to add another directory to this list?  Why not let rpmbuild create BUILD/BUILDROOT/ and use that, if it wants to?  BUILD/ is unseen by end users generally - it's populated and erased entirely by rpmbuild.  So let rpmbuild create BUILD/BUILDROOT/.

Comment 9 Jindrich Novy 2008-08-29 17:25:14 UTC
(In reply to comment #8)
> for how many years have we been teaching people to create BUILD RPMS SRPMS
> SPECS SOURCES before running rpmbuild?

It is irrelevant. RPM is under active development unlike during many years up to now. Some changes are therefore expected, especially in rawhide. We need to properly document it though when rpm-4.6 is out so that users are aware of that.

The addition of BUILDROOT directory is just a direct result of obsoleting ill-designed BuildRoot: tag that was subject of misleading guidelines. The fact is that to keep it secure (e.g. two buildroots won't conflicts between two or more parallel builds) rpmbuild has to decide itself where the buildroot will be located and in fact it is configurable either in /usr/lib/rpm/macros system-wide or in .rpmmacros per user.

>  Now we're going to add another directory to this list?

Yes.

> Why not let rpmbuild create BUILD/BUILDROOT/ and use
> that, if it wants to? 

Because it doesn't make sense from the directory logic and it's messy. rpmbuild doesn't remove directories in BUILD/ after a package is built. Imagine what amount of directories you would have to pass just to find BUILDROOT subdirectory after you built a few packages. And yes, it by principle allows conflicts among directories where packages are actually built and BUILDROOT directory. So it is unacceptable.

> BUILD/ is unseen by end users generally - it's populated
> and erased entirely by rpmbuild.  So let rpmbuild create BUILD/BUILDROOT/.

Not in case when the build fails. In this situation it is very good for a packager to have possibility to look into the buildroot to see what happenned.

Comment 10 Matt Domsch 2008-09-03 13:21:43 UTC
I'll hold off on a new rawhide rebuild until this bug and #458234 are resolved in mock.

Comment 11 Jindrich Novy 2008-09-03 13:36:24 UTC
Matt, I committed a few days ago to rpm upstream that all needed directories are created if they are missing prior to build/srpm installation. Maybe that resolves also this bug without touching mock.

It will occur with the new GIT snapshot in rawhide.

Comment 12 Jim Meyering 2008-09-10 20:07:44 UTC
Hi Jindrich,

Is this fix slated to hit rawhide soon?
I'm experiencing problems in ovirt due to it.
If it's going to take much longer, it may be worthwhile for me to commit a work-around patch locally.

Thanks,
Jim

btw, I'm using rpm-4.5.90-0.git8461.5.x86_64

Comment 13 Clark Williams 2008-09-10 20:24:53 UTC
The mock which adds the BUILDROOT dir hit rawhide a few days ago (mock-0.9.11-1.fc10.noarch). Is it still a problem?

Comment 14 Jim Meyering 2008-09-10 20:44:47 UTC
Hi Clark,
Thanks for the quick reply.

In following ovirt's build instructions (http://ovirt.org/build-instructions.html) on rawhide, I get this failure due to a missing BUILDROOT directory:

$ make -f ovirt.mk OVIRT_BRANCH=next build
...
cp version rpm-build/
rm -rf ovirt-server-0.92
rpmbuild --define ...
...
Executing(%install): /bin/sh -e /var/tmp/rpm-tmp.FhFnTO
+ umask 022
+ cd /home/meyering/w/co/ov/server/rpm-build
+ cd ovirt-server-0.92
+ LANG=C
+ export LANG
+ unset DISPLAY
+ test x/home/meyering/w/co/ov/server/rpm-build/BUILDROOT/ovirt-server-0.92-1.fc1
0.x86_64 '!=' x
+ rm -rf /home/meyering/w/co/ov/server/rpm-build/BUILDROOT/ovirt-server-0.92-1.fc
10.x86_64
+ mkdir /home/meyering/w/co/ov/server/rpm-build/BUILDROOT/ovirt-server-0.92-1.fc1
0.x86_64
mkdir: cannot create directory `/home/meyering/w/co/ov/server/rpm-build/BUILDROOT
/ovirt-server-0.92-1.fc10.x86_64': No such file or directory
error: Bad exit status from /var/tmp/rpm-tmp.FhFnTO (%install)
      
      
RPM build errors:
    Bad exit status from /var/tmp/rpm-tmp.FhFnTO (%install)
make[1]: *** [rpms] Error 1
make[1]: Leaving directory `/home/meyering/w/co/ov/server'
make: *** [publish] Error 1
[Exit 2]


Should I report this elsewhere?

Comment 15 Clark Williams 2008-09-10 20:49:27 UTC
no, I think that's my problem (mock that is). The output of the error messages makes it look like there was a newline tagged onto the end of BUILDROOT...

I'll dig a bit deeper.

Comment 16 Clark Williams 2008-09-10 20:56:37 UTC
Ah, that'll teach me to read things more closely!

You're not calling mock in your build, so you're seeing the rpm error and you need the rpm that Jindrich was referring to in comment #11. 

Don't know what the rpm version number is though. 

I'm going to close this BZ, since the mock fix for this problem is already in rawhide.

Comment 17 Jindrich Novy 2008-09-11 13:50:00 UTC
(In reply to comment #12)
> Hi Jindrich,
> 
> Is this fix slated to hit rawhide soon?

Yup, I committed and built it in today's rpm-4.5.90-0.git8461.6.


Note You need to log in before you can comment on or make changes to this bug.