Yes, known... this is a clash between apt and rpm internal Lua versions. This and the recent change in repodata format makes apt indeed completely broken for F10. Will fix eventually but maybe we should pull apt+synaptic out until this is resolved, shipping known broken packages does little good to anybody.

*** Bug 460742 has been marked as a duplicate of this bug. ***

This bug appears to have been reported against 'rawhide' during the Fedora 10 development cycle.
Changing version to '10'.

More information and reason for this action is here:
http://fedoraproject.org/wiki/BugZappers/HouseKeeping

*** Bug 473656 has been marked as a duplicate of this bug. ***

*** Bug 474403 has been marked as a duplicate of this bug. ***

While searching for Lua 5.1 documentation while attempting to fix this I stumbled upon a patch from that already solves this (which was for some unknown reason sent to rpm-devel), so I added it to devel CVS in 0.5.15lorg3.94-6 release.

I didn't manage to finish an apt-get update though, failing at CollectFileProvides for flac. I'll eventually try to look at it later today.

(In reply to comment #1)
> This
> and the recent change in repodata format makes apt indeed completely broken for
> F10.

Panu: Are you aware of details of the change in repodata format? Maybe that could help solve my problem.

(In reply to comment #6)
> While searching for Lua 5.1 documentation while attempting to fix this I
> stumbled upon a patch from that already solves this (which was for some unknown
> reason sent to rpm-devel), so I added it to devel CVS in
> 0.5.15lorg3.94-6 release.

It's not quite that simple :-/ This discards the local Lua libraries apt (and rpm for that matter) bundles, namely posix and rexlib, shipping without them is a notable functionality regression for apt-lua scripts. Especially the posix library is rather essential for doing much anything useful (without it, gpg checker wont work etc). Hmm... ok, lua-posix appears to be in Fedora as a separate package, that should be enough to preserve most common functionality.

For upstream I'll need a better fix that handles all the myriad of combinations without losing functionality but this is at least a start at getting apt back on track.

> I didn't manage to finish an apt-get update though, failing at
> CollectFileProvides for flac. I'll eventually try to look at it later today.
> 
> (In reply to comment #1)
> > This
> > and the recent change in repodata format makes apt indeed completely broken for
> > F10.
> 
> Panu: Are you aware of details of the change in repodata format? Maybe that
> could help solve my problem.

Well, repodata format didn't really change, it's just that apt was using hardcoded "basenames" for primary/filelist files as a kludge to hide the fact that repomd "index" is actually several files. I've been intending to fix but never got around to it, but it should be fixed upstream now. Thanks for kicking my lazy butt to do something about it :)

(In reply to comment #7)
> (In reply to comment #6)
> > While searching for Lua 5.1 documentation while attempting to fix this I
> > stumbled upon a patch from that already solves this (which was for some unknown
> > reason sent to rpm-devel), so I added it to devel CVS in
> > 0.5.15lorg3.94-6 release.
> 
> It's not quite that simple :-/ This discards the local Lua libraries apt (and
> rpm for that matter) bundles, namely posix and rexlib, shipping without them is
> a notable functionality regression for apt-lua scripts. Especially the posix
> library is rather essential for doing much anything useful (without it, gpg
> checker wont work etc). Hmm... ok, lua-posix appears to be in Fedora as a
> separate package, that should be enough to preserve most common functionality.

Yum, I noticed regex being separate in new lua, added "require 'regex'" in the lua scripts but I forgot to take that into account when commiting. Sorry for that. Not knowing much about LUA I don't even know what does require really do not what's its lua C library counterpart.

> > Panu: Are you aware of details of the change in repodata format? Maybe that
> > could help solve my problem.
> 
> Well, repodata format didn't really change, it's just that apt was using
> hardcoded "basenames" for primary/filelist files as a kludge to hide the fact
> that repomd "index" is actually several files. I've been intending to fix but
> never got around to it, but it should be fixed upstream now. Thanks for kicking
> my lazy butt to do something about it :)

Wow, you're fast. I found out what's the problem with those file names in the morning and had been struggling to fix that sensibly for hours :)

(In reply to comment #8)
> Yum, I noticed regex being separate in new lua, added "require 'regex'" in the
  ^^^ This should have been "Yes" :}

> Wow, you're fast. I found out what's the problem with those file names in the
> morning and had been struggling to fix that sensibly for hours :)

To put things to some perspective, I've been scratching my head for *weeks* how to sensibly fix it :) And the current fix is far from perfect, it's still a bit of a hack but so far I haven't been able to come up with a "fully correct" fix that doesn't require restructuring half of apt's internals...

Created attachment 327135 [details]
Load required lua packages

(In reply to comment #7)

> It's not quite that simple :-/ This discards the local Lua libraries apt (and
> rpm for that matter) bundles, namely posix and rexlib, shipping without them is
> a notable functionality regression for apt-lua scripts. Especially the posix
> library is rather essential for doing much anything useful (without it, gpg
> checker wont work etc). Hmm... ok, lua-posix appears to be in Fedora as a
> separate package, that should be enough to preserve most common functionality.

Attaching patch with necessary changes to lua scripts. The lrexlib package is being reviewed here: bug #476712

Ok upstream whacked to build against external liblua but including bundled Lua-extensions. Support for rpm 4.4.x is horribly broken by that but this'll at least permit moving on with things, apt's been broken for far far too long now.

Kinda amusingly, I apparently don't belong to the "provenpackager" group and the "opening" of ACL's killed my co-maintainer permissions wrt apt... Until I regain the permissions (already requested), here's the src.rpm of upstream snapshot that should make apt reasonably functional again:
http://laiskiainen.org/tmp/apt-0.5.15lorg3.95-0.git416.1.fc11.src.rpm

Okay, the above snapshot is now built into rawhide:
http://koji.fedoraproject.org/koji/buildinfo?buildID=76168
At least basic smoke-tests pass... F10 is going to need an update soon too of course, but please do test the rawhide package a bit before we go for F10.

Thanks Axel for undoing the mess the ACL mass-opening scripts/whatever caused :)

apt-0.5.15lorg3.95-0.git416.3.fc10 has been submitted as an update for Fedora 10.
http://admin.fedoraproject.org/updates/apt-0.5.15lorg3.95-0.git416.3.fc10

apt-0.5.15lorg3.95-0.git416.3.fc10 has been pushed to the Fedora 10 testing repository.  If problems still persist, please make note of it in this bug report.
 If you want to test the update, you can install it with 
 su -c 'yum --enablerepo=updates-testing update apt'.  You can provide feedback for this update here: http://admin.fedoraproject.org/updates/F10/FEDORA-2009-0304

*** Bug 479483 has been marked as a duplicate of this bug. ***

apt-0.5.15lorg3.95-0.git416.3.fc10 has been pushed to the Fedora 10 stable repository.  If problems still persist, please make note of it in this bug report.

same problem : 

===========
# apt-get update
*** glibc detected *** apt-get: realloc(): invalid pointer: 0x08877024 ***
======= Backtrace: =========
/lib/libc.so.6[0x9a63a4]
/lib/libc.so.6(realloc+0x242)[0x9aadc2]
/usr/lib/libapt-pkg.so.3(luaM_realloc+0x35)[0x1ff195]
/usr/lib/libapt-pkg.so.3(luaD_reallocstack+0x43)[0x1fb223]
/usr/lib/libapt-pkg.so.3(luaD_growstack+0x46)[0x1fb2e6]
/usr/lib/libapt-pkg.so.3(luaD_precall+0x180)[0x1fbdd0]
/usr/lib/libapt-pkg.so.3(luaD_call+0x42)[0x1fc1a2]
/usr/lib/libapt-pkg.so.3(lua_call+0x3b)[0x1f7c9b]
/usr/lib/liblua-5.1.so(luaL_openlibs+0x65)[0xb8b385]
/usr/lib/librpmio-4.6.so(rpmluaNew+0x43)[0x2ba8c3]
/usr/lib/librpmio-4.6.so(rpmluaGetPrintBuffer+0x37)[0x2bb2d7]
/usr/lib/librpm-4.6.so(rpmReadConfigFiles+0x20e)[0x28358e]
/usr/lib/libapt-pkg.so.3(_ZN9rpmSystem5ScoreERK13Configuration+0x2b)[0x19bb4b]
/usr/lib/libapt-pkg.so.3(_Z13pkgInitSystemR13ConfigurationRP9pkgSystem+0x99)[0x1c3b49]
apt-get[0x8051036]
/lib/libc.so.6(__libc_start_main+0xe5)[0x94d6e5]
apt-get(_ZNSt8ios_base4InitD1Ev+0x41)[0x804cc61]
======= Memory map: ========
00110000-00234000 r-xp 00000000 fd:00 1024020    /usr/lib/libapt-pkg.so.3.0.0
00234000-00239000 rw-p 00123000 fd:00 1024020    /usr/lib/libapt-pkg.so.3.0.0
00239000-002a1000 r-xp 00000000 fd:00 1024615    /usr/lib/librpm-4.6.so
002a1000-002a6000 rw-p 00067000 fd:00 1024615    /usr/lib/librpm-4.6.so
002a6000-002cd000 r-xp 00000000 fd:00 1024694    /usr/lib/librpmio-4.6.so
002cd000-002cf000 rw-p 00027000 fd:00 1024694    /usr/lib/librpmio-4.6.so
002cf000-002d1000 rw-p 002cf000 00:00 0 
002d1000-002dc000 r-xp 00000000 fd:00 14726      /lib/libnss_files-2.9.so
002dc000-002dd000 r--p 0000a000 fd:00 14726      /lib/libnss_files-2.9.so
002dd000-002de000 rw-p 0000b000 fd:00 14726      /lib/libnss_files-2.9.so
00312000-0032d000 r-xp 00000000 fd:00 10541      /lib/libselinux.so.1
0032d000-0032e000 r--p 0001a000 fd:00 10541      /lib/libselinux.so.1
0032e000-0032f000 rw-p 0001b000 fd:00 10541      /lib/libselinux.so.1
0032f000-0045d000 r-xp 00000000 fd:00 10702      /lib/libdb-4.5.so
0045d000-00460000 rw-p 0012e000 fd:00 10702      /lib/libdb-4.5.so
00912000-00932000 r-xp 00000000 fd:00 10551      /lib/ld-2.9.so
00933000-00934000 r--p 00020000 fd:00 10551      /lib/ld-2.9.so
00934000-00935000 rw-p 00021000 fd:00 10551      /lib/ld-2.9.so
00937000-00aa5000 r-xp 00000000 fd:00 10552      /lib/libc-2.9.so
00aa5000-00aa7000 r--p 0016e000 fd:00 10552      /lib/libc-2.9.so
00aa7000-00aa8000 rw-p 00170000 fd:00 10552      /lib/libc-2.9.so
00aa8000-00aab000 rw-p 00aa8000 00:00 0 
00aad000-00ab0000 r-xp 00000000 fd:00 10558      /lib/libdl-2.9.so
00ab0000-00ab1000 r--p 00002000 fd:00 10558      /lib/libdl-2.9.so
00ab1000-00ab2000 rw-p 00003000 fd:00 10558      /lib/libdl-2.9.so
00ab4000-00adb000 r-xp 00000000 fd:00 10556      /lib/libm-2.9.so
00adb000-00adc000 r--p 00026000 fd:00 10556      /lib/libm-2.9.so
00adc000-00add000 rw-p 00027000 fd:00 10556      /lib/libm-2.9.so
00adf000-00af5000 r-xp 00000000 fd:00 10565      /lib/libpthread-2.9.so
00af5000-00af6000 r--p 00015000 fd:00 10565      /lib/libpthread-2.9.so
00af6000-00af7000 rw-p 00016000 fd:00 10565      /lib/libpthread-2.9.so
00af7000-00af9000 rw-p 00af7000 00:00 0 
00b51000-00b66000 r-xp 00000000 fd:00 1024186    /usr/lib/libmagic.so.1.0.0
00b66000-00b67000 rw-p 00015000 fd:00 1024186    /usr/lib/libmagic.so.1.0.0
00b69000-00b93000 r-xp 00000000 fd:00 1024190    /usr/lib/liblua-5.1.so
00b93000-00b94000 rw-p 0002a000 fd:00 1024190    /usr/lib/liblua-5.1.so
00bfe000-00c11000 r-xp 00000000 fd:00 10562      /lib/libz.so.1.2.3
00c11000-00c12000 rw-p 00012000 fd:00 10562      /lib/libz.so.1.2.3
00c57000-00c5f000 r-xp 00000000 fd:00 10566      /lib/librt-2.9.so
00c5f000-00c60000 r--p 00007000 fd:00 10566      /lib/librt-2.9.so
00c60000-00c61000 rw-p 00008000 fd:00 10566      /lib/librt-2.9.so
00d36000-00d37000 r-xp 00d36000 00:00 0          [vdso]
02081000-02096000 r-xp 00000000 fd:00 1741       /usr/lib/libelf-0.140.so
02096000-02097000 ---p 00015000 fd:00 1741       /usr/lib/libelf-0.140.so
02097000-02098000 r--p 00015000 fd:00 1741       /usr/lib/libelf-0.140.so
02098000-02099000 rw-p 00016000 fd:00 1741       /usr/lib/libelf-0.140.so
02218000-02281000 r-xp 00000000 fd:00 5063       /usr/lib/libsqlite3.so.0.8.6
02281000-02283000 rw-p 00068000 fd:00 5063       /usr/lib/libsqlite3.so.0.8.6
05708000-0571e000 r-xp 00000000 fd:00 9122       /lib/libnssutil3.so
0571e000-05721000 rw-p 00015000 fd:00 9122       /lib/libnssutil3.so
05963000-05aa2000 r-xp 00000000 fd:00 9644       /lib/libnss3.so
05aa2000-05aa8000 rw-p 0013e000 fd:00 9644       /lib/libnss3.so
06df1000-06f3c000 r-xp 00000000 fd:00 4213       /usr/lib/libxml2.so.2.7.3
06f3c000-06f41000 rw-p 0014b000 fd:00 4213       /usr/lib/libxml2.so.2.7.3
06f41000-06f42000 rw-p 06f41000 00:00 0 
0706b000-07073000 r-xp 00000000 fd:00 9991       /lib/libpopt.so.0.0.0
07073000-07074000 rw-p 00007000 fd:00 9991       /lib/libpopt.so.0.0.0
07311000-0731e000 r-xp 00000000 fd:00 10564      /lib/libgcc_s-4.3.2-20081105.so.1
0731e000-0731f000 rw-p 0000c000 fd:00 10564      /lib/libgcc_s-4.3.2-20081105.so.1
0742c000-07513000 r-xp 00000000 fd:00 4235       /usr/lib/libstdc++.so.6.0.10
07513000-07517000 r--p 000e6000 fd:00 4235       /usr/lib/libstdc++.so.6.0.10
07517000-07519000 rw-p 000ea000 fd:00 4235       /usr/lib/libstdc++.so.6.0.10
07519000-0751e000 rw-p 07519000 00:00 0 
0775a000-0775d000 r-xp 00000000 fd:00 10690      /lib/libplds4.so
0775d000-0775e000 rw-p 00002000 fd:00 10690      /lib/libplds4.so
07760000-07764000 r-xp 00000000 fd:00 10688      /lib/libplc4.so
07764000-07765000 rw-p 00003000 fd:00 10688      /lib/libplc4.so
077c0000-077f7000 r-xp 00000000 fd:00 10686      /lib/libnspr4.so
077f7000-077f8000 rw-p 00037000 fd:00 10686      /lib/libnspr4.so
077f8000-077fa000 rw-p 077f8000 00:00 0 
0797f000-0798f000 r-xp 00000000 fd:00 10708      /lib/libbz2.so.1.0.4
0798f000-07990000 rw-p 00010000 fd:00 10708      /lib/libbz2.so.1.0.4
08048000-0806f000 r-xp 00000000 fd:00 991570     /usr/bin/apt-get
0806f000-08070000 rw-p 00027000 fd:00 991570     /usr/bin/apt-get
0885b000-0889c000 rw-p 0885b000 00:00 0          [heap]
b7ee4000-b80e4000 r--p 00000000 fd:00 1048579    /usr/lib/locale/locale-archive
b80e4000-b80ec000 rw-p b80e4000 00:00 0 
bfcea000-bfcff000 rw-p bffeb000 00:00 0          [stack]
Aborted

============