Bug 1220269 - the drpm mirror fallback does not work
Summary: the drpm mirror fallback does not work
Keywords:
Status: CLOSED DUPLICATE of bug 1219817
Alias: None
Product: Fedora
Classification: Fedora
Component: librepo
Version: 22
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
Assignee: Tomas Mlcoch
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2015-05-11 07:22 UTC by Lubomir Rintel
Modified: 2015-06-09 06:40 UTC (History)
11 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2015-06-09 06:38:47 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)
Debug output from dnf run (82.91 KB, text/plain)
2015-05-29 11:14 UTC, Patrick O'Callaghan
no flags Details

Description Lubomir Rintel 2015-05-11 07:22:21 UTC
Description of problem:

Failure to download a single package from a single mirror causes the update to be aborted.

Note that this has possible security implications, as a single remote can prevent users from getting updates.

Version-Release number of selected component (if applicable):

[lkundrak@belphegor ~]$ rpm -qa |grep dnf
dnf-conf-1.0.0-1.fc22.noarch
python-dnf-plugins-extras-migrate-0.0.7-1.fc22.noarch
python-dnf-1.0.0-1.fc22.noarch
python-dnf-plugins-extras-common-0.0.7-1.fc22.noarch
dnf-plugins-core-0.1.7-1.fc22.noarch
python-dnf-plugins-core-0.1.7-1.fc22.noarch
dnf-1.0.0-1.fc22.noarch
dnf-yum-1.0.0-1.fc22.noarch
[lkundrak@belphegor ~]$ 

Actual results:

There are three attempts to download libssh bellow -- all from a single mirror! No fallbcak

dnf -y [root@belphegor lkundrak]# dnf -y update
Last metadata expiration check performed 0:54:28 ago on Mon May 11 08:12:55 2015.
Dependencies resolved.

> [snip] ...

Install    1 Package
Upgrade  368 Packages

Total download size: 337 M
Downloading Packages:
(1/369): boost-container-1.57.0-6.fc22.x86_64.rpm                                                                                                                                  1.6 MB/s |  66 kB     00:00    
(2/369): NetworkManager-wwan-1.1.0-12079.33527341b1.fc22.x86_64.rpm                                                                                                                 31 kB/s |  43 kB     00:01    
(3/369): NetworkManager-wifi-1.1.0-12079.33527341b1.fc22.x86_64.rpm                                                                                                                 81 kB/s |  48 kB     00:00    
(4/369): NetworkManager-tui-1.1.0-12079.33527341b1.fc22.x86_64.rpm                                                                                                                 129 kB/s | 101 kB     00:00    
(5/369): NetworkManager-libnm-1.1.0-12079.33527341b1.fc22.x86_64.rpm                                                                                                               129 kB/s | 385 kB     00:02    
(6/369): NetworkManager-team-1.1.0-12079.33527341b1.fc22.x86_64.rpm                                                                                                                 94 kB/s |  22 kB     00:00    
(7/369): NetworkManager-bluetooth-1.1.0-12079.33527341b1.fc22.x86_64.rpm                                                                                                           107 kB/s |  42 kB     00:00    
(8/369): NetworkManager-adsl-1.1.0-12079.33527341b1.fc22.x86_64.rpm                                                                                                                100 kB/s |  20 kB     00:00    
(9/369): NetworkManager-devel-1.1.0-12079.33527341b1.fc22.x86_64.rpm                                                                                                               247 kB/s | 278 kB     00:01    
(10/369): NetworkManager-libnm-devel-1.1.0-12079.33527341b1.fc22.x86_64.rpm                                                                                                        220 kB/s | 428 kB     00:01    
(11/369): NetworkManager-glib-devel-1.1.0-12079.33527341b1.fc22.x86_64.rpm                                                                                                         297 kB/s | 461 kB     00:01    
(12/369): NetworkManager-config-server-1.1.0-12079.33527341b1.fc22.x86_64.rpm                                                                                                       48 kB/s |  11 kB     00:00    
(13/369): NetworkManager-1.1.0-12079.33527341b1.fc22.x86_64.rpm                                                                                                                    297 kB/s | 1.9 MB     00:06    
(14/369): NetworkManager-glib-1.1.0-12079.33527341b1.fc22.x86_64.rpm                                                                                                               281 kB/s | 275 kB     00:00    
(15/369): boost-1.57.0-6.fc22.x86_64.rpm                                                                                                                                            11 MB/s |  43 kB     00:00    
(16/369): boost-atomic-1.57.0-6.fc22.x86_64.rpm                                                                                                                                     12 MB/s |  45 kB     00:00    
(17/369): boost-locale-1.57.0-6.fc22.x86_64.rpm                                                                                                                                     21 MB/s | 285 kB     00:00    
(18/369): boost-system-1.57.0-6.fc22.x86_64.rpm                                                                                                                                    4.2 MB/s |  48 kB     00:00    
(19/369): boost-timer-1.57.0-6.fc22.x86_64.rpm                                                                                                                                      12 MB/s |  50 kB     00:00    
(20/369): boost-signals-1.57.0-6.fc22.x86_64.rpm                                                                                                                                    12 MB/s |  70 kB     00:00    
(21/369): boost-program-options-1.57.0-6.fc22.x86_64.rpm                                                                                                                           7.9 MB/s | 169 kB     00:00    
(22/369): boost-serialization-1.57.0-6.fc22.x86_64.rpm                                                                                                                             7.7 MB/s | 159 kB     00:00    
(23/369): boost-math-1.57.0-6.fc22.x86_64.rpm                                                                                                                                       13 MB/s | 282 kB     00:00    
(24/369): boost-log-1.57.0-6.fc22.x86_64.rpm                                                                                                                                        19 MB/s | 487 kB     00:00    
(25/369): boost-graph-1.57.0-6.fc22.x86_64.rpm                                                                                                                                      12 MB/s | 140 kB     00:00    
(26/369): boost-wave-1.57.0-6.fc22.x86_64.rpm                                                                                                                                       12 MB/s | 233 kB     00:00    
(27/369): boost-filesystem-1.57.0-6.fc22.x86_64.rpm                                                                                                                                452 kB/s |  75 kB     00:00    
(28/369): boost-context-1.57.0-6.fc22.x86_64.rpm                                                                                                                                   273 kB/s |  45 kB     00:00    
(29/369): boost-chrono-1.57.0-6.fc22.x86_64.rpm                                                                                                                                     12 MB/s |  52 kB     00:00    
(30/369): boost-python-1.57.0-6.fc22.x86_64.rpm                                                                                                                                     17 MB/s | 132 kB     00:00    
(31/369): boost-iostreams-1.57.0-6.fc22.x86_64.rpm                                                                                                                                 5.9 MB/s |  67 kB     00:00    
(32/369): boost-thread-1.57.0-6.fc22.x86_64.rpm                                                                                                                                    8.1 MB/s |  89 kB     00:00    
(33/369): boost-date-time-1.57.0-6.fc22.x86_64.rpm                                                                                                                                  11 MB/s |  59 kB     00:00    
(34/369): boost-test-1.57.0-6.fc22.x86_64.rpm                                                                                                                                       21 MB/s | 223 kB     00:00    
(35/369): boost-regex-1.57.0-6.fc22.x86_64.rpm                                                                                                                                      18 MB/s | 303 kB     00:00    
(36/369): boost-random-1.57.0-6.fc22.x86_64.rpm                                                                                                                                    4.5 MB/s |  51 kB     00:00    
(37/369): boost-coroutine-1.57.0-6.fc22.x86_64.rpm                                                                                                                                  12 MB/s |  60 kB     00:00    
(38/369): cjkuni-uming-fonts-0.2.20080216.1-54.fc21_0.2.20080216.1-55.fc22.noarch.drpm                                                                                             612 kB/s |  13 kB     00:00    
(39/369): doxygen-1.8.9.1-2.fc22.x86_64.rpm                                                                                                                                         21 MB/s | 4.2 MB     00:00    
(40/369): boost-devel-1.57.0-4.fc22_1.57.0-6.fc22.x86_64.drpm                                                                                                                      6.0 MB/s | 1.6 MB     00:00    
(41/369): ghc-Cabal-1.18.1.5-43.fc22_1.18.1.5-44.fc22.x86_64.drpm                                                                                                                  3.6 MB/s | 242 kB     00:00    
(42/369): ghc-array-0.5.0.0-43.fc22_0.5.0.0-44.fc22.x86_64.drpm                                                                                                                    2.7 MB/s |  59 kB     00:00    
(43/369): ghc-bytestring-0.10.4.0-43.fc22_0.10.4.0-44.fc22.x86_64.drpm                                                                                                             5.0 MB/s |  60 kB     00:00    
(44/369): ghc-base-4.7.0.2-43.fc22_4.7.0.2-44.fc22.x86_64.drpm                                                                                                                      15 MB/s | 405 kB     00:00    
(45/369): ghc-containers-0.5.5.1-43.fc22_0.5.5.1-44.fc22.x86_64.drpm                                                                                                               7.1 MB/s |  87 kB     00:00    
(46/369): ghc-directory-1.2.1.0-44.fc22.x86_64.rpm                                                                                                                                  12 MB/s |  68 kB     00:00    
(47/369): ghc-deepseq-1.3.0.2-44.fc22.x86_64.rpm                                                                                                                                   4.8 MB/s |  50 kB     00:00    
(48/369): ghc-filepath-1.3.0.2-44.fc22.x86_64.rpm                                                                                                                                   14 MB/s |  69 kB     00:00    
(49/369): ghc-old-locale-1.0.0.6-44.fc22.x86_64.rpm                                                                                                                                 13 MB/s |  56 kB     00:00    
(50/369): ghc-pretty-1.1.1.1-44.fc22.x86_64.rpm                                                                                                                                     13 MB/s |  66 kB     00:00    
(51/369): ghc-old-time-1.1.0.2-43.fc22_1.1.0.2-44.fc22.x86_64.drpm                                                                                                                 6.3 MB/s |  49 kB     00:00    
(52/369): ghc-srpm-macros-1.4.2-1.fc22.noarch.rpm                                                                                                                                  4.0 MB/s | 8.1 kB     00:00    
(53/369): ghc-process-1.2.0.0-44.fc22.x86_64.rpm                                                                                                                                   8.5 MB/s |  74 kB     00:00    
(54/369): ghc-time-1.4.2-43.fc22_1.4.2-44.fc22.x86_64.drpm                                                                                                                         6.2 MB/s |  62 kB     00:00    
(55/369): ghc-transformers-0.3.0.0-43.fc22_0.3.0.0-44.fc22.x86_64.drpm                                                                                                             6.5 MB/s |  51 kB     00:00    
(56/369): ghc-unix-2.7.0.1-43.fc22_2.7.0.1-44.fc22.x86_64.drpm                                                                                                                     3.4 MB/s |  53 kB     00:00    
(57/369): icedtea-web-1.6-2.fc22_1.6-3.fc22.x86_64.drpm                                                                                                                            3.2 MB/s |  74 kB     00:00    
(58/369): kdelibs3-3.5.10-65.fc22_3.5.10-68.fc22.x86_64.drpm                                                                                                                       6.0 MB/s | 6.8 MB     00:01    
[DRPM] ghc-array-0.5.0.0-43.fc22_0.5.0.0-44.fc22.x86_64.drpm: done                                                                                                                                                
(59/369): libabw-0.1.1-4.fc22.x86_64.rpm                                                                                                                                           3.6 MB/s |  99 kB     00:00    
[MIRROR] libguestfs-1.29.39-1.fc22.x86_64.rpm: Status code: 404 for http://download.eng.brq.redhat.com/pub/fedora/linux/updates/testing/22/x86_64/l/libguestfs-1.29.39-1.fc22.x86_64.rpm                          
[MIRROR] libguestfs-1.29.39-1.fc22.x86_64.rpm: Curl error (78): Remote file not found for ftp://mirror.slu.cz/fedora/linux/updates/testing/22/x86_64/l/libguestfs-1.29.39-1.fc22.x86_64.rpm [RETR response: 550]  
[MIRROR] libguestfs-1.29.39-1.fc22.x86_64.rpm: Status code: 404 for http://mirror.slu.cz/fedora/linux/updates/testing/22/x86_64/l/libguestfs-1.29.39-1.fc22.x86_64.rpm                                            
[MIRROR] libguestfs-1.29.39-1.fc22.x86_64.rpm: Status code: 404 for http://mirror.vutbr.cz/fedora/updates/testing/22/x86_64/l/libguestfs-1.29.39-1.fc22.x86_64.rpm                                                
[MIRROR] libguestfs-1.29.39-1.fc22.x86_64.rpm: Curl error (78): Remote file not found for ftp://mirror.vutbr.cz/fedora/updates/testing/22/x86_64/l/libguestfs-1.29.39-1.fc22.x86_64.rpm [RETR response: 550]      
[MIRROR] libguestfs-1.29.39-1.fc22.x86_64.rpm: Status code: 404 for http://ftp.linux.cz/pub/linux/fedora/linux/updates/testing/22/x86_64/l/libguestfs-1.29.39-1.fc22.x86_64.rpm                                   
[MIRROR] libguestfs-1.29.39-1.fc22.x86_64.rpm: Curl error (78): Remote file not found for ftp://ftp.fi.muni.cz/pub/linux/fedora/linux/updates/testing/22/x86_64/l/libguestfs-1.29.39-1.fc22.x86_64.rpm [RETR response: 550]
[MIRROR] libguestfs-1.29.39-1.fc22.x86_64.rpm: Curl error (78): Remote file not found for ftp://ftp.linux.cz/pub/linux/fedora/linux/updates/testing/22/x86_64/l/libguestfs-1.29.39-1.fc22.x86_64.rpm [RETR response: 550]
(60/369): kicad-2015.03.21-2.rev5528.fc22.x86_64.rpm                                                                                                                                14 MB/s |  65 MB     00:04    
[MIRROR] libguestfs-tools-c-1.29.38-1.fc22_1.29.39-1.fc22.x86_64.drpm: Status code: 404 for http://download.eng.brq.redhat.com/pub/fedora/linux/updates/testing/22/x86_64/drpms/libguestfs-tools-c-1.29.38-1.fc22_1.29.39-1.fc22.x86_64.drpm
[MIRROR] libguestfs-1.29.39-1.fc22.x86_64.rpm: Status code: 404 for http://ftp.fi.muni.cz/pub/linux/fedora/linux/updates/testing/22/x86_64/l/libguestfs-1.29.39-1.fc22.x86_64.rpm                                 
[MIRROR] libguestfs-1.29.39-1.fc22.x86_64.rpm: Curl error (78): Remote file not found for ftp://mirror.karneval.cz/pub/linux/fedora/linux/updates/testing/22/x86_64/l/libguestfs-1.29.39-1.fc22.x86_64.rpm [RETR response: 550]
[MIRROR] libguestfs-1.29.39-1.fc22.x86_64.rpm: Status code: 404 for http://mirror.karneval.cz/pub/linux/fedora/linux/updates/testing/22/x86_64/l/libguestfs-1.29.39-1.fc22.x86_64.rpm                             
[MIRROR] libguestfs-tools-c-1.29.38-1.fc22_1.29.39-1.fc22.x86_64.drpm: Curl error (78): Remote file not found for ftp://mirror.slu.cz/fedora/linux/updates/testing/22/x86_64/drpms/libguestfs-tools-c-1.29.38-1.fc22_1.29.39-1.fc22.x86_64.drpm [RETR response: 550]
[MIRROR] libguestfs-tools-c-1.29.38-1.fc22_1.29.39-1.fc22.x86_64.drpm: Status code: 404 for http://mirror.slu.cz/fedora/linux/updates/testing/22/x86_64/drpms/libguestfs-tools-c-1.29.38-1.fc22_1.29.39-1.fc22.x86_64.drpm
[MIRROR] libguestfs-tools-c-1.29.38-1.fc22_1.29.39-1.fc22.x86_64.drpm: Status code: 404 for http://mirror.vutbr.cz/fedora/updates/testing/22/x86_64/drpms/libguestfs-tools-c-1.29.38-1.fc22_1.29.39-1.fc22.x86_64.drpm
(61/369): NetworkManager-debuginfo-1.1.0-12079.33527341b1.fc22.x86_64.rpm                                                                                                          695 kB/s | 6.1 MB     00:09    
[MIRROR] libssh-0.6.4-1.fc22_0.6.5-1.fc22.x86_64.drpm: Curl error (56): Failure when receiving data from the peer for ftp://mirror.slu.cz/fedora/linux/updates/testing/22/x86_64/drpms/libssh-0.6.4-1.fc22_0.6.5-1.fc22.x86_64.drpm [response reading failed]
[FAILED] libssh-0.6.4-1.fc22_0.6.5-1.fc22.x86_64.drpm: Curl error (56): Failure when receiving data from the peer for ftp://mirror.slu.cz/fedora/linux/updates/testing/22/x86_64/drpms/libssh-0.6.4-1.fc22_0.6.5-1.fc22.x86_64.drpm [response reading failed]
[DRPM] cjkuni-uming-fonts-0.2.20080216.1-54.fc21_0.2.20080216.1-55.fc22.noarch.drpm: done                                                                                                                         
[DRPM] ghc-Cabal-1.18.1.5-43.fc22_1.18.1.5-44.fc22.x86_64.drpm: done                                                                                                                                              
[DRPM] ghc-bytestring-0.10.4.0-43.fc22_0.10.4.0-44.fc22.x86_64.drpm: done                                                                                                                                         
[DRPM] ghc-old-time-1.1.0.2-43.fc22_1.1.0.2-44.fc22.x86_64.drpm: done                                                                                                                                             
[DRPM] ghc-time-1.4.2-43.fc22_1.4.2-44.fc22.x86_64.drpm: done                                                                                                                                                     
[DRPM] ghc-transformers-0.3.0.0-43.fc22_0.3.0.0-44.fc22.x86_64.drpm: done                                                                                                                                         
[DRPM] ghc-unix-2.7.0.1-43.fc22_2.7.0.1-44.fc22.x86_64.drpm: done                                                                                                                                                 
[DRPM] ghc-containers-0.5.5.1-43.fc22_0.5.5.1-44.fc22.x86_64.drpm: done                                                                                                                                           
[DRPM] icedtea-web-1.6-2.fc22_1.6-3.fc22.x86_64.drpm: done                                                                                                                                                        
[DRPM] ghc-base-4.7.0.2-43.fc22_4.7.0.2-44.fc22.x86_64.drpm: done                                                                                                                                                 
[DRPM] kdelibs3-3.5.10-65.fc22_3.5.10-68.fc22.x86_64.drpm: done                                                                                                                                                   
[DRPM] boost-devel-1.57.0-4.fc22_1.57.0-6.fc22.x86_64.drpm: done                                                                                                                                                  
Error: Error downloading packages:fc22.x86_64.rpm                                      72% [=============================================================-                       ] 5.5 MB/s |  93 MB     00:06 ETA
  Curl error (56): Failure when receiving data from the peer for ftp://mirror.slu.cz/fedora/linux/updates/testing/22/x86_64/drpms/libssh-0.6.4-1.fc22_0.6.5-1.fc22.x86_64.drpm [response reading failed]
[root@belphegor lkundrak]#

Comment 1 Honza Silhan 2015-05-13 19:51:23 UTC
Thanks for the report. This seems to me like temporary unavailability of 3 packages or the repo metadata was just changed so the links are wrong. Can you fill in the remaining debug details [1], please?

[1] https://github.com/rpm-software-management/dnf/wiki/Bug-Reporting#connection-issue

Comment 2 Patrick O'Callaghan 2015-05-28 15:19:53 UTC
I'm getting repeated failures of this type:

Failure when receiving data from the peer for ftp://ftp.mirrorservice.org/sites/dl.fedoraproject.org/pub/fedora/linux/development/22/x86_64/os/Packages/k/kde-l10n-14.12.3-6.fc22.noarch.rpm [response reading failed]

I get the same even after "dnf clean all", and it happens with update, install, distro-sync, ...

Comment 3 Radek Holy 2015-05-29 06:34:59 UTC
Seems like a problem in librepo. Could you provide the information requested above?

Comment 4 Patrick O'Callaghan 2015-05-29 11:14:57 UTC
Created attachment 1031947 [details]
Debug output from dnf run

Comment 5 Patrick O'Callaghan 2015-05-29 11:16:04 UTC
The above debug log is from:

librepo-1.7.13-1.fc22.x86_64
curl-7.40.0-3.fc22.x86_64
dnf-1.0.0-1.fc22.noarch

Running with -refresh does not correct the problem.

Comment 6 Radek Holy 2015-06-02 08:03:43 UTC
It seems like a network issue. Does this: https://lists.fedoraproject.org/pipermail/users/2015-May/461340.html mean that DNF/librepo should disable the EPSV mode? Always? Automatically? Manually?

I have no idea what to do. Tomas, what about you?

Comment 7 Sergiu 2015-06-07 07:33:14 UTC
Same problem ... I hate fedora 22... Is not network and is not package related is fedora related to be exact dnf !! I Hate fedora 22 !!! I don't think if will gone tel 1 00000 00000 0000 times it will ever happen for the developers to do something about it, but i  try! HATE Fedora 22. Worst distro ever! Dont use it!

Comment 8 Tomas Mlcoch 2015-06-08 08:42:42 UTC
Hi, this is almost same problem as 1219817.
This is happening, because librepo consider curl's return code CURLE_RECV_ERROR as a fatal failure and don't try another mirror.
This is fixed in librepo-1.7.16-1.fc22 which is already in testing and will be pushed into stable soon.
https://admin.fedoraproject.org/updates/FEDORA-2015-9077/librepo-1.7.16-1.fc22

Comment 9 Radek Holy 2015-06-09 06:38:47 UTC
Cool, thank you Tomas.
Since the cause is the same, I think we can mark this as a duplicate.

*** This bug has been marked as a duplicate of bug 1219817 ***


Note You need to log in before you can comment on or make changes to this bug.