Bug 1911828 - md5 mismatch for several packages
Summary: md5 mismatch for several packages
Keywords:
Status: CLOSED DUPLICATE of bug 1873876
Alias: None
Product: Fedora
Classification: Fedora
Component: deltarpm
Version: 34
Hardware: All
OS: Linux
unspecified
medium
Target Milestone: ---
Assignee: Jonathan Dieter
QA Contact: Fedora Extras Quality Assurance
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-12-31 15:36 UTC by JayJayJazz
Modified: 2021-05-21 12:42 UTC (History)
4 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-05-21 12:42:38 UTC
Type: Bug
Embargoed:


Attachments (Terms of Use)
Extract of dnf.log (86.80 KB, text/plain)
2020-12-31 15:36 UTC, JayJayJazz
no flags Details

Description JayJayJazz 2020-12-31 15:36:36 UTC
Created attachment 1743452 [details]
Extract of dnf.log

Description of problem:
Today's update via dnf resulted in several md5 mismatch messages.


How reproducible:
Upgrade RPM packages via dnf. List is given below.


Actual results:
RPM packages have to be downloaded, because drpm fails.


Expected results:
drpm should work fine, so that RPM re-download is not needed.


Additional info:
List of drpm packages that failed:

libopenmpt-0.4.15-1.fc33_0.4.16-1.fc33.x86_64.drpm
perl-DateTime-TimeZone-2.44-1.fc33_2.45-1.fc33.noarch.drpm
texlive-ae-svn15878.1.4-33.fc33_svn15878.1.4-34.fc33.noarch.drpm
texlive-algorithms-svn42428-33.fc33_svn42428-34.fc33.noarch.drpm
texlive-alphalph-svn53087-33.fc33_svn53087-34.fc33.noarch.drpm
texlive-amscls-svn46099-33.fc33_svn46099-34.fc33.noarch.drpm
texlive-amsfonts-svn29208.3.04-33.fc33_svn29208.3.04-34.fc33.noarch.drpm
texlive-amsmath-svn53640-33.fc33_svn53640-34.fc33.noarch.drpm
texlive-anysize-svn15878.0-33.fc33_svn15878.0-34.fc33.noarch.drpm
texlive-atbegshi-svn53051-33.fc33_svn53051-34.fc33.noarch.drpm
texlive-attachfile-svn42099-33.fc33_svn42099-34.fc33.noarch.drpm
texlive-atveryend-svn53108-33.fc33_svn53108-34.fc33.noarch.drpm
texlive-auto-pst-pdf-svn52849-33.fc33_svn52849-34.fc33.noarch.drpm
texlive-auxhook-svn53173-33.fc33_svn53173-34.fc33.noarch.drpm
texlive-avantgar-svn31835.0-33.fc33_svn31835.0-34.fc33.noarch.drpm
texlive-babelbib-svn50354-33.fc33_svn50354-34.fc33.noarch.drpm
texlive-babel-svn54487-33.fc33_svn54487-34.fc33.noarch.drpm
texlive-beamer-svn54841-33.fc33_svn54841-34.fc33.noarch.drpm
texlive-bera-svn20031.0-33.fc33_svn20031.0-34.fc33.noarch.drpm
texlive-beton-svn15878.0-33.fc33_svn15878.0-34.fc33.noarch.drpm
texlive-biblatex-svn53063-33.fc33_svn53063-34.fc33.noarch.drpm
texlive-bidi-svn53615-33.fc33_svn53615-34.fc33.noarch.drpm
texlive-bigintcalc-svn53172-33.fc33_svn53172-34.fc33.noarch.drpm
texlive-bitset-svn53837-33.fc33_svn53837-34.fc33.noarch.drpm
texlive-bookman-svn31835.0-33.fc33_svn31835.0-34.fc33.noarch.drpm
texlive-bookmark-svn53026-33.fc33_svn53026-34.fc33.noarch.drpm
texlive-booktabs-svn53402-33.fc33_svn53402-34.fc33.noarch.drpm
texlive-breakurl-svn29901.1.40-33.fc33_svn29901.1.40-34.fc33.noarch.drpm
texlive-breqn-svn54801-33.fc33_svn54801-34.fc33.noarch.drpm
texlive-caption-svn53517-33.fc33_svn53517-34.fc33.noarch.drpm
texlive-catchfile-svn53084-33.fc33_svn53084-34.fc33.noarch.drpm
texlive-charter-svn15878.0-33.fc33_svn15878.0-34.fc33.noarch.drpm
texlive-cite-svn36428.5.5-33.fc33_svn36428.5.5-34.fc33.noarch.drpm
texlive-cmap-svn42428-33.fc33_svn42428-34.fc33.noarch.drpm
texlive-cmextra-svn42428-33.fc33_svn42428-34.fc33.noarch.drpm
texlive-cm-super-svn15878.0-33.fc33_svn15878.0-34.fc33.noarch.drpm
texlive-cm-svn49028-33.fc33_svn49028-34.fc33.noarch.drpm
texlive-colorprofiles-svn49086-33.fc33_svn49086-34.fc33.noarch.drpm
texlive-colortbl-svn53545-33.fc33_svn53545-34.fc33.noarch.drpm
texlive-courier-svn35058.0-33.fc33_svn35058.0-34.fc33.noarch.drpm
texlive-ctable-svn38672-33.fc33_svn38672-34.fc33.noarch.drpm
texlive-dehyph-svn48599-33.fc33_svn48599-34.fc33.noarch.drpm
texlive-ec-svn25033.1.0-33.fc33_svn25033.1.0-34.fc33.noarch.drpm
texlive-enctex-svn34957.0-33.fc33_svn34957.0-34.fc33.noarch.drpm
texlive-epstopdf-pkg-svn53546-33.fc33_svn53546-34.fc33.noarch.drpm
texlive-etexcmds-svn53171-33.fc33_svn53171-34.fc33.noarch.drpm
texlive-etex-pkg-svn41784-33.fc33_svn41784-34.fc33.noarch.drpm
texlive-etex-svn37057.0-33.fc33_svn37057.0-34.fc33.noarch.drpm
texlive-euler-svn42428-33.fc33_svn42428-34.fc33.noarch.drpm
texlive-euro-ce-svn25714-33.fc33_svn25714-34.fc33.noarch.drpm
texlive-euro-svn22191.1.1-33.fc33_svn22191.1.1-34.fc33.noarch.drpm
texlive-eurosym-svn17265.1.4_subrfix-33.fc33_svn17265.1.4_subrfix-34.fc33.noarch.drpm
texlive-filecontents-svn52142-33.fc33_svn52142-34.fc33.noarch.drpm
texlive-fix2col-svn38770-33.fc33_svn38770-34.fc33.noarch.drpm
texlive-float-svn15878.1.3d-33.fc33_svn15878.1.3d-34.fc33.noarch.drpm
texlive-fontspec-svn53860-33.fc33_svn53860-34.fc33.noarch.drpm
texlive-fpl-svn54512-33.fc33_svn54512-34.fc33.noarch.drpm
texlive-fp-svn49719-33.fc33_svn49719-34.fc33.noarch.drpm
texlive-gettitlestring-svn53170-33.fc33_svn53170-34.fc33.noarch.drpm
texlive-graphics-cfg-svn41448-33.fc33_svn41448-34.fc33.noarch.drpm
texlive-grfext-svn53024-33.fc33_svn53024-34.fc33.noarch.drpm
texlive-grffile-svn52756-33.fc33_svn52756-34.fc33.noarch.drpm
texlive-helvetic-svn31835.0-33.fc33_svn31835.0-34.fc33.noarch.drpm
texlive-hologo-svn53048-33.fc33_svn53048-34.fc33.noarch.drpm
texlive-hycolor-svn53584-33.fc33_svn53584-34.fc33.noarch.drpm
texlive-hyperref-svn54841-33.fc33_svn54841-34.fc33.noarch.drpm
texlive-hyphen-base-svn54763-33.fc33_svn54763-34.fc33.noarch.drpm
texlive-hyphenex-svn37354.0-33.fc33_svn37354.0-34.fc33.noarch.drpm
texlive-hyphen-german-svn54758-33.fc33_svn54758-34.fc33.noarch.drpm
texlive-hyph-utf8-svn54568-33.fc33_svn54568-34.fc33.noarch.drpm
texlive-ifmtarg-svn47544-33.fc33_svn47544-34.fc33.noarch.drpm
texlive-ifplatform-svn45533-33.fc33_svn45533-34.fc33.noarch.drpm
texlive-infwarerr-svn53023-33.fc33_svn53023-34.fc33.noarch.drpm
texlive-intcalc-svn53168-33.fc33_svn53168-34.fc33.noarch.drpm
texlive-kastrup-svn15878.0-33.fc33_svn15878.0-34.fc33.noarch.drpm
texlive-knuth-lib-svn35820.0-33.fc33_svn35820.0-34.fc33.noarch.drpm
texlive-knuth-local-svn38627-33.fc33_svn38627-34.fc33.noarch.drpm
texlive-koma-script-svn54825-33.fc33_svn54825-34.fc33.noarch.drpm
texlive-kvdefinekeys-svn53193-33.fc33_svn53193-34.fc33.noarch.drpm
texlive-kvoptions-svn52985-33.fc33_svn52985-34.fc33.noarch.drpm
texlive-kvsetkeys-svn53166-33.fc33_svn53166-34.fc33.noarch.drpm
texlive-l3backend-svn54259-33.fc33_svn54259-34.fc33.noarch.drpm
texlive-l3experimental-svn53394-33.fc33_svn53394-34.fc33.noarch.drpm
texlive-l3kernel-svn54672-33.fc33_svn54672-34.fc33.noarch.drpm
texlive-latexbug-svn52414-33.fc33_svn52414-34.fc33.noarch.drpm
texlive-latexconfig-svn53525-33.fc33_svn53525-34.fc33.noarch.drpm
texlive-latex-fonts-svn28888.0-33.fc33_svn28888.0-34.fc33.noarch.drpm
texlive-letltxmacro-svn53022-33.fc33_svn53022-34.fc33.noarch.drpm
texlive-lineno-svn21442.4.41-33.fc33_svn21442.4.41-34.fc33.noarch.drpm
texlive-listings-svn54554-33.fc33_svn54554-34.fc33.noarch.drpm
texlive-lm-math-svn36915.1.959-33.fc33_svn36915.1.959-34.fc33.noarch.drpm
texlive-lm-svn48145-33.fc33_svn48145-34.fc33.noarch.drpm
texlive-ltxcmds-svn53165-33.fc33_svn53165-34.fc33.noarch.drpm
texlive-ltxmisc-svn21927.0-33.fc33_svn21927.0-34.fc33.noarch.drpm
texlive-lua-alt-getopt-svn29349.0.7.0-33.fc33_svn29349.0.7.0-34.fc33.noarch.drpm
texlive-lualibs-svn53682-33.fc33_svn53682-34.fc33.noarch.drpm
texlive-luatexbase-svn52663-33.fc33_svn52663-34.fc33.noarch.drpm
texlive-makecmds-svn15878.0-33.fc33_svn15878.0-34.fc33.noarch.drpm
texlive-manfnt-font-svn54684-33.fc33_svn54684-34.fc33.noarch.drpm
texlive-marginnote-svn48383-33.fc33_svn48383-34.fc33.noarch.drpm
texlive-marvosym-svn29349.2.2a-33.fc33_svn29349.2.2a-34.fc33.noarch.drpm
texlive-mathspec-svn42773-33.fc33_svn42773-34.fc33.noarch.drpm
texlive-mathtools-svn54516-33.fc33_svn54516-34.fc33.noarch.drpm
texlive-mdwtools-svn15878.1.05.4-33.fc33_svn15878.1.05.4-34.fc33.noarch.drpm
texlive-memoir-svn54554-33.fc33_svn54554-34.fc33.noarch.drpm
texlive-metalogo-svn18611.0.12-33.fc33_svn18611.0.12-34.fc33.noarch.drpm
texlive-mflogo-font-svn54512-33.fc33_svn54512-34.fc33.noarch.drpm
texlive-mflogo-svn42428-33.fc33_svn42428-34.fc33.noarch.drpm
texlive-mfnfss-svn46036-33.fc33_svn46036-34.fc33.noarch.drpm
texlive-microtype-svn52853-33.fc33_svn52853-34.fc33.noarch.drpm
texlive-minitoc-svn48196-33.fc33_svn48196-34.fc33.noarch.drpm
texlive-mnsymbol-svn18651.1.4-33.fc33_svn18651.1.4-34.fc33.noarch.drpm
texlive-modes-svn53604-33.fc33_svn53604-34.fc33.noarch.drpm
texlive-multido-svn18302.1.42-33.fc33_svn18302.1.42-34.fc33.noarch.drpm
texlive-natbib-svn20668.8.31b-33.fc33_svn20668.8.31b-34.fc33.noarch.drpm
texlive-ncntrsbk-svn31835.0-33.fc33_svn31835.0-34.fc33.noarch.drpm
texlive-notoccite-svn18129.0-33.fc33_svn18129.0-34.fc33.noarch.drpm
texlive-ntgclass-svn53882-33.fc33_svn53882-34.fc33.noarch.drpm
texlive-palatino-svn31835.0-33.fc33_svn31835.0-34.fc33.noarch.drpm
texlive-paralist-svn43021-33.fc33_svn43021-34.fc33.noarch.drpm
texlive-parallel-svn15878.0-33.fc33_svn15878.0-34.fc33.noarch.drpm
texlive-parskip-svn53503-33.fc33_svn53503-34.fc33.noarch.drpm
texlive-pdfescape-svn53082-33.fc33_svn53082-34.fc33.noarch.drpm
texlive-pdflscape-svn53047-33.fc33_svn53047-34.fc33.noarch.drpm
texlive-pdftexcmds-svn52913-33.fc33_svn52913-34.fc33.noarch.drpm
texlive-pgf-svn54512-33.fc33_svn54512-34.fc33.noarch.drpm
texlive-picture-svn54867-33.fc33_svn54867-34.fc33.noarch.drpm
texlive-placeins-svn19848.2.2-33.fc33_svn19848.2.2-34.fc33.noarch.drpm
texlive-plain-svn43076-33.fc33_svn43076-34.fc33.noarch.drpm
texlive-polyglossia-svn54758-33.fc33_svn54758-34.fc33.noarch.drpm
texlive-psfrag-svn15878.3.04-33.fc33_svn15878.3.04-34.fc33.noarch.drpm
texlive-pslatex-svn16416.0-33.fc33_svn16416.0-34.fc33.noarch.drpm
texlive-pspicture-svn15878.0-33.fc33_svn15878.0-34.fc33.noarch.drpm
texlive-pst-3d-svn17257.1.10-33.fc33_svn17257.1.10-34.fc33.noarch.drpm
texlive-pst-eps-svn15878.1.0-33.fc33_svn15878.1.0-34.fc33.noarch.drpm
texlive-pst-grad-svn15878.1.06-33.fc33_svn15878.1.06-34.fc33.noarch.drpm
texlive-pst-math-svn49425-33.fc33_svn49425-34.fc33.noarch.drpm
texlive-pst-node-svn54687-33.fc33_svn54687-34.fc33.noarch.drpm
texlive-pst-ovl-svn45506-33.fc33_svn45506-34.fc33.noarch.drpm
texlive-pst-plot-svn54080-33.fc33_svn54080-34.fc33.noarch.drpm
texlive-pstricks-add-svn53763-33.fc33_svn53763-34.fc33.noarch.drpm
texlive-pstricks-svn54080-33.fc33_svn54080-34.fc33.noarch.drpm
texlive-pxfonts-svn15878.0-33.fc33_svn15878.0-34.fc33.noarch.drpm
texlive-ragged2e-svn51780-33.fc33_svn51780-34.fc33.noarch.drpm
texlive-rcs-svn15878.0-33.fc33_svn15878.0-34.fc33.noarch.drpm
texlive-refcount-svn53164-33.fc33_svn53164-34.fc33.noarch.drpm
texlive-rerunfilecheck-svn54841-33.fc33_svn54841-34.fc33.noarch.drpm
texlive-sansmathaccent-svn53628-33.fc33_svn53628-34.fc33.noarch.drpm
texlive-sansmath-svn17997.1.1-33.fc33_svn17997.1.1-34.fc33.noarch.drpm
texlive-seminar-svn34011.1.62-33.fc33_svn34011.1.62-34.fc33.noarch.drpm
texlive-sepnum-svn20186.2.0-33.fc33_svn20186.2.0-34.fc33.noarch.drpm
texlive-setspace-svn24881.6.7a-33.fc33_svn24881.6.7a-34.fc33.noarch.drpm
texlive-stringenc-svn52982-33.fc33_svn52982-34.fc33.noarch.drpm
texlive-tex-gyre-math-svn41264-33.fc33_svn41264-34.fc33.noarch.drpm
texlive-tex-gyre-svn48058-33.fc33_svn48058-34.fc33.noarch.drpm
texlive-tex-ini-files-svn40533-33.fc33_svn40533-34.fc33.noarch.drpm
texlive-texlive-msg-translations-svn54919-33.fc33_svn54919-34.fc33.noarch.drpm
texlive-textcase-svn52092-33.fc33_svn52092-34.fc33.noarch.drpm
texlive-times-svn35058.0-33.fc33_svn35058.0-34.fc33.noarch.drpm
texlive-tipa-svn29349.1.3-33.fc33_svn29349.1.3-34.fc33.noarch.drpm
texlive-tools-svn53640-33.fc33_svn53640-34.fc33.noarch.drpm
texlive-translator-svn54512-33.fc33_svn54512-34.fc33.noarch.drpm
texlive-transparent-svn52981-33.fc33_svn52981-34.fc33.noarch.drpm
texlive-txfonts-svn15878.0-33.fc33_svn15878.0-34.fc33.noarch.drpm
texlive-ucharcat-svn38907-33.fc33_svn38907-34.fc33.noarch.drpm
texlive-ucs-svn35853.2.2-33.fc33_svn35853.2.2-34.fc33.noarch.drpm
texlive-unicode-data-svn54758-33.fc33_svn54758-34.fc33.noarch.drpm
texlive-unicode-math-svn53609-33.fc33_svn53609-34.fc33.noarch.drpm
texlive-uniquecounter-svn53162-33.fc33_svn53162-34.fc33.noarch.drpm
texlive-updmap-map-svn56618-33.fc33_svn56618-34.fc33.noarch.drpm
texlive-url-svn32528.3.4-33.fc33_svn32528.3.4-34.fc33.noarch.drpm
texlive-utopia-svn15878.0-33.fc33_svn15878.0-34.fc33.noarch.drpm
texlive-wasy-svn53533-33.fc33_svn53533-34.fc33.noarch.drpm
texlive-wasysym-svn54080-33.fc33_svn54080-34.fc33.noarch.drpm
texlive-wasy-type1-svn53534-33.fc33_svn53534-34.fc33.noarch.drpm
texlive-xcolor-svn41044-33.fc33_svn41044-34.fc33.noarch.drpm
texlive-xifthen-svn38929-33.fc33_svn38929-34.fc33.noarch.drpm
texlive-xltxtra-svn49555-33.fc33_svn49555-34.fc33.noarch.drpm
texlive-xstring-svn49946-33.fc33_svn49946-34.fc33.noarch.drpm
texlive-xunicode-svn30466.0.981-33.fc33_svn30466.0.981-34.fc33.noarch.drpm
texlive-zapfchan-svn31835.0-33.fc33_svn31835.0-34.fc33.noarch.drpm
texlive-zref-svn54098-33.fc33_svn54098-34.fc33.noarch.drpm

Comment 1 Andre Robatino 2021-01-01 11:26:28 UTC
I've been seeing this for maybe a week or two. I posted to the user list at https://lists.fedoraproject.org/archives/list/users@lists.fedoraproject.org/thread/NDLSTUTYGFZXPRQWF46L25WJ4VSXW4PC/ but apparently no one else seems to notice. I wasn't even sure it was an external problem, though there is no sign of SMART or btrfs errors on my machine.

Comment 2 Andre Robatino 2021-01-02 19:36:02 UTC
The current F33 version of deltarpm is deltarpm-3.6.2-7.fc33 which was built on July 28, but this problem started appearing at most a few weeks ago, long after F33 release. I also noticed that this version of deltarpm doesn't currently appear in Bodhi (maybe Bodhi is having transient issues?).

Comment 3 JayJayJazz 2021-01-03 11:04:52 UTC
I have another small update. Another package with the md5 mismatch error:

Downloading Packages:
(1/12): pugixml-1.11-1.fc33_1.11.4-1.fc33.x86_64.drpm
/var/cache/dnf/updates-0e22a1f5a0a34771/packages/pugixml-1.11-1.fc33_1.11.4-1.fc33.x86_64.drpm: md5 mismatch of result

Comment 4 Andre Robatino 2021-01-05 14:23:49 UTC
Are the drpms in question actually corrupted? If not, and the md5 check is faulty (I think I've seen cases before where this happened on an RPM, and I had to download it manually, and the RPM was actually fine), is there a way to turn it off, so the drpm rebuild can proceed?

Comment 5 Jonathan Dieter 2021-01-05 19:59:41 UTC
Well, it looks like we're seeing the same problem that's come up before.  deltarpms work by creating a byte-for-byte replica of the original RPM, which means recompressing the data.  The problem is that libzstd has been upgraded in Fedora 33 from 1.4.5 to 1.4.7, which changes the compression output slightly.  The drpms are perfectly valid and applying them creates a perfectly valid RPM, but it's not a byte-for-byte replica of the original.

Andre, to answer your question, I don't believe there's any way to turn it off.  The problem is that the RPM's signature is no longer valid, and therefore can't be trusted.  We don't sign the deltarpms, so without the RPM signature, an attacker could theoretically create a deltarpm that generates a malicious RPM.

A temporary workaround is to downgrade libzstd to 1.4.5 on the client and then perform the update.

Kevin, are the F33 deltarpms being generated on a build server running F33?  If so, can we update libzstd on them to 1.4.7?  If not, we have to decide whether F33 deltarpms are more important than the F32 deltarpms.

Comment 6 Kevin Fenzi 2021-01-05 20:35:43 UTC
The drpms are being generated on a f32 server with libzstd-1.4.5-4.fc32.x86_64

I can update it to 1.4.7... shall I do that?

Comment 7 Andre Robatino 2021-01-05 20:47:54 UTC
zstd-1.4.7-1.fc32 was pushed to stable 2 days ago. Does that server get updates automatically?

https://bodhi.fedoraproject.org/updates/FEDORA-2020-0896207697

Comment 8 Kevin Fenzi 2021-01-05 20:50:57 UTC
It gets security updates automatically. That was not a security update.

Comment 9 Jonathan Dieter 2021-01-05 21:08:20 UTC
(In reply to Kevin Fenzi from comment #6)
> The drpms are being generated on a f32 server with
> libzstd-1.4.5-4.fc32.x86_64
> 
> I can update it to 1.4.7... shall I do that?

Yeah, if 1.4.7 is stable in F32, let's update it on the server.  Thanks so much!

Comment 10 Kevin Fenzi 2021-01-05 21:27:15 UTC
Done.

Comment 11 Jonathan Dieter 2021-01-05 22:04:13 UTC
Thanks so much!  The next set of deltarpms should apply without md5 mismatches.  I'll leave this open until I've confirmed that.

Comment 12 Andre Robatino 2021-01-06 01:28:03 UTC
In the F33 updates push that just finished, I still got md5 mismatch errors on the following drpms:

daxctl-libs-70.1-1.fc33_71.1-1.fc33.x86_64.drpm
dnf-4.4.2-1.fc33_4.5.2-1.fc33.noarch.drpm
ndctl-libs-70.1-1.fc33_71.1-1.fc33.x86_64.drpm
python3-hawkey-0.55.0-3.fc33_0.55.2-1.fc33.x86_64.drpm
libdnf-0.55.0-3.fc33_0.55.2-1.fc33.x86_64.drpm
python3-dnf-4.4.2-1.fc33_4.5.2-1.fc33.noarch.drpm
python3-libdnf-0.55.0-3.fc33_0.55.2-1.fc33.x86_64.drpm

Comment 13 Jonathan Dieter 2021-01-06 18:33:24 UTC
Given the length of time it takes to complete a push, I wouldn't be surprised if that push contained deltarpms created before Kevin's fix.  Let's wait and see what happens after tonight's push.

Comment 14 Andre Robatino 2021-01-07 01:41:39 UTC
This time just one drpm out of 8 got the md5 mismatch error.

youtube-dl-2020.12.31-1.fc33_2021.01.03-1.fc33.noarch.drpm

Comment 15 Jonathan Dieter 2021-01-07 22:06:52 UTC
It should have been none, and I've just realized why.  It's the rpm builders that need the latest libzstd, not the server where the deltarpms are generated.  The version of libzstd on the users' machines has to match that on the build servers so they compress exactly the same.  Kevin, can we update libzstd on the builders?

Comment 16 Andre Robatino 2021-01-09 01:25:17 UTC
In the latest push, 90 drpms, all rebuilt successfully.

Comment 17 Jonathan Dieter 2021-01-09 18:24:24 UTC
Woohoo!  Kevin, thanks so much for getting the builders updated!  Closing this since it looks like it's fixed.

Comment 18 Andre Robatino 2021-01-11 03:13:04 UTC
In the latest push, got an md5 mismatch error on youtube-dl-2021.01.03-1.fc33_2021.01.08-1.fc33.noarch.drpm. Maybe built before the update?

Comment 19 Andre Robatino 2021-01-11 03:15:10 UTC
Sorry, md5 mismatch error on 2 out of 2 drpms:

orca-3.38.1-1.fc33_3.38.2-1.fc33.noarch.drpm
youtube-dl-2021.01.03-1.fc33_2021.01.08-1.fc33.noarch.drpm

Comment 20 Jonathan Dieter 2021-01-11 22:29:21 UTC
It looks like orca, at least, was built before the builders were updated. I think we'll have to wait a bit longer to be sure. I'll re-open for now.  If any packages get a mismatch that were built after the ninth, then we still have a problem.

Comment 21 Andre Robatino 2021-01-12 01:38:58 UTC
Out of 18 drpms, md5 mismatch for

cinnamon-translations-4.8.2-1.fc33_4.8.3-1.fc33.noarch.drpm
mint-y-icons-1.4.6-1.fc33_1.5.0-1.fc33.noarch.drpm

Comment 22 Andre Robatino 2021-01-17 02:07:28 UTC
Out of 16 drpms, I got an md5 mismatch for selinux-policy-targeted-3.14.6-33.fc33_3.14.6-34.fc33.noarch.drpm but I recall seeing this long before with certain selinux packagess (maybe just this one), so it may be an unrelated issue. All other drpms in this and the several previous pushes were okay - I'm only posting when I see a mismatch.

Comment 23 Andre Robatino 2021-01-20 01:58:46 UTC
Got an md5 mismatch for youtube-dl-2021.01.08-1.fc33_2021.01.16-1.fc33.noarch.drpm (only drpm in my latest update).

Comment 24 Jonathan Dieter 2021-01-24 17:54:38 UTC
selinux-policy-targeted seems to always have an md5 mismatch, and I'm not sure what the issue is with youtube-dl, but it seems that most drpms are rebuilding successfully, so our original problem seems to be fixed.  I'm going to close this as fixed.  Please reopen if we see most drpms failing in an update.  Please open a new ticket if it's just one (like selinux-policy-targeted).

Comment 25 Andre Robatino 2021-02-10 02:16:22 UTC
latest F33 update, out of 11 drpms, md5 mismatch for

NetworkManager-adsl-1.26.4-1.fc33_1.26.6-1.fc33.x86_64.drpm
NetworkManager-bluetooth-1.26.4-1.fc33_1.26.6-1.fc33.x86_64.drpm
NetworkManager-ovs-1.26.4-1.fc33_1.26.6-1.fc33.x86_64.drpm
NetworkManager-ppp-1.26.4-1.fc33_1.26.6-1.fc33.x86_64.drpm
NetworkManager-team-1.26.4-1.fc33_1.26.6-1.fc33.x86_64.drpm
NetworkManager-wwan-1.26.4-1.fc33_1.26.6-1.fc33.x86_64.drpm
NetworkManager-wifi-1.26.4-1.fc33_1.26.6-1.fc33.x86_64.drpm
NetworkManager-libnm-1.26.4-1.fc33_1.26.6-1.fc33.x86_64.drpm

Comment 26 Andre Robatino 2021-02-14 01:36:16 UTC
Latest F33 update push, out of 12 drpms, md5 mismatch for

kernel-5.10.14-200.fc33_5.10.15-200.fc33.x86_64.drpm
kernel-devel-5.10.14-200.fc33_5.10.15-200.fc33.x86_64.drpm
youtube-dl-2021.02.04.1-1.fc33_2021.02.10-1.fc33.noarch.drpm

The drpm for youtube-dl does not always fail, a few updates ago I got a successful one. AFAIK this is the first mismatch I've seen for kernel drpms.

Comment 27 Andre Robatino 2021-05-21 12:21:59 UTC
Recently I've been seeing a lot of md5 mismatch errors on F34, and checking I see that zstd was updated again, 4 days ago, for F32, F33, and F34. Do the builders need to be updated again?

Comment 28 Jonathan Dieter 2021-05-21 12:42:38 UTC
Yep, we're tracking this in #1873876.

*** This bug has been marked as a duplicate of bug 1873876 ***


Note You need to log in before you can comment on or make changes to this bug.