The glusterd2-containers has failed every night since the first manually triggered build. [1] The failure has been with the same error always. [2] If possible, I'd like to get shell access to the builder to debug the failure. [1]: https://build.gluster.org/job/glusterd2-containers/buildTimeTrend [2]: https://build.gluster.org/job/glusterd2-containers/19/console
Huh, okay, this is weird, so the build has been passing the last couple of days. I have no idea why. But this makes me suspect that a Fedora package was broken for a couple of weeks and it's now fixed.
Packages updated on 23rd. None of these, as far as I can see should have made a difference for buildah. cups-libs-2.2.6-23.fc28.x86_64 Sun 23 Sep 2018 02:30:56 PM UTC kernel-headers-4.18.9-200.fc28.x86_64 Sun 23 Sep 2018 02:30:55 PM UTC vim-minimal-8.1.408-1.fc28.x86_64 Sun 23 Sep 2018 02:30:54 PM UTC libmodulemd-1.6.4-1.fc28.x86_64 Sun 23 Sep 2018 02:30:54 PM UTC kernel-4.18.9-200.fc28.x86_64 Sun 23 Sep 2018 02:30:54 PM UTC openssl-devel-1.1.0i-1.fc28.x86_64 Sun 23 Sep 2018 02:30:53 PM UTC vim-enhanced-8.1.408-1.fc28.x86_64 Sun 23 Sep 2018 02:30:52 PM UTC NetworkManager-1.10.12-1.fc28.x86_64 Sun 23 Sep 2018 02:30:52 PM UTC vim-common-8.1.408-1.fc28.x86_64 Sun 23 Sep 2018 02:30:51 PM UTC NetworkManager-libnm-1.10.12-1.fc28.x86_64 Sun 23 Sep 2018 02:30:51 PM UTC vim-filesystem-8.1.408-1.fc28.noarch Sun 23 Sep 2018 02:30:48 PM UTC openssl-pkcs11-0.4.8-2.fc28.x86_64 Sun 23 Sep 2018 02:30:48 PM UTC openssl-libs-1.1.0i-1.fc28.x86_64 Sun 23 Sep 2018 02:30:48 PM UTC openssl-1.1.0i-1.fc28.x86_64 Sun 23 Sep 2018 02:30:48 PM UTC kernel-modules-4.18.9-200.fc28.x86_64 Sun 23 Sep 2018 02:30:43 PM UTC kernel-core-4.18.9-200.fc28.x86_64 Sun 23 Sep 2018 02:30:39 PM UTC
The mystery of why this failed until today and what changed continues. The uptime is greater than any of these dates. So the kernel changes should not have had an impact.
Is it because of glusterfs' fix? https://review.gluster.org/21299
Nope. The failures were permission errors from buildah. Way before it touched anything glusterfs.