https://koji.fedoraproject.org/koji/taskinfo?taskID=70633086 /usr/bin/make install-recursive make[1]: Entering directory '/builddir/build/BUILD/rpm-ostree-2021.6' Making install in . make[2]: Entering directory '/builddir/build/BUILD/rpm-ostree-2021.6' /usr/bin/cargo build "--offline" --features sqlite-rpmdb-default --release Compiling libc v0.2.97 Compiling proc-macro2 v1.0.26 Compiling unicode-xid v0.2.1 Compiling syn v1.0.71 Compiling autocfg v1.0.1 Compiling pkg-config v0.3.19 Compiling cfg-if v1.0.0 Compiling serde v1.0.126 Compiling serde_derive v1.0.126 Compiling cc v1.0.66 Compiling unicode-segmentation v1.7.1 Compiling memchr v2.4.0 Compiling lazy_static v1.4.0 Compiling once_cell v1.5.2 Compiling cfg-if v0.1.10 Compiling strum v0.18.0 Compiling proc-macro-hack v0.5.19 Compiling pin-project-lite v0.2.4 Compiling version-compare v0.0.10 Compiling version_check v0.9.2 Compiling log v0.4.13 Compiling getrandom v0.1.16 Compiling futures-core v0.3.15 Compiling bitflags v1.2.1 Compiling getrandom v0.2.2 Compiling scopeguard v1.1.0 Compiling anyhow v1.0.41 Compiling futures-sink v0.3.15 Compiling futures-channel v0.3.15 Compiling proc-macro-nested v0.1.7 Compiling futures-task v0.3.15 Compiling futures-io v0.3.15 Compiling slab v0.4.2 Compiling pin-utils v0.1.0 Compiling smallvec v1.6.1 Compiling either v1.6.1 Compiling itoa v0.4.7 Compiling bytes v1.0.1 Compiling ppv-lite86 v0.2.10 Compiling ryu v1.0.5 Compiling siphasher v0.3.3 Compiling ahash v0.4.7 Compiling openssl v0.10.35 Compiling regex-syntax v0.6.22 Compiling foreign-types-shared v0.1.1 Compiling fnv v1.0.7 Compiling matches v0.1.8 Compiling scratch v1.0.0 Compiling const_fn v0.4.5 Compiling serde_json v1.0.64 Compiling tinyvec_macros v0.1.0 Compiling unicode-width v0.1.8 Compiling strum v0.20.0 Compiling termcolor v1.1.2 Compiling version-compare v0.0.11 Compiling native-tls v0.2.7 Compiling httparse v1.4.1 Compiling openssl-probe v0.1.4 Compiling cxxbridge-flags v1.0.49 Compiling try-lock v0.2.3 Compiling percent-encoding v2.1.0 Compiling build-env v0.3.0 Compiling encoding_rs v0.8.28 Compiling httpdate v1.0.1 Compiling gio v0.9.1 Compiling tower-service v0.3.1 Compiling ref-cast v1.0.6 Compiling crc32fast v1.2.1 Compiling rayon-core v1.9.1 Compiling ansi_term v0.11.0 Compiling camino v1.0.4 Compiling strsim v0.8.0 Compiling arrayref v0.3.6 Compiling vec_map v0.8.2 Compiling byteorder v1.4.3 Compiling linked-hash-map v0.5.4 Compiling curl v0.4.38 Compiling remove_dir_all v0.5.3 Compiling hex v0.4.3 Compiling ipnet v2.3.0 Compiling mime v0.3.16 Compiling foreign-types-shared v0.3.0 Compiling number_prefix v0.3.0 Compiling base64 v0.13.0 Compiling humantime v2.1.0 Compiling unindent v0.1.7 Compiling ansi_term v0.12.1 Compiling xml-rs v0.8.3 Compiling utf8-cstr v0.1.6 Compiling dtoa v0.4.7 Compiling c_utf8 v0.1.0 Compiling maplit v1.0.2 Compiling paste v1.0.5 Compiling instant v0.1.9 Compiling unicode-bidi v0.3.5 Compiling tracing-core v0.1.18 Compiling sharded-slab v0.1.1 Compiling os-release v0.1.0 Compiling foreign-types v0.3.2 Compiling lock_api v0.4.4 Compiling tinyvec v1.2.0 Compiling thread_local v1.1.3 Compiling itertools v0.10.0 Compiling itertools v0.9.0 Compiling phf_shared v0.8.0 Compiling phf_shared v0.9.0 Compiling textwrap v0.11.0 Compiling hashbrown v0.9.1 Compiling form_urlencoded v1.0.1 Compiling cfg-expr v0.7.4 Compiling radix64 v0.6.2 Compiling codespan-reporting v0.11.0 Compiling http v0.2.4 Compiling yaml-rust v0.4.5 Compiling heck v0.3.2 Compiling cmake v0.1.45 Compiling indoc v1.0.3 Compiling proc-macro-error-attr v1.0.4 Compiling proc-macro-error v1.0.4 Compiling nom v5.1.2 Compiling want v0.3.0 Compiling tracing-log v0.1.2 Compiling futures-macro v0.3.15 Compiling futures-util v0.3.15 Compiling tokio v1.7.1 Compiling crossbeam-utils v0.8.1 Compiling indexmap v1.6.2 Compiling memoffset v0.6.1 Compiling num-traits v0.2.14 Compiling num-integer v0.1.44 Compiling rayon v1.5.1 Compiling aho-corasick v0.7.15 Compiling cstr-argument v0.1.1 Compiling quote v1.0.8 Compiling libsystemd-sys v0.9.0 Compiling unicode-normalization v0.1.19 Compiling crossbeam-channel v0.5.0 Compiling crossbeam-epoch v0.9.1 Compiling crossbeam-deque v0.8.0 Compiling openssl-sys v0.9.65 Compiling libz-sys v1.1.2 Compiling link-cplusplus v1.0.5 Compiling cxx v1.0.49 Compiling curl-sys v0.4.44+curl-7.77.0 Compiling http-body v0.4.2 Compiling regex v1.4.3 Compiling regex-automata v0.1.9 Compiling idna v0.2.3 Compiling num_cpus v1.13.0 Compiling parking_lot_core v0.8.3 Compiling signal-hook-registry v1.3.0 Compiling mio v0.7.11 Compiling socket2 v0.4.0 Compiling atty v0.2.14 Compiling terminal_size v0.1.16 Compiling xattr v0.2.2 Compiling filetime v0.2.14 Compiling nix v0.20.0 Compiling time v0.1.44 Compiling openat v0.1.21 Compiling memfd v0.4.0 Compiling subprocess v0.2.7 Compiling clap v2.33.3 Compiling flate2 v1.0.20 Compiling rand_core v0.6.1 Compiling rand_core v0.5.1 Compiling tar v0.4.33 Compiling parking_lot v0.11.1 Compiling rand_pcg v0.2.1 Compiling rand_chacha v0.2.2 Compiling rand_chacha v0.3.0 Compiling rand v0.7.3 Compiling rand v0.8.4 Compiling url v2.2.2 Compiling matchers v0.0.1 Compiling iso8601 v0.4.0 Compiling console v0.14.0 Compiling env_logger v0.8.4 Compiling tempfile v3.2.0 Compiling dlv-list v0.2.2 Compiling indicatif v0.15.0 Compiling phf_generator v0.9.0 Compiling phf_generator v0.8.0 Compiling ordered-multimap v0.3.1 Compiling rust-ini v0.17.0 Compiling cxx-build v1.0.49 Compiling openat-ext v0.2.1 Compiling thiserror-impl v1.0.23 Compiling strum_macros v0.18.0 Compiling tokio-macros v1.2.0 Compiling tracing-attributes v0.1.15 Compiling strum_macros v0.20.1 Compiling ref-cast-impl v1.0.6 Compiling phf_macros v0.8.0 Compiling cxxbridge-macro v1.0.49 Compiling gvariant-macro v0.4.0 Compiling foreign-types-macros v0.2.1 Compiling structopt-derive v0.4.14 Compiling phf_macros v0.9.0 Compiling fn-error-context v0.1.2 Compiling gvariant v0.4.0 Compiling foreign-types v0.5.0 Compiling systemd v0.9.0 Compiling phf v0.9.0 Compiling phf v0.8.0 Compiling thiserror v1.0.23 Compiling envsubst v0.2.0 Compiling tracing v0.1.26 Compiling structopt v0.3.21 Compiling futures-executor v0.3.15 Compiling futures v0.3.15 Compiling tokio-util v0.6.7 Compiling tokio-native-tls v0.3.0 Compiling tokio-stream v0.1.6 Compiling h2 v0.3.3 Compiling toml v0.5.8 Compiling serde_urlencoded v0.7.0 Compiling chrono v0.4.19 Compiling tracing-serde v0.1.2 Compiling serde_yaml v0.8.17 Compiling cjson v0.1.1 Compiling tracing-subscriber v0.2.18 Compiling rpmostree-client v0.1.0 (/builddir/build/BUILD/rpm-ostree-2021.6/rust/rpmostree-client) Compiling system-deps v1.3.2 Compiling proc-macro-crate v0.1.5 Compiling system-deps v3.1.1 Compiling hyper v0.14.9 Compiling glib-sys v0.10.1 Compiling gobject-sys v0.10.0 Compiling gio-sys v0.10.1 Compiling ostree-sys v0.7.3 Compiling glib-macros v0.10.1 Compiling libdnf-sys v0.1.0 (/builddir/build/BUILD/rpm-ostree-2021.6/rust/libdnf-sys) Compiling rpmostree-rust v0.1.0 (/builddir/build/BUILD/rpm-ostree-2021.6) Compiling glib v0.10.3 Compiling hyper-tls v0.5.0 Compiling reqwest v0.11.3 Compiling xmlrpc v0.15.0 Compiling ostree v0.11.0 Compiling ostree-ext v0.1.3 LLVM ERROR: out of memory Allocation failed error: could not compile `rpmostree-rust` Caused by: process didn't exit successfully: `rustc --crate-name rpm_ostree --edition=2018 rust/src/main.rs --error-format=json --json=diagnostic-rendered-ansi --crate-type bin --emit=dep-info,link -C opt-level=3 -C panic=abort -C lto -C debuginfo=2 --cfg 'feature="default"' --cfg 'feature="sqlite-rpmdb-default"' -C metadata=1bc3157f068ff15f -C extra-filename=-1bc3157f068ff15f --out-dir /builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps -L dependency=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps --extern anyhow=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libanyhow-665c342a6aed2a9c.rlib --extern c_utf8=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libc_utf8-79ca299bcf4e6bb6.rlib --extern camino=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libcamino-c72a653df10b9aa0.rlib --extern chrono=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libchrono-fbeb95e3a2d92b41.rlib --extern clap=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libclap-7fbeb48638c71dab.rlib --extern curl=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libcurl-35a081bd23abdbc8.rlib --extern cxx=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libcxx-1bd58fdde481852e.rlib --extern env_logger=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libenv_logger-e282344d8f383706.rlib --extern envsubst=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libenvsubst-17a64085f785f3e6.rlib --extern fn_error_context=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libfn_error_context-a9f05d3f59c2b9a6.so --extern futures=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libfutures-a0a0527675f38643.rlib --extern gio=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libgio-3c9941f6947956c6.rlib --extern gio_sys=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libgio_sys-f482237b77c170ea.rlib --extern glib=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libglib-4f1201f646d4087f.rlib --extern glib_sys=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libglib_sys-70276fe52a48313a.rlib --extern gobject_sys=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libgobject_sys-636e93c7b133b103.rlib --extern indicatif=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libindicatif-fdcb5232a9546818.rlib --extern indoc=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libindoc-bcdc1a555bea58b6.so --extern lazy_static=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/liblazy_static-88ac92082a136a12.rlib --extern libc=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/liblibc-77a165df9f5325e8.rlib --extern libdnf_sys=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/liblibdnf_sys-4963e49a4ff834ec.rlib --extern maplit=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libmaplit-fee1bd48d64c70a9.rlib --extern memfd=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libmemfd-73c76ed8d7e26309.rlib --extern nix=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libnix-1eb4f951a3410268.rlib --extern openat=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libopenat-7fd52f16b66e5214.rlib --extern openat_ext=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libopenat_ext-f434c63c0e41cd55.rlib --extern os_release=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libos_release-7819e1423e714e18.rlib --extern ostree=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libostree-12fb3556654b98a3.rlib --extern ostree_ext=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libostree_ext-657013c700cef44b.rlib --extern ostree_sys=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libostree_sys-40756194c724a0de.rlib --extern paste=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libpaste-f4fd0db4826977eb.so --extern phf=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libphf-e77b2ed44a389aac.rlib --extern rand=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/librand-0970689f32ed6442.rlib --extern rayon=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/librayon-1fcf9274db8be831.rlib --extern rpmostree_client=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/librpmostree_client-8b3fbb7bc26b42a3.rlib --extern rpmostree_rust=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/librpmostree_rust-94afb09d4b9bbcca.rlib --extern ini=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libini-481ed7b2d7971b0e.rlib --extern serde=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libserde-b81f5a723deaeb9e.rlib --extern serde_derive=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libserde_derive-04b9d47f9f6e71f7.so --extern serde_json=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libserde_json-c7812dc60eea7bb9.rlib --extern serde_yaml=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libserde_yaml-7bacb5c8514876c2.rlib --extern structopt=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libstructopt-a893e409b9259d6d.rlib --extern subprocess=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libsubprocess-b99fe097f8c7b572.rlib --extern systemd=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libsystemd-991b9279407d8f91.rlib --extern tempfile=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libtempfile-6f7dfd78c006ddc2.rlib --extern tokio=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libtokio-6a27570e4506a1f7.rlib --extern tracing=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libtracing-6670f25bee49e202.rlib --extern tracing_subscriber=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libtracing_subscriber-c1069fafc7596e81.rlib --extern xmlrpc=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/deps/libxmlrpc-96ebf4a9a1503651.rlib -L /builddir/build/BUILD/rpm-ostree-2021.6/.libs --cfg system_deps_have_jsonglib --cfg system_deps_have_libarchive --cfg system_deps_have_rpm --cfg system_deps_have_libcurl --cfg system_deps_have_polkitgobject --cfg 'feature="fedora-integration"' -L native=/usr/lib -L native=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/build/cxx-8452231bc68f4cf6/out -L native=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/build/link-cplusplus-a38ab07f76a1fd0a/out -L native=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/build/libdnf-sys-f250628eb3b0b613/out/build/libdnf -L native=/builddir/build/BUILD/rpm-ostree-2021.6/target/release/build/libdnf-sys-f250628eb3b0b613/out -L native=/usr/lib` (signal: 6, SIGABRT: process abort signal) make[2]: *** [Makefile:4754: cargo-build] Error 101 make[2]: Leaving directory '/builddir/build/BUILD/rpm-ostree-2021.6' make[1]: *** [Makefile:3790: install-recursive] Error 1 make[1]: Leaving directory '/builddir/build/BUILD/rpm-ostree-2021.6' make: *** [Makefile:4295: install] Error 2 error: Bad exit status from /var/tmp/rpm-tmp.rTM41K (%install) RPM build errors: Bad exit status from /var/tmp/rpm-tmp.rTM41K (%install) Child return code was: 1 EXCEPTION: [Error()] Traceback (most recent call last): File "/usr/lib/python3.9/site-packages/mockbuild/trace_decorator.py", line 93, in trace result = func(*args, **kw) File "/usr/lib/python3.9/site-packages/mockbuild/util.py", line 600, in do_with_status raise exception.Error("Command failed: \n # %s\n%s" % (command, output), child.returncode) mockbuild.exception.Error: Command failed: # bash --login -c /usr/bin/rpmbuild -bb --target i686 --nodeps /builddir/build/SPECS/rpm-ostree.spec
xrefs: - https://bugzilla.redhat.com/show_bug.cgi?id=1966949 - https://github.com/rust-lang/rust/issues/60294#issuecomment-524571687
This f34 build failed with the same error: https://koji.fedoraproject.org/koji/taskinfo?taskID=70635251 Previous successful build: https://koji.fedoraproject.org/koji/buildinfo?buildID=1773587 - rust-1.52.1-2.fc34.i686 llvm-libs-12.0.0-2.fc34.i686 Failed build: - rust-1.53.0-1.fc34.i686 llvm-libs-12.0.0-2.fc34.i686 I'm going to need to set up a reproducer environment to confirm it's rust 1.53 that triggered this, or whether it's something else.
After some excitement around i686/Fedora/podman/seccomp in https://bugzilla.redhat.com/show_bug.cgi?id=1958474 I am reproducing the OOM in a local podman container with rust-1.53.0-1.fc34.i686. I see rustc RES slowly growing from 2g to 2.5g to 3.3g and up until OOM. I think this is the linking/LTO phase. But, downgrading to rust-1.52.1-2.fc34.i686 still fails.
It could simply be that we're building more Rust code (hmm, perhaps a good bit more now that we pull in hyper) and that pushed us over the edge. I have verified that disabling LTO fixes it.
https://src.fedoraproject.org/rpms/rpm-ostree/c/f5f08e67231ae0e560b5cc1c844c48b3f7b33cb4?branch=rawhide and followup fixed it.