Bug 2219766

Summary: Systemd service garbd starts before network has come up
Product: Red Hat Enterprise Linux 8 Reporter: Henrik Rasmussen <her>
Component: galeraAssignee: Michal Schorm <mschorm>
Status: NEW --- QA Contact: RHEL CS Apps Subsystem QE <rhel-cs-apps-subsystem-qe>
Severity: low Docs Contact:
Priority: unspecified    
Version: 8.5CC: hhorak
Target Milestone: rc   
Target Release: ---   
Hardware: Unspecified   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: ---
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Henrik Rasmussen 2023-07-05 09:23:37 UTC 
Description of problem:

Systemd service garbd startes right after reboot, but with no delay, thus before the network connection has been established. This results in a garbd-wrapper DNS lookup failure.

Version-Release number of selected component (if applicable): Linux version 4.18.0-477.15.1.el8_8.x86_64 (mockbuild.eng.rdu2.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-18) (GCC)) #1 SMP Fri Jun 2 08:27:19 EDT 2023

How reproducible: Right after startup

Steps to Reproduce:
1. Reboot the server
2. Systemd service garbd starts
3. Systemd service garbd fails

Actual results:
# last
reboot   system boot  4.18.0-477.15.1. Wed Jul  5 09:41   still running

# dmesg
[Wed Jul  5 09:41:21 2023] XFS (sda1): Mounting V5 Filesystem
[Wed Jul  5 09:41:23 2023] XFS (sda1): Ending clean mount
[Wed Jul  5 09:41:23 2023] NET: Registered protocol family 40
[Wed Jul  5 09:41:28 2023] IPv6: ADDRCONF(NETDEV_UP): ens192: link is not ready
[Wed Jul  5 09:41:28 2023] vmxnet3 0000:0b:00.0 ens192: intr type 3, mode 0, 3 vectors allocated
[Wed Jul  5 09:41:28 2023] vmxnet3 0000:0b:00.0 ens192: NIC Link is Up 10000 Mbps

# journalctl -u garbd
-- Logs begin at Wed 2023-07-05 09:41:11 CEST, end at Wed 2023-07-05 11:01:01 CEST. --
Jul 05 09:41:24 ngcmsarb01pl.unicph.domain systemd[1]: Started Galera Arbitrator Daemon.
Jul 05 09:41:24 ngcmsarb01pl.unicph.domain garbd-wrapper[863]: Ncat: Could not resolve hostname "ngcmsdb01pl": Name or service not known. QUITTING.
Jul 05 09:41:24 ngcmsarb01pl.unicph.domain garbd-wrapper[881]: Ncat: You must specify a host to connect to. QUITTING.
Jul 05 09:41:24 ngcmsarb01pl.unicph.domain garbd-wrapper[847]: None of the nodes in GALERA_NODES is accessible
Jul 05 09:41:25 ngcmsarb01pl.unicph.domain systemd[1]: garbd.service: Main process exited, code=exited, status=1/FAILURE
Jul 05 09:41:25 ngcmsarb01pl.unicph.domain systemd[1]: garbd.service: Failed with result 'exit-code'.
Jul 05 09:55:02 ngcmsarb01pl.unicph.domain systemd[1]: Started Galera Arbitrator Daemon.


Expected results:
That systemd service would wait starting up until the network connection has been establiched.

Additional info: