Bug 1267169 - systemd on overcloud nodes fail to start dhcp-interface@BRIDGE_NAME.services after reboot
systemd on overcloud nodes fail to start dhcp-interface@BRIDGE_NAME.services ...
Status: CLOSED NOTABUG
Product: Red Hat OpenStack
Classification: Red Hat
Component: rhosp-director (Show other bugs)
7.0 (Kilo)
All Linux
low Severity medium
: ---
: 10.0 (Newton)
Assigned To: Dan Sneddon
Shai Revivo
: Triaged
Depends On:
Blocks:
  Show dependency treegraph
 
Reported: 2015-09-29 04:31 EDT by Jaison Raju
Modified: 2016-11-01 08:25 EDT (History)
7 users (show)

See Also:
Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
Environment:
Last Closed: 2016-08-19 15:37:38 EDT
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---


Attachments (Terms of Use)
Screenshot node start (29.26 KB, image/png)
2015-09-29 04:37 EDT, Jaison Raju
no flags Details
systemd journal ifcfg (90.82 KB, application/x-bzip)
2015-09-29 04:49 EDT, Jaison Raju
no flags Details


External Trackers
Tracker ID Priority Status Summary Last Updated
Red Hat Knowledge Base (Solution) 2741461 None None None 2016-11-01 08:25 EDT

  None (edit)
Description Jaison Raju 2015-09-29 04:31:09 EDT
Description of problem:
systemd on overcloud nodes fail to dhcp-interface@BRIDGE_NAME.services after reboot .

# systemctl status dhcp-interface@br-storage.service -l
dhcp-interface@br-storage.service - DHCP interface br/storage
   Loaded: loaded (/usr/lib/systemd/system/dhcp-interface@.service; disabled)
   Active: failed (Result: exit-code) since Mon 2015-09-28 14:35:54 EDT; 16h ago
  Process: 3037 ExecStart=/sbin/ifup %I (code=exited, status=1/FAILURE)
  Process: 3034 ExecStartPre=/usr/local/sbin/dhcp-all-interfaces.sh %I (code=exited, status=0/SUCCESS)
 Main PID: 3037 (code=exited, status=1/FAILURE)

Sep 28 14:35:54 overcloud-blockstorage-2.localdomain systemd[1]: Starting DHCP interface br/storage...
Sep 28 14:35:54 overcloud-blockstorage-2.localdomain dhcp-all-interfaces.sh[3034]: cat: /sys/class/net/br/storage/addr_assign_type: No such file or directory
Sep 28 14:35:54 overcloud-blockstorage-2.localdomain dhcp-all-interfaces.sh[3034]: Inspecting interface: br/storage...Device has generated MAC, skipping.
Sep 28 14:35:54 overcloud-blockstorage-2.localdomain ifup[3037]: /sbin/ifup: configuration for br/storage not found.
Sep 28 14:35:54 overcloud-blockstorage-2.localdomain ifup[3037]: Usage: ifup <configuration>
Sep 28 14:35:54 overcloud-blockstorage-2.localdomain systemd[1]: dhcp-interface@br-storage.service: main process exited, code=exited, status=1/FAILURE
Sep 28 14:35:54 overcloud-blockstorage-2.localdomain systemd[1]: Failed to start DHCP interface br/storage.
Sep 28 14:35:54 overcloud-blockstorage-2.localdomain systemd[1]: Unit dhcp-interface@br-storage.service entered failed state.

# ls /etc/sysconfig/network-scripts/ifcfg-*
/etc/sysconfig/network-scripts/ifcfg-br-storage  /etc/sysconfig/network-scripts/ifcfg-eth1  /etc/sysconfig/network-scripts/ifcfg-vlan20
/etc/sysconfig/network-scripts/ifcfg-eth0        /etc/sysconfig/network-scripts/ifcfg-lo    /etc/sysconfig/network-scripts/ifcfg-vlan40


Version-Release number of selected component (if applicable):
RHOS 7
Director

How reproducible:
Always

Steps to Reproduce:
1. Setup overcloud nodes using templates . 
2. Reboot node
3.

Actual results:
systemd fails to start dhcp-interface@* service

Expected results:
systemd is able to start all services .

Additional info:
Comment 1 Jaison Raju 2015-09-29 04:37 EDT
Created attachment 1078232 [details]
Screenshot node start
Comment 3 Jaison Raju 2015-09-29 04:49 EDT
Created attachment 1078234 [details]
systemd journal ifcfg
Comment 4 Jaison Raju 2015-09-29 04:55:51 EDT
In the initial start of the nodes , i do not find this systemd interface services.
The following reboots cause systemd to start this bridge interfaces .

# egrep "dhcp|interface"  before_systemd_status.txt after_systemd_status.txt
after_systemd_status.txt:dhcp-interface@br-ex.service -> '/org/freedesktop/systemd1/unit/dhcp_2dinterface_40br_2dex_2eservice'
after_systemd_status.txt:dhcp-interface@br-ex.service - DHCP interface br/ex
after_systemd_status.txt:   Loaded: loaded (/usr/lib/systemd/system/dhcp-interface@.service; disabled)
after_systemd_status.txt:  Process: 1401 ExecStartPre=/usr/local/sbin/dhcp-all-interfaces.sh %I (code=exited, status=0/SUCCESS)
after_systemd_status.txt:Sep 29 04:31:54 overcloud-controller-0.localdomain dhcp-all-interfaces.sh[1401]: cat: /sys/class/net/br/ex/addr_assign_type: No such file or directory
after_systemd_status.txt:Sep 29 04:31:54 overcloud-controller-0.localdomain dhcp-all-interfaces.sh[1401]: Inspecting interface: br/ex...Device has generated MAC, skipping.
after_systemd_status.txt:Sep 29 04:32:06 overcloud-controller-0.localdomain systemd[1]: dhcp-interface@br-ex.service: main process exited, code=exited, status=1/FAILURE
after_systemd_status.txt:Sep 29 04:32:06 overcloud-controller-0.localdomain systemd[1]: Failed to start DHCP interface br/ex.
after_systemd_status.txt:Sep 29 04:32:06 overcloud-controller-0.localdomain systemd[1]: Unit dhcp-interface@br-ex.service entered failed state.

Regards,
Jaison R
Comment 6 chris alfonso 2015-09-30 12:14:06 EDT
Other than observing the services, what is the net effect or issue this causes?
Comment 7 Jaison Raju 2015-10-01 23:58:42 EDT
(In reply to chris alfonso from comment #6)
> Other than observing the services, what is the net effect or issue this
> causes?

So far no issues are noticed .
network / floating ip / glance / cinder works well .
Comment 10 Hugh Brock 2016-02-28 03:07:12 EST
Jaison, can you still observe this with 7.3?
Comment 11 Jaison Raju 2016-03-04 06:06:45 EST
(In reply to Hugh Brock from comment #10)
> Jaison, can you still observe this with 7.3?

Still noticed:
[root@overcloud-controller-0 ~]# systemctl | grep dhcp
● dhcp-interface@br-ex.service                                                             loaded failed     failed          DHCP interface br/ex
● dhcp-interface@br-int.service                                                            loaded failed     failed          DHCP interface br/int
● dhcp-interface@br-tun.service                                                            loaded failed     failed          DHCP interface br/tun
● dhcp-interface@ovs-system.service                                                        loaded failed     failed          DHCP interface ovs/system
  system-dhcp\x2dinterface.slice                                                           loaded active     active          system-dhcp\x2dinterface.slice

[root@overcloud-compute-0 ~]# systemctl | grep dhcp
● dhcp-interface@br-ex.service                                                             loaded failed failed    DHCP interface br/ex
● dhcp-interface@br-int.service                                                            loaded failed failed    DHCP interface br/int
● dhcp-interface@br-tun.service                                                            loaded failed failed    DHCP interface br/tun
  dhcp-interface@eth0.service                                                              loaded active exited    DHCP interface eth0
  dhcp-interface@eth1.service                                                              loaded active exited    DHCP interface eth1
● dhcp-interface@ovs-system.service                                                        loaded failed failed    DHCP interface ovs/system
  system-dhcp\x2dinterface.slice                                                           loaded active active    system-dhcp\x2dinterface.slice
Comment 12 Mike Burns 2016-04-07 16:50:54 EDT
This bug did not make the OSP 8.0 release.  It is being deferred to OSP 10.

Note You need to log in before you can comment on or make changes to this bug.