rubygem-staypuft: pcs status shows "neutron-server_monitor_30000 on pcmk-maca25400702875 'OCF_PENDING' (196): call=228, status=complete, last-rc-change='Tue Jan 6 16:44:44 2015', queued=0ms, exec=0ms" under failed actions. Environment: ruby193-rubygem-foreman_openstack_simplify-0.0.6-8.el7ost.noarch openstack-foreman-installer-3.0.8-1.el7ost.noarch ruby193-rubygem-staypuft-0.5.9-1.el7ost.noarch rhel-osp-installer-client-0.5.4-1.el7ost.noarch openstack-puppet-modules-2014.2.8-1.el7ost.noarch rhel-osp-installer-0.5.4-1.el7ost.noarch Steps to reproduce: 1. Install rhel-osp-installer. 2. Successfully deploy HAneutron (3 controllers + 2 computes) 3. Login to any controller and run "pcs status" Result: Failed actions: neutron-server_monitor_30000 on pcmk-maca25400702875 'OCF_PENDING' (196): call=228, status=complete, last-rc-change='Tue Jan 6 16:44:44 2015', queued=0ms, exec=0ms Full output is below: [root@maca25400702875 ~(openstack_admin)]# pcs status Cluster name: openstack Last updated: Tue Jan 6 17:15:52 2015 Last change: Tue Jan 6 16:51:38 2015 via cibadmin on pcmk-maca25400702877 Stack: corosync Current DC: pcmk-maca25400702876 (2) - partition with quorum Version: 1.1.10-32.el7_0.1-368c726 3 Nodes configured 124 Resources configured Online: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Full list of resources: ip-192.168.0.4 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702875 ip-192.168.0.3 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702876 ip-192.168.0.29 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702877 ip-192.168.0.31 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702875 ip-192.168.0.2 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702876 ip-192.168.0.32 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702877 ip-192.168.0.23 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702875 ip-192.168.0.24 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702876 ip-192.168.0.25 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702877 ip-192.168.0.36 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702875 Clone Set: memcached-clone [memcached] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: rabbitmq-server-clone [rabbitmq-server] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] ip-192.168.0.30 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702876 Clone Set: haproxy-clone [haproxy] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] ip-192.168.0.13 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702877 Master/Slave Set: galera-master [galera] Masters: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] ip-192.168.0.26 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702875 ip-192.168.0.28 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702876 ip-192.168.0.27 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702877 Clone Set: openstack-keystone-clone [openstack-keystone] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] ip-192.168.0.14 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702875 Clone Set: fs-varlibglanceimages-clone [fs-varlibglanceimages] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] ip-192.168.0.16 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702876 ip-192.168.0.15 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702877 Clone Set: openstack-glance-registry-clone [openstack-glance-registry] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: openstack-glance-api-clone [openstack-glance-api] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] ip-192.168.0.35 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702875 ip-192.168.0.33 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702876 ip-192.168.0.34 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702877 Clone Set: openstack-nova-consoleauth-clone [openstack-nova-consoleauth] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: openstack-nova-api-clone [openstack-nova-api] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: openstack-nova-novncproxy-clone [openstack-nova-novncproxy] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: openstack-nova-conductor-clone [openstack-nova-conductor] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: openstack-nova-scheduler-clone [openstack-nova-scheduler] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] ip-192.168.0.6 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702875 ip-192.168.0.5 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702876 ip-192.168.0.12 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702877 Clone Set: openstack-cinder-api-clone [openstack-cinder-api] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: openstack-cinder-scheduler-clone [openstack-cinder-scheduler] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] openstack-cinder-volume (systemd:openstack-cinder-volume): Started pcmk-maca25400702876 Clone Set: neutron-server-clone [neutron-server] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] ip-192.168.0.17 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702875 ip-192.168.0.18 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702877 ip-192.168.0.19 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702875 ip-192.168.0.20 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702876 ip-192.168.0.22 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702877 ip-192.168.0.21 (ocf::heartbeat:IPaddr2): Started pcmk-maca25400702875 Clone Set: neutron-ovs-cleanup-clone [neutron-ovs-cleanup] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: neutron-netns-cleanup-clone [neutron-netns-cleanup] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Resource Group: neutron-agents neutron-openvswitch-agent (systemd:neutron-openvswitch-agent): Started pcmk-maca25400702876 neutron-dhcp-agent (systemd:neutron-dhcp-agent): Started pcmk-maca25400702876 neutron-l3-agent (systemd:neutron-l3-agent): Started pcmk-maca25400702876 neutron-metadata-agent (systemd:neutron-metadata-agent): Started pcmk-maca25400702876 Clone Set: openstack-heat-api-clone [openstack-heat-api] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Resource Group: heat openstack-heat-engine (systemd:openstack-heat-engine): Started pcmk-maca25400702877 Clone Set: openstack-heat-api-cfn-clone [openstack-heat-api-cfn] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: httpd-clone [httpd] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: mongod-clone [mongod] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: ceilometer-delay-clone [ceilometer-delay] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] openstack-ceilometer-central (systemd:openstack-ceilometer-central): Started pcmk-maca25400702877 Clone Set: openstack-ceilometer-api-clone [openstack-ceilometer-api] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: openstack-ceilometer-alarm-notifier-clone [openstack-ceilometer-alarm-notifier] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: openstack-ceilometer-collector-clone [openstack-ceilometer-collector] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: openstack-ceilometer-notification-clone [openstack-ceilometer-notification] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: openstack-ceilometer-alarm-evaluator-clone [openstack-ceilometer-alarm-evaluator] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Clone Set: openstack-heat-api-cloudwatch-clone [openstack-heat-api-cloudwatch] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] Failed actions: neutron-server_monitor_30000 on pcmk-maca25400702875 'OCF_PENDING' (196): call=228, status=complete, last-rc-change='Tue Jan 6 16:44:44 2015', queued=0ms, exec=0ms PCSD Status: pcmk-maca25400702877: Online pcmk-maca25400702876: Online pcmk-maca25400702875: Online Daemon Status: corosync: active/enabled pacemaker: active/enabled pcsd: active/enabled Expected result: The neutron-server shouldn't appear under failed actions.
Created attachment 976976 [details] logs - controller1
Created attachment 976977 [details] logs - controller2
Created attachment 976979 [details] logs - controller3
Created attachment 976980 [details] foreman logs
This is a duplicate of bug 1174389 It's not a blocker. The service failed *at some point* but is currently running. So pacemaker correctly handled the failure. Failed message: neutron-server_monitor_30000 on pcmk-maca25400702875 But current status: Clone Set: neutron-server-clone [neutron-server] Started: [ pcmk-maca25400702875 pcmk-maca25400702876 pcmk-maca25400702877 ] *** This bug has been marked as a duplicate of bug 1174389 ***