Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1660652

Summary: Agent 'ocf:ovn:ovndb-servers' is not installed or does not provide valid metadata: input/output error
Product: Red Hat OpenStack Reporter: Robin Cernin <rcernin>
Component: puppet-ovnAssignee: Russell Bryant <rbryant>
Status: CLOSED CURRENTRELEASE QA Contact: Udi Shkalim <ushkalim>
Severity: medium Docs Contact:
Priority: medium    
Version: 13.0 (Queens)CC: ekuris, ggrimaux, lmartins, mweetman, nalmond, nusiddiq, panburaj, rcernin
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-03-12 09:38:33 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Robin Cernin 2018-12-18 23:07:24 UTC
Description of problem:

           "+ puppet apply --verbose --detailed-exitcodes --summarize --color=false --modulepath /etc/puppet/modules:/opt/stack/puppet-modules:/usr/share/openstack-puppet/modules --tags file,file_line,concat,augeas,pacemaker::resource::bundle,pacemaker::property,pacemaker::resource::ip,pacemaker::resource::ocf,pacemaker::constraint::order,pacemaker::constraint::colocation -e 'include ::tripleo::profile::base::pacemaker;include ::tripleo::profile::pacemaker::ovn_dbs_bundle'", 
            "Failed to get D-Bus connection: Operation not permitted", 
            "ovs-vsctl: unix:/var/run/openvswitch/db.sock: database connection failed (No such file or directory)", 
            "Warning: Undefined variable 'deploy_config_name'; ", 
            "   (file & line not available)", 
            "Error: pcs -f /var/lib/pacemaker/cib/puppet-cib-backup20181204-8-9s8q7h create failed: Error: Agent 'ocf:ovn:ovndb-servers' is not installed or does not provide valid metadata: Metadata query for ocf:ovn:ovndb-servers failed: Input/output error, use --force to override", 
            "Error: /Stage[main]/Tripleo::Profile::Pacemaker::Ovn_dbs_bundle/Pacemaker::Resource::Ocf[ovndb_servers]/Pcmk_resource[ovndb_servers]/ensure: change from absent to present failed: pcs -f /var/lib/pacemaker/cib/puppet-cib-backup20181204-8-9s8q7h create failed: Error: Agent 'ocf:ovn:ovndb-servers' is not installed or does not provide valid metadata: Metadata query for ocf:ovn:ovndb-servers failed: Input/output error, use --force to override", 
            "Warning: /Stage[main]/Tripleo::Profile::Pacemaker::Ovn_dbs_bundle/Pacemaker::Constraint::Colocation[ip-192.168.21.99-with-ovndb_servers]/Pcmk_constraint[colo-ip-192.168.21.99-ovn-dbs-bundle]: Skipping because of failed dependencies", 

Agent 'ocf:ovn:ovndb-servers' is not installed or does not provide valid metadata: Metadata query for ocf:ovn:ovndb-servers failed: Input/output error, use --force to override", 

I can see this refers to ovndb_servers resource:
  Resource: ovndb_servers (class=ocf provider=ovn type=ovndb-servers)

Which is in OCF
# ls -l /usr/lib/ocf/resource.d/ovn/ovndb-servers 
lrwxrwxrwx. 1 root root 48 Jun 21 16:18 /usr/lib/ocf/resource.d/ovn/ovndb-servers -> /usr/share/openvswitch/scripts/ovndb-servers.ocf

Which is owned by ovn-common package

# rpm -qf /usr/lib/ocf/resource.d/ovn/ovndb-servers
openvswitch-ovn-common-2.9.0-19.el7fdp.1.x86_64

The package is present in our environment

$ grep openvswitch installed-rpms                                                                                                                                         
openstack-neutron-openvswitch-12.0.3-2.el7ost.noarch        Thu Sep  6 04:25:48 2018
openvswitch-2.9.0-54.el7fdp.x86_64                          Thu Sep  6 04:25:20 2018
openvswitch-ovn-central-2.9.0-54.el7fdp.x86_64              Thu Sep  6 04:25:46 2018
openvswitch-ovn-common-2.9.0-54.el7fdp.x86_64               Thu Sep  6 04:25:20 2018
openvswitch-ovn-host-2.9.0-54.el7fdp.x86_64                 Thu Sep  6 04:25:47 2018
openvswitch-selinux-extra-policy-1.0-5.el7fdp.noarch        Thu Sep  6 04:25:18 2018
python-openvswitch-2.9.0-54.el7fdp.noarch                   Thu Sep  6 04:18:02 2018

How reproducible:

Deploy OSP13 with OVN DVR HA

Actual results:

Deployment failed because of the OVN agents missing 

Error: Agent 'ocf:ovn:ovndb-servers' is not installed or does not provide valid metadata: Metadata query for ocf:ovn:ovndb-servers failed: Input/output error, use --force to override", 
            "Error: /Stage[main]/Tripleo::Profile::Pacemaker::Ovn_dbs_bundle/Pacemaker::Resource::Ocf[ovndb_servers]/Pcmk_resource[ovndb_servers]/ensure: change from absent to present failed: pcs -f /var/lib/pacemaker/cib/puppet-cib-backup20181204-8-9s8q7h create failed: Error: Agent 'ocf:ovn:ovndb-servers' is not installed or does not provide valid metadata: Metadata query for ocf:ovn:ovndb-servers failed: Input/output error, use --force to override", 

Expected results:


Additional info:

Comment 14 Lukas Bezdicka 2019-05-07 12:37:15 UTC
*** Bug 1601302 has been marked as a duplicate of this bug. ***