Description of problem: Deploying latest OSP16.1, Manila share fails to start (from Pacemaker): Error: error checking path "/etc/ganesha": stat /etc/ganesha: no such file or directory Version-Release number of selected component (if applicable): ceph-ansible-4.0.49.3-1.el8cp.noarch openstack-tripleo-heat-templates-11.3.2-1.20210408163453.el8ost.noarch podman images REPOSITORY TAG IMAGE ID CREATED SIZE registry.redhat.io/rhosp-rhel8/openstack-nova-libvirt 16.1 7d28320262e0 3 weeks ago 1.94 GB registry.redhat.io/rhosp-rhel8/openstack-nova-compute 16.1 ff29bb401db4 3 weeks ago 1.94 GB registry.redhat.io/rhosp-rhel8/openstack-nova-api 16.1 3652747793d5 3 weeks ago 1.13 GB registry.redhat.io/rhceph/rhceph-4-rhel8 latest de2d5658e265 4 weeks ago 935 MB registry.redhat.io/rhosp-rhel8/openstack-nova-scheduler 16.1 0041a5392372 5 weeks ago 1.26 GB registry.redhat.io/rhosp-rhel8/openstack-neutron-server-ovn 16.1 64ab2f68aa08 5 weeks ago 1.1 GB registry.redhat.io/rhosp-rhel8/openstack-swift-container 16.1 360c2e6ee947 5 weeks ago 694 MB registry.redhat.io/rhosp-rhel8/openstack-cinder-api 16.1 5e768045199a 5 weeks ago 1.12 GB registry.redhat.io/rhosp-rhel8/openstack-manila-api 16.1 fa1fc4d988aa 5 weeks ago 850 MB registry.redhat.io/rhosp-rhel8/openstack-swift-object 16.1 23cc5e2fcd98 5 weeks ago 694 MB registry.redhat.io/rhosp-rhel8/openstack-octavia-api 16.1 986134ace62c 5 weeks ago 1.07 GB registry.redhat.io/rhosp-rhel8/openstack-neutron-metadata-agent-ovn 16.1 4e96f0b02137 5 weeks ago 1.07 GB registry.redhat.io/rhosp-rhel8/openstack-keystone 16.1 4b20f28c30d8 5 weeks ago 736 MB registry.redhat.io/rhosp-rhel8/openstack-cinder-volume 16.1 1f142adb00cc 5 weeks ago 1.17 GB cluster.common.tag/openstack-cinder-volume pcmklatest 1f142adb00cc 5 weeks ago 1.17 GB registry.redhat.io/rhosp-rhel8/openstack-nova-novncproxy 16.1 35358136ae39 5 weeks ago 1.1 GB registry.redhat.io/rhosp-rhel8/openstack-swift-proxy-server 16.1 a041aec762b7 5 weeks ago 740 MB registry.redhat.io/rhosp-rhel8/openstack-glance-api 16.1 4ea113ec9492 5 weeks ago 972 MB registry.redhat.io/rhosp-rhel8/openstack-cinder-scheduler 16.1 d37efb2c7f10 5 weeks ago 1.04 GB cluster.common.tag/openstack-manila-share pcmklatest 775270a9e426 5 weeks ago 1.05 GB registry.redhat.io/rhosp-rhel8/openstack-manila-share 16.1 775270a9e426 5 weeks ago 1.05 GB registry.redhat.io/rhosp-rhel8/openstack-octavia-housekeeping 16.1 cb09650aa50f 5 weeks ago 863 MB registry.redhat.io/rhosp-rhel8/openstack-octavia-worker 16.1 09a3823211d4 5 weeks ago 863 MB registry.redhat.io/rhosp-rhel8/openstack-manila-scheduler 16.1 d6b26a098183 5 weeks ago 798 MB registry.redhat.io/rhosp-rhel8/openstack-octavia-health-manager 16.1 c8dbdbe7a61c 5 weeks ago 863 MB registry.redhat.io/rhosp-rhel8/openstack-swift-account 16.1 117662aea80f 5 weeks ago 694 MB registry.redhat.io/rhosp-rhel8/openstack-ovn-controller 16.1 9fb0adf56245 5 weeks ago 639 MB cluster.common.tag/openstack-ovn-northd pcmklatest 82e2453a2826 5 weeks ago 752 MB registry.redhat.io/rhosp-rhel8/openstack-ovn-northd 16.1 82e2453a2826 5 weeks ago 752 MB registry.redhat.io/rhosp-rhel8/openstack-nova-conductor 16.1 a75dd65f4bea 5 weeks ago 1.04 GB cluster.common.tag/openstack-redis pcmklatest 0270e88deb5d 5 weeks ago 525 MB registry.redhat.io/rhosp-rhel8/openstack-redis 16.1 0270e88deb5d 5 weeks ago 525 MB registry.redhat.io/rhosp-rhel8/openstack-horizon 16.1 6542971a177d 5 weeks ago 833 MB registry.redhat.io/rhosp-rhel8/openstack-placement-api 16.1 a620b9e4ee91 5 weeks ago 696 MB registry.redhat.io/rhosp-rhel8/openstack-rabbitmq 16.1 6c0a100bdc45 5 weeks ago 567 MB cluster.common.tag/openstack-rabbitmq pcmklatest 6c0a100bdc45 5 weeks ago 567 MB cluster.common.tag/openstack-haproxy pcmklatest 2002e9ff0d79 5 weeks ago 523 MB registry.redhat.io/rhosp-rhel8/openstack-haproxy 16.1 2002e9ff0d79 5 weeks ago 523 MB registry.redhat.io/rhosp-rhel8/openstack-cron 16.1 179e13cbedc3 5 weeks ago 390 MB registry.redhat.io/rhosp-rhel8/openstack-memcached 16.1 4a78c35e8104 5 weeks ago 411 MB registry.redhat.io/rhosp-rhel8/openstack-iscsid 16.1 0861f24db7d9 5 weeks ago 395 MB cluster.common.tag/openstack-mariadb pcmklatest 8966b4d1c7e5 5 weeks ago 718 MB registry.redhat.io/rhosp-rhel8/openstack-mariadb 16.1 8966b4d1c7e5 5 weeks ago 718 MB How reproducible: Deploy Manila with OSP 16.1 (latest), check Manila share container status with pacemaker: pcs status the container failed to start.
My command used to deploy: #!/bin/bash # This file is managed by ansible set -xeo pipefail export DEPLOY_CONTROL_VIP=192.168.24.2 export DEPLOY_DEPLOYMENT_USER=stack export DEPLOY_LOCAL_IP=192.168.24.1 export DEPLOY_NETWORKS_FILE=/usr/share/openstack-tripleo-heat-templates/network_data_undercloud.yaml export DEPLOY_OUTPUT_DIR=/home/stack export DEPLOY_PUBLIC_VIP=XXXX export DEPLOY_ROLES_FILE=/home/stack/tripleo_standalone_role.yaml export DEPLOY_STACK=standalone export DEPLOY_STANDALONE_ROLE=Standalone export DEPLOY_TEMPLATES=/usr/share/openstack-tripleo-heat-templates export DEPLOY_TIMEOUT_ARG=90 sudo openstack tripleo deploy --templates $DEPLOY_TEMPLATES --standalone --yes --output-dir $DEPLOY_OUTPUT_DIR --stack $DEPLOY_STACK --standalone-role $DEPLOY_STANDALONE_ROLE --timeout $DEPLOY_TIMEOUT_ARG -e /usr/share/openstack-tripleo-heat-templates/environments/standalone/standalone-tripleo.yaml -e /home/stack/containers-prepare-parameters.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/external-network-vip.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/docker-ha.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/services/neutron-ovn-dvr-ha.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/ssl/tls-endpoints-public-ip.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/ssl/enable-tls.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/ssl/inject-trust-anchor.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/ceph-ansible/ceph-mds.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/manila-cephfsganesha-config.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/services/octavia.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/ceph-ansible/ceph-ansible.yaml -e /home/stack/standalone_parameters.yaml -r $DEPLOY_ROLES_FILE -n $DEPLOY_NETWORKS_FILE --deployment-user $DEPLOY_DEPLOYMENT_USER --local-ip $DEPLOY_LOCAL_IP --control-virtual-ip $DEPLOY_CONTROL_VIP --public-virtual-ip $DEPLOY_PUBLIC_VIP --keep-running >/home/stack/standalone_deploy.log 2>&1 and in my environment: StandaloneExtraConfig: ganesha_vip: 192.168.24.2
manila-share pcs container bundle depends on ceph-nfs container bundle which depends on the corosync managed VIP. If /etc/ganesha doesn't exist, ceph-nfs (ganesha) won't come up. ceph-ansible creates /etc/ganesha (and does other prep) so that ganesha aka ceph-nfs can run successfully even though in OSP pacemaker rather than ceph-ansible is actually responsible for spawning ganesha/ceph-nfs. ceph-ansible is guided by .../ceph-ansible/group_vars/nfss.yml when it sets up /etc/ganesha and other such prep. What are the contents of /home/stack/standalone-ansible-.../ceph-ansible/group_vars/nfss.yml in your deployment?
I found the issue, https://review.opendev.org/c/openstack/tripleo-heat-templates/+/773205 was not backported to OSP 16.1, @tbarron could we please do it? Thanks
Backport proposed to OSP 16.1. Good catch, thanks Emilien and Tom!
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Red Hat OpenStack Platform 16.1.7 (Train) bug fix and enhancement advisory), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2021:3762