Created attachment 1041172 [details] controller logs Packstack liberty delorean trunk install https://prod-rdojenkins.rhcloud.com/view/RDO-Liberty-Delorean-Trunk/job/khaleesi-rdo-liberty-delorean-centos-7.0-aio-packstack-neutron-ml2-vxlan-rabbitmq-permissive-tempest-rpm-minimal/10/ Description of problem: [0;36mDebug: /Stage[main]/Main/Cinder::Type[iscsi]/Exec[cinder type-create iscsi]/unless: WARNING:keystoneclient.auth.identity.base:Failed to contact the endpoint at http://172.31.50.129:8776/v1/a665023a4cb34bf99dd3b42c44fc441f for discovery. Fallback to using that endpoint as the base url.[0m [0;36mDebug: /Stage[main]/Main/Cinder::Type[iscsi]/Exec[cinder type-create iscsi]/unless: WARNING:keystoneclient.auth.identity.base:Failed to contact the endpoint at http://172.31.50.129:8776/v1/a665023a4cb34bf99dd3b42c44fc441f for discovery. Fallback to using that endpoint as the base url.[0m [0;36mDebug: /Stage[main]/Main/Cinder::Type[iscsi]/Exec[cinder type-create iscsi]/unless: WARNING:keystoneclient.auth.identity.base:Failed to contact the endpoint at http://172.31.50.129:8776/v1/a665023a4cb34bf99dd3b42c44fc441f for discovery. Fallback to using that endpoint as the base url.[0m [0;36mDebug: /Stage[main]/Main/Cinder::Type[iscsi]/Exec[cinder type-create iscsi]/unless: WARNING:keystoneclient.auth.identity.base:Failed to contact the endpoint at http://172.31.50.129:8776/v1/a665023a4cb34bf99dd3b42c44fc441f for discovery. Fallback to using that endpoint as the base url.[0m [0;36mDebug: /Stage[main]/Main/Cinder::Type[iscsi]/Exec[cinder type-create iscsi]/unless: ERROR: Unable to establish connection to http://172.31.50.129:8776/v1/a665023a4cb34bf99dd3b42c44fc441f/types[0m [0;36mDebug: Exec[cinder type-create iscsi](provider=posix): Executing 'cinder type-create iscsi'[0m [0;36mDebug: Executing 'cinder type-create iscsi'[0m [mNotice: /Stage[main]/Main/Cinder::Type[iscsi]/Exec[cinder type-create iscsi]/returns: WARNING:keystoneclient.auth.identity.base:Failed to contact the endpoint at http://172.31.50.129:8776/v1/a665023a4cb34bf99dd3b42c44fc441f for discovery. Fallback to using that endpoint as the base url.[0m [mNotice: /Stage[main]/Main/Cinder::Type[iscsi]/Exec[cinder type-create iscsi]/returns: WARNING:keystoneclient.auth.identity.base:Failed to contact the endpoint at http://172.31.50.129:8776/v1/a665023a4cb34bf99dd3b42c44fc441f for discovery. Fallback to using that endpoint as the base url.[0m [mNotice: /Stage[main]/Main/Cinder::Type[iscsi]/Exec[cinder type-create iscsi]/returns: WARNING:keystoneclient.auth.identity.base:Failed to contact the endpoint at http://172.31.50.129:8776/v1/a665023a4cb34bf99dd3b42c44fc441f for discovery. Fallback to using that endpoint as the base url.[0m [mNotice: /Stage[main]/Main/Cinder::Type[iscsi]/Exec[cinder type-create iscsi]/returns: WARNING:keystoneclient.auth.identity.base:Failed to contact the endpoint at http://172.31.50.129:8776/v1/a665023a4cb34bf99dd3b42c44fc441f for discovery. Fallback to using that endpoint as the base url.[0m [mNotice: /Stage[main]/Main/Cinder::Type[iscsi]/Exec[cinder type-create iscsi]/returns: ERROR: Unable to establish connection to http://172.31.50.129:8776/v1/a665023a4cb34bf99dd3b42c44fc441f/types[0m [1;31mError: cinder type-create iscsi returned 1 instead of one of [0][0m [1;31mError: /Stage[main]/Main/Cinder::Type[iscsi]/Exec[cinder type-create iscsi]/returns: change from notrun to 0 failed: cinder type-create iscsi returned 1 instead of one of [0][0m [mNotice: /Stage[main]/Main/Cinder::Type[iscsi]/Cinder::Type_set[lvm]/Exec[cinder type-key iscsi set volume_backend_name=lvm]: Dependency Exec[cinder type-create iscsi] has failures: true[0m [1;31mWarning: /Stage[main]/Main/Cinder::Type[iscsi]/Cinder::Type_set[lvm]/Exec[cinder type-key iscsi set volume_backend_name=lvm]: Skipping because of failed dependencies[0m [0;36mDebug: Executing '/usr/bin/systemctl is-act
Looking at the logs, I find the following in /var/log/messages: Jun 22 01:01:59 rdo-pksk-02n8t-rhos-ci-12-controller systemd: Unit openstack-cinder-api.service entered failed state. Jun 22 01:02:00 rdo-pksk-02n8t-rhos-ci-12-controller cinder-backup: Traceback (most recent call last): Jun 22 01:02:00 rdo-pksk-02n8t-rhos-ci-12-controller cinder-backup: File "/usr/bin/cinder-backup", line 6, in <module> Jun 22 01:02:00 rdo-pksk-02n8t-rhos-ci-12-controller cinder-backup: from cinder.cmd.backup import main Jun 22 01:02:00 rdo-pksk-02n8t-rhos-ci-12-controller cinder-backup: File "/usr/lib/python2.7/site-packages/cinder/cmd/backup.py", line 36, in <module> Jun 22 01:02:00 rdo-pksk-02n8t-rhos-ci-12-controller cinder-backup: from cinder.openstack.common.report import guru_meditation_report as gmr Jun 22 01:02:00 rdo-pksk-02n8t-rhos-ci-12-controller cinder-backup: File "/usr/lib/python2.7/site-packages/cinder/openstack/common/report/guru_meditation_report.py", line 62, in <module> Jun 22 01:02:00 rdo-pksk-02n8t-rhos-ci-12-controller cinder-backup: from cinder.openstack.common.report.generators import process as prgen Jun 22 01:02:00 rdo-pksk-02n8t-rhos-ci-12-controller cinder-backup: File "/usr/lib/python2.7/site-packages/cinder/openstack/common/report/generators/process.py", line 23, in <module> Jun 22 01:02:00 rdo-pksk-02n8t-rhos-ci-12-controller cinder-backup: import psutil Jun 22 01:02:00 rdo-pksk-02n8t-rhos-ci-12-controller cinder-backup: ImportError: No module named psutil So it is a missing dependency, introduced by https://review.openstack.org/192883
Proposed https://review.gerrithub.io/237202 as a fix
This bug was accidentally moved from POST to MODIFIED via an error in automation, please see mmccune with any questions
This bug is against a Version which has reached End of Life. If it's still present in supported release (http://releases.openstack.org), please update Version and reopen.