Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1503517

Summary: OSP12 deployments with ceph nodes fail with: "stderr_lines": ["Error response from daemon: No such container: ceph-mon-controller-1"], "stdout": "", "stdout_lines": []}
Product: Red Hat OpenStack Reporter: Marius Cornea <mcornea>
Component: rhosp-directorAssignee: Sébastien Han <shan>
Status: CLOSED CURRENTRELEASE QA Contact: Yogev Rabl <yrabl>
Severity: urgent Docs Contact: Derek <dcadzow>
Priority: urgent    
Version: 12.0 (Pike)CC: dbecker, gfidente, jefbrown, johfulto, jomurphy, jschluet, kdreyer, mburns, morazi, pgrist, rhel-osp-director-maint, sasha, scohen, shan, tvignaud
Target Milestone: gaKeywords: Triaged
Target Release: 12.0 (Pike)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 1503598 (view as bug list) Environment:
Last Closed: 2017-10-30 10:24:47 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1503598    
Bug Blocks:    
Attachments:
Description Flags
ceph-install-workflow.log none

Description Marius Cornea 2017-10-18 11:04:18 UTC
Created attachment 1340123 [details]
ceph-install-workflow.log

Description of problem:
OSP11 -> OSP12 upgrade: major-upgrade-composable-steps-docker fails on deployments with ceph nodes: "stderr_lines": ["Error response from daemon: No such container: ceph-mon-controller-1"], "stdout": "", "stdout_lines": []}

This issue is happening with the latest puddle: 2017-10-17.2

Version-Release number of selected component (if applicable):
ceph-ansible-3.0.2-1.el7cp.noarch

How reproducible:
100%

Steps to Reproduce:
1. Deploy OSP11 with 3 ctrl, 2 computes, 3 ceph nodes
2. Upgrade to OSP11

Actual results:
Upgrade fails while running the ceph-ansible playbooks

Expected results:
Upgrade succeeds.

Additional info:
Attaching /var/log/mistral/ceph-install-workflow.log

Comment 1 Giulio Fidente 2017-10-18 11:55:23 UTC
Looks like ceph-mon@controller-1 failed with:

docker[449322]: common_functions.sh: line 3: disk_list.sh: No such file or directory

Sebastien, not sure if you can help figure what is going on?

Comment 2 Marius Cornea 2017-10-18 12:07:15 UTC
This is not particular to upgrades, it shows up for fresh deployments as well.

Comment 3 Marius Cornea 2017-10-18 12:39:21 UTC
(undercloud) [stack@undercloud-0 ~]$ docker run docker-registry.engineering.redhat.com/ceph/rhceph-2-rhel7:latest ls
common_functions.sh: line 3: disk_list.sh: No such file or directory

Looks like disk_list.sh is missing from image.

Comment 5 Jon Schlueter 2017-10-18 12:47:42 UTC
the image in question is from rhceph-rhel7-docker-2.4-3 build

Comment 9 Jon Schlueter 2017-10-19 14:12:20 UTC
the broken ceph container is no longer a candidate to be released. rhceph-rhel7-docker-2.4-3 .

this bug can be closed now but a follow up bug needs opened to address OSP 12 integration of ceph2 containers with ceph-ansible-3.0.2 or later targeted for OSP 12

Comment 10 Giulio Fidente 2017-10-30 10:24:47 UTC
(In reply to Jon Schlueter from comment #9)
> the broken ceph container is no longer a candidate to be released.
> rhceph-rhel7-docker-2.4-3 .
> 
> this bug can be closed now but a follow up bug needs opened to address OSP
> 12 integration of ceph2 containers with ceph-ansible-3.0.2 or later targeted
> for OSP 12

ceph-ansible >= 3.0.6, starting from puddle 2017-10-29.1 we include 3.0.7 which works with ceph2 images