Bug 1370129 – PV recycler image fails to start

Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.

Bug 1370129 - PV recycler image fails to start

Summary:	PV recycler image fails to start

Status:	CLOSED ERRATA

Aliases:	None

Product:	OpenShift Container Platform
Classification:	Red Hat
Component:	Storage (Show other bugs)
Sub Component:
Version:	3.3.0
Hardware:	Unspecified Unspecified

Priority	unspecified Severity unspecified
Target Milestone:	---
Target Release:	---
Assigned To:	Bradley Childs
QA Contact:	Jianwei Hou
Docs Contact:

URL:
Whiteboard:
Keywords:

Depends On:
Blocks:
	Show dependency tree / graph

Reported:	2016-08-25 07:44 EDT by Tomas Schlosser
Modified:	2016-09-27 05:46 EDT (History)
CC List:	3 users (show)

See Also:
Fixed In Version:
Doc Type:	If docs needed, set a value
Doc Text:
Story Points:	---
Clone Of:
Environment:
Last Closed:	2016-09-27 05:46:06 EDT
Type:	Bug
Regression:	---
Mount Type:	---
Documentation:	---
CRM:
Verified Versions:
Category:	---
oVirt Team:	---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---

Attachments	(Terms of Use)
Add an attachment (proposed patch, testcase, etc.)

External Trackers
Tracker	ID	Priority	Status	Summary	Last Updated
Red Hat Product Errata	RHBA-2016:1933	normal	SHIPPED_LIVE	Red Hat OpenShift Container Platform 3.3 Release Advisory	2016-09-27 09:24:36 EDT

Groups: None (edit)

Description Tomas Schlosser 2016-08-25 07:44:01 EDT

Description of problem:
When PVC is deleted, the PV is not recycled and ends up in 'Failed' state.

Version-Release number of selected component (if applicable):
atomic-openshift-3.3.0.23-1.git.0.f3689d5.el7.x86_64
image - openshift3/ose-recycler:v3.3.0.23

Steps to Reproduce:
1. create PVC (you can use 'oc new-app --template=mysql-persistent)
2. let it bind to PV
3. delete PVC (oc delete pvc mysql)

Actual results:
PV ends up in failed state and recycler pod is stuck in openshift-infra project.

Expected results:
PV is scrubbed and returned to the pool.

Additional info:
Upon deletion, recycler pod is created, but fails:
recycler-for-vol08 0/1 RunContainerError 0 12s

Upon further investigation, there is a binary missing apparently:
recycler-for-vol08 Pod spec.containers{pv-recycler} Warning Failed {kubelet node1.devel.xpaas} Failed to start container with docker id b3a4a676947c with error: Error response from daemon: Container command not found or does not exist.

Running it through docker says the same thing:
$ docker run --rm openshift3/ose-recycler:v3.3.0.23
exec: "/usr/bin/openshift-recycle": stat /usr/bin/openshift-recycle: no such file or directory
docker: Error response from daemon: Container command not found or does not exist..

And listing everything in /usr/bin does not find any match for recycle:
$ docker run --rm --entrypoint=/usr/bin/ls openshift3/ose-recycler:v3.3.0.23 /usr/bin | grep recycle

In previous version (v3.2.1.13 - latest released), the binary was found, but it's name was just recycle, not openshift-recycle.

Comment 1 Eric Paris 2016-08-25 08:23:44 EDT

There was a problem with the builds until 3.3.0.25 where the recycle container was not being properly created. This is resolved.

Comment 2 Tomas Schlosser 2016-08-25 08:37:03 EDT

Thanks for looking into this! I have verified that the new image works and PVs are scrubbed and available as expected.

Comment 4 errata-xmlrpc 2016-09-27 05:46:06 EDT

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:1933

Note You need to log in before you can comment on or make changes to this bug.