Bug 2002608 - Migration of unmounted PVC fails during "StageBackup" phase
Summary: Migration of unmounted PVC fails during "StageBackup" phase
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Migration Toolkit for Containers
Classification: Red Hat
Component: Controller
Version: 1.6.0
Hardware: Unspecified
OS: Unspecified
unspecified
medium
Target Milestone: ---
: 1.6.0
Assignee: John Matthews
QA Contact: Xin jiang
Avital Pinnick
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-09-09 10:49 UTC by Xin jiang
Modified: 2021-09-29 14:36 UTC (History)
6 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-09-29 14:36:19 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHSA-2021:3694 0 None None None 2021-09-29 14:36:26 UTC

Description Xin jiang 2021-09-09 10:49:42 UTC
Description of problem:
When migrating a PVC that is not attached by any pod, the cutover process is stuck at Waiting for all Stage Pods to start


Version-Release number of selected component (if applicable):
MTC 1.6.0 
openshift-migration-operator-metadata-container-v1.6.0-20

Source:
AWS OCP 3.11 + MTC 1.5.1

Target:
AWS OCP 4.6 + MTC 1.6.0

How reproducible:
Always


Steps to Reproduce:
1. In source cluster create a PVC using default storageclass, and request 1Gi
$ oc new-project ocp-41815-notattachedanalyticwarn

$ cat <<EOF | oc create -f -
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
  namespace: ocp-41815-notattachedanalyticwarn
  name: test-data
spec:
  accessModes:
  - ReadWriteOnce
  resources:
    requests:
      storage: 1Gi
EOF

2. 2. Create a job that will deploy a pod to use this volume
and create 3 files of 200M each

 cat <<EOF | oc create -f -
apiVersion:  batch/v1
kind: Job
metadata:
  labels:
    app: analytic-warn-test
  name: analytic-warn-test
  namespace: ocp-41815-notattachedanalyticwarn
spec:
  replicas:  1
  template:
    metadata:
      labels:
        app: analytic-warn-test
    spec:
      restartPolicy: OnFailure
      containers:
      - name: podtest
        imagePullPolicy: Always
        image: quay.io/openshifttest/alpine
        command: [ "/bin/sh", "-c", "--" ]
        args:
        - dd if=/dev/zero of=/data/test/file_1 bs=20M count=10;
          dd if=/dev/zero of=/data/test/file_2 bs=20M count=10;
          dd if=/dev/zero of=/data/test/file_3 bs=20M count=10;
          echo "Files created";
        restartPolicy: Never
        volumeMounts:
        - name: testvolume
          mountPath: /data/test
      volumes:
      - name: testvolume
        persistentVolumeClaim:
          claimName: test-data
EOF

3. Create a migration plan for this namespace with IDVM, IDIM
report a warning on UI:
Failed to compute PV resizing data for the following volumes. PV resizing will be disabled for these volumes and the migration may fail if the volumes are full or their requested and actual capacities differ in the source cluster. Please ensure that the volumes are attached to one or more running Pods for PV resizing to work correctly: [test-data]



4. Execute cutover


Actual results:
The process is stuck at StageBackup(Waiting for all Stage Pods to start.)


Expected results:
The process should finish successfully

Additional info:
Logs from controller pod:
{"level":"info","ts":1631180571.455342,"logger":"migration","msg":"Waiting for Stage Pods to be ready on source cluster","migMigration":"migration-d9264","phase":"StagePodsCreated"}
{"level":"info","ts":1631180574.4648843,"logger":"migration","msg":"[RUN] (Step 24/48) Waiting for all Stage Pods to start.","migMigration":"migration-d9264","phase":"StagePodsCreated"}
{"level":"info","ts":1631180574.4649167,"logger":"migration","msg":"Checking health of Stage Pods on source cluster.","migMigration":"migration-d9264","phase":"StagePodsCreated"}
{"level":"info","ts":1631180574.5018363,"logger":"migration","msg":"Waiting for Stage Pods to be ready on source cluster","migMigration":"migration-d9264","phase":"StagePodsCreated"}

Comment 1 Jaydip Gabani 2021-09-10 17:18:30 UTC
Similar to https://bugzilla.redhat.com/show_bug.cgi?id=2002420, and https://bugzilla.redhat.com/show_bug.cgi?id=2001829, and should be resolved with the respective changes made to solve the aforementioned BZ.

This bug should not exists anymore with the merging of the PR - https://github.com/konveyor/mig-controller/pull/1198

This PR cherry-pick the changes in the release branch - https://github.com/konveyor/mig-controller/pull/1199

Changing the status to MODIFIED

Comment 6 Prasad Joshi 2021-09-17 05:59:29 UTC
Verified with MTC 1.6.0

oc get migmigration -n openshift-migration -o yaml
status:
    conditions:
    - category: Advisory
      durable: true
      lastTransitionTime: "2021-09-17T05:51:09Z"
      message: The migration has completed successfully.
      reason: Completed
      status: "True"
      type: Succeeded
    itinerary: Final
    observedDigest: 737ddfd3e9959e6cfb17cdd54a4ad7ae7125cab5fe60bd209a8816de14c57a7a
    phase: Completed

image: registry.redhat.io/rhmtc/openshift-migration-controller-rhel8@sha256:3b5efa9c8197fe0313a2ab7eb184d135ba9749c9a4f0d15a6abb11c0d18b9194

Comment 8 errata-xmlrpc 2021-09-29 14:36:19 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: Migration Toolkit for Containers (MTC) 1.6.0 security & bugfix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2021:3694


Note You need to log in before you can comment on or make changes to this bug.