Bug 2031045
Summary: | [vmware-vsphere-csi-driver] failed to get VolumeID from volumeMigrationService for volumePath | ||
---|---|---|---|
Product: | OpenShift Container Platform | Reporter: | Fabio Bertinatto <fbertina> |
Component: | Storage | Assignee: | Jan Safranek <jsafrane> |
Storage sub component: | Kubernetes External Components | QA Contact: | Penghao Wang <pewang> |
Status: | CLOSED WONTFIX | Docs Contact: | |
Severity: | medium | ||
Priority: | unspecified | CC: | jsafrane, wduan |
Version: | 4.10 | ||
Target Milestone: | --- | ||
Target Release: | --- | ||
Hardware: | Unspecified | ||
OS: | Unspecified | ||
Whiteboard: | |||
Fixed In Version: | Doc Type: | If docs needed, set a value | |
Doc Text: | Story Points: | --- | |
Clone Of: | Environment: | ||
Last Closed: | 2023-01-13 11:01:08 UTC | Type: | Bug |
Regression: | --- | Mount Type: | --- |
Documentation: | --- | CRM: | |
Verified Versions: | Category: | --- | |
oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
Cloudforms Team: | --- | Target Upstream Version: | |
Embargoed: |
Description
Fabio Bertinatto
2021-12-10 11:45:56 UTC
Decrypted stack trace: sigs.k8s.io/vsphere-csi-driver/v2/pkg/csi/service/vanilla.(*controller).ControllerPublishVolume.func1 /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/pkg/csi/service/vanilla/controller.go:1026 sigs.k8s.io/vsphere-csi-driver/v2/pkg/csi/service/vanilla.(*controller).ControllerPublishVolume /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/pkg/csi/service/vanilla/controller.go:1050 github.com/container-storage-interface/spec/lib/go/csi._Controller_ControllerPublishVolume_Handler.func1 /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/vendor/github.com/container-storage-interface/spec/lib/go/csi/csi.pb.go:5632 github.com/rexray/gocsi/middleware/serialvolume.(*interceptor).controllerPublishVolume /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/vendor/github.com/rexray/gocsi/middleware/serialvolume/serial_volume_locker.go:120 github.com/rexray/gocsi/middleware/serialvolume.(*interceptor).handle /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/vendor/github.com/rexray/gocsi/middleware/serialvolume/serial_volume_locker.go:86 github.com/rexray/gocsi/utils.ChainUnaryServer.func2.1.1 /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/vendor/github.com/rexray/gocsi/utils/utils_middleware.go:99 github.com/rexray/gocsi/middleware/specvalidator.(*interceptor).handleServer.func1 /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/vendor/github.com/rexray/gocsi/middleware/specvalidator/spec_validator.go:178 github.com/rexray/gocsi/middleware/specvalidator.(*interceptor).handle /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/vendor/github.com/rexray/gocsi/middleware/specvalidator/spec_validator.go:218 github.com/rexray/gocsi/middleware/specvalidator.(*interceptor).handleServer /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/vendor/github.com/rexray/gocsi/middleware/specvalidator/spec_validator.go:177 github.com/rexray/gocsi/utils.ChainUnaryServer.func2.1.1 /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/vendor/github.com/rexray/gocsi/utils/utils_middleware.go:99 github.com/rexray/gocsi.(*StoragePlugin).injectContext /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/vendor/github.com/rexray/gocsi/middleware.go:231 github.com/rexray/gocsi/utils.ChainUnaryServer.func2.1.1 /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/vendor/github.com/rexray/gocsi/utils/utils_middleware.go:99 github.com/rexray/gocsi/utils.ChainUnaryServer.func2 /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/vendor/github.com/rexray/gocsi/utils/utils_middleware.go:106 github.com/container-storage-interface/spec/lib/go/csi._Controller_ControllerPublishVolume_Handler /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/vendor/github.com/container-storage-interface/spec/lib/go/csi/csi.pb.go:5634 google.golang.org/grpc.(*Server).processUnaryRPC /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/vendor/google.golang.org/grpc/server.go:1024 google.golang.org/grpc.(*Server).handleStream /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/vendor/google.golang.org/grpc/server.go:1313 google.golang.org/grpc.(*Server).serveStreams.func1.1 /go/src/github.com/kubernetes-sigs/vsphere-csi-driver/vendor/google.golang.org/grpc/server.go:722~ $ Tested with today's CI version, 4.12.0-0.ci-2022-10-12-173207 + CSI migration enabled, I don't any of these errors: > failed to get VolumeID from volumeMigrationService for volumePath > CnsFault error: CNS: Failed to attach disk because missing SCSI controller I saw this error when TechPreviewNoUpgrade was being applied (i.e. nodes were drained and restarted): Warning FailedAttachVolume 8m44s (x7 over 9m19s) attachdetach-controller AttachVolume.Attach failed for volume "csi.vsphere.vmware.com-[WorkloadDatastore] b4bc4663-de68-0b0e-6d89-0603566a4811/1.vmdk" : rpc error: code = Internal desc = failed to set keepAfterDeleteVm control flag for VolumeID "5b87ca09-3f72-4475-883e-995624b8710e" Normal SuccessfulAttachVolume 8m11s attachdetach-controller AttachVolume.Attach succeeded for volume "csi.vsphere.vmware.com-[WorkloadDatastore] b4bc4663-de68-0b0e-6d89-0603566a4811/1.vmdk" But it healed in ~30 seconds, I don't think it's worth debugging. I tested both in-line in-tree volumes and in-tree PVs, both running 40 Pods with 40 volumes each. I think it got fixed by a recent CSI driver rebase. Change the Target Release to 4.12.0 |