Bug 2222184
| Summary: | upgrade failed from odf 4.13.1 to 4.14 due to NON_EXISTING_ROOT_KEY in noobaa-core and CSI_ENABLE_TOPOLOGY not found in rook-ceph-operator | ||
|---|---|---|---|
| Product: | [Red Hat Storage] Red Hat OpenShift Data Foundation | Reporter: | Vijay Avuthu <vavuthu> |
| Component: | Multi-Cloud Object Gateway | Assignee: | Liran Mauda <lmauda> |
| Status: | ASSIGNED --- | QA Contact: | Vijay Avuthu <vavuthu> |
| Severity: | urgent | Docs Contact: | |
| Priority: | unspecified | ||
| Version: | 4.14 | CC: | kramdoss, muagarwa, nbecker, odf-bz-bot |
| Target Milestone: | --- | Keywords: | Automation, Regression |
| Target Release: | ODF 4.14.0 | Flags: | nbecker:
needinfo?
(vavuthu) |
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | Type: | Bug | |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
|
Description
Vijay Avuthu
2023-07-12 07:31:26 UTC
> noobaa-core-0 pod log
Jul-12 7:28:57.433 [Upgrade/20] [ERROR] core.server.system_services.system_store:: SystemStore: load failed Error: NON_EXISTING_ROOT_KEY
at MasterKeysManager.load_root_key (/root/node_modules/noobaa-core/src/server/system_services/master_key_manager.js:64:40)
at /root/node_modules/noobaa-core/src/server/system_services/system_store.js:414:41
at Semaphore.surround (/root/node_modules/noobaa-core/src/util/semaphore.js:71:90)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
Jul-12 7:28:57.433 [Upgrade/20] [ERROR] core.server.system_services.system_store:: SystemStore: load failed Error: NON_EXISTING_ROOT_KEY
at MasterKeysManager.load_root_key (/root/node_modules/noobaa-core/src/server/system_services/master_key_manager.js:64:40)
at /root/node_modules/noobaa-core/src/server/system_services/system_store.js:414:41
at Semaphore.surround (/root/node_modules/noobaa-core/src/util/semaphore.js:71:90)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
Jul-12 7:28:57.434 [Upgrade/20] [ERROR] UPGRADE:: failed to load system store!! Error: NON_EXISTING_ROOT_KEY
at MasterKeysManager.load_root_key (/root/node_modules/noobaa-core/src/server/system_services/master_key_manager.js:64:40)
at /root/node_modules/noobaa-core/src/server/system_services/system_store.js:414:41
at Semaphore.surround (/root/node_modules/noobaa-core/src/util/semaphore.js:71:90)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
Jul-12 7:28:57.434 [Upgrade/20] [ERROR] UPGRADE:: failed to init upgrade process!!
upgrade_manager failed with exit code 1
noobaa_init.sh finished
noobaa_init failed with exit code 1. aborting
We looked at the setup and found the version mismatch error "Storage cluster version (4.13.1) is higher than the OCS Operator version (4.13.0)" This is due to the PR merged a few days ago https://github.com/red-hat-storage/ocs-operator/pull/2089. We need to update the downstream docker file to use the pkg's updated path while using the ldflags to update the version. We already notified Boris. He will make a fix in the downstream docker file. It will solve the rook issue. for the noobaa issue, someone needs to take a look from the noobaa team. I am moving it to the noobaa component. |