Bug 2054361
| Summary: | [ACM2.5 DOC-BUG] BMH Image provisioning fails: A general error has occurred. See ExtendedInfo for more information Extended information: [{'Message': 'Unable to mount remote share https://10.0.98.217:6183/redfish/ | ||
|---|---|---|---|
| Product: | Red Hat Advanced Cluster Management for Kubernetes | Reporter: | Alexander Chuzhoy <sasha> |
| Component: | Documentation | Assignee: | Christopher Dawson <cdawson> |
| Status: | ON_QA --- | QA Contact: | |
| Severity: | medium | Docs Contact: | Christopher Dawson <cdawson> |
| Priority: | medium | ||
| Version: | rhacm-2.5 | CC: | aos-bugs, derekh, janders, mdockery, ohochman, racedoro, yliu1 |
| Target Milestone: | --- | Keywords: | Reopened |
| Target Release: | rhacm-2.5 | Flags: | bot-tracker-sync:
rhacm-2.5+
|
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2022-02-17 19:36:59 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
relevant logs from events: 3m59s Normal ProvisioningStarted baremetalhost/master-1-0 Image provisioning started for https://assisted-image-service-rhacm.apps.rhos-qe.e2e.bos.redhat.com/images/d2da59f6-1908-42fe-bac2-a371f19d2fbd?api_key=eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbmZyYV9lbnZfaWQiOiJkMmRhNTlmNi0xOTA4LTQyZmUtYmFjMi1hMzcxZjE5ZDJmYmQifQ.6nqgvUsqph4CbsGO4FP9Eg4TztngEoYqz6PiTz_3zd1OB7UV1dZgsXPp1iyaPoKQ77TS3Ao5ihj7C9PA_H2S_w&arch=x86_64&type=minimal-iso&version=4.10 3m49s Normal ProvisioningError baremetalhost/master-1-0 Image provisioning failed: Deploy step deploy.deploy failed with BadRequestError: HTTP POST https://10.19.133.14/redfish/v1/Managers/iDRAC.Embedded.1/VirtualMedia/CD/Actions/VirtualMedia.InsertMedia returned code 400. Base.1.7.GeneralError: A general error has occurred. See ExtendedInfo for more information Extended information: [{'Message': 'Unable to mount remote share https://10.0.98.217:6183/redfish/boot-e9d876cf-49d2-47e9-ae52-aaa51bc95311.iso.', 'MessageArgs': ['https://10.0.98.217:6183/redfish/boot-e9d876cf-49d2-47e9-ae52-aaa51bc95311.iso'], 'MessageArgs': 1, 'MessageId': 'IDRAC.2.2.RAC0720', 'RelatedProperties': ['#/Image'], 'RelatedProperties': 1, 'Resolution': 'Retry the operation.', 'Severity': 'Informational'}]. 2m48s Normal DeprovisioningStarted baremetalhost/master-1-0 Image deprovisioning started 2m38s Normal DeprovisioningComplete baremetalhost/master-1-0 Image deprovisioning completed 80s Normal InspectionSkipped baremetalhost/master-1-0 disabled by annotation 81s Normal BMCAccessValidated baremetalhost/master-1-0 Verified access to BMC 80s Normal ProfileSet baremetalhost/master-1-0 Hardware profile set: unknown 79s Normal ProvisioningStarted baremetalhost/master-1-0 Image provisioning started for https://assisted-image-service-rhacm.apps.rhos-qe.e2e.bos.redhat.com/images/d2da59f6-1908-42fe-bac2-a371f19d2fbd?api_key=eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbmZyYV9lbnZfaWQiOiJkMmRhNTlmNi0xOTA4LTQyZmUtYmFjMi1hMzcxZjE5ZDJmYmQifQ.6nqgvUsqph4CbsGO4FP9Eg4TztngEoYqz6PiTz_3zd1OB7UV1dZgsXPp1iyaPoKQ77TS3Ao5ihj7C9PA_H2S_w&arch=x86_64&type=minimal-iso&version=4.10 69s Normal ProvisioningError baremetalhost/master-1-0 Image provisioning failed: Deploy step deploy.deploy failed with BadRequestError: HTTP POST https://10.19.133.14/redfish/v1/Managers/iDRAC.Embedded.1/VirtualMedia/CD/Actions/VirtualMedia.InsertMedia returned code 400. Base.1.7.GeneralError: A general error has occurred. See ExtendedInfo for more information Extended information: [{'Message': 'Unable to mount remote share https://10.0.98.217:6183/redfish/boot-719a983b-28bb-4cb2-baa5-7375191d8172.iso.', 'MessageArgs': ['https://10.0.98.217:6183/redfish/boot-719a983b-28bb-4cb2-baa5-7375191d8172.iso'], 'MessageArgs': 1, 'MessageId': 'IDRAC.2.2.RAC0720', 'RelatedProperties': ['#/Image'], 'RelatedProperties': 1, 'Resolution': 'Retry the operation.', 'Severity': 'Informational'}]. Could you check the iDRAC event log? Maybe it has any hints on why it does not like the ISO? I've had a look at the server in question and was able to mount vMedia from another source using RedFish queries. So the issue does not seem to lie on the BMC side this time. If possible it may be worthwhile verifying connectivity between the BMC and the image source prior to deployment. Error Message: Image provisioning failed: Deploy step deploy.deploy failed with BadRequestError: HTTP POST https://10.19.133.14/redfish/v1/Managers/iDRAC.Embedded.1/VirtualMedia/CD/Actions/VirtualMedia.InsertMedia returned code 400. Base.1.7.GeneralError: A general error has occurred. See ExtendedInfo for more information Extended information: [{'Message': 'Unable to mount remote share https://10.0.98.217:6183/redfish/boot-719a983b-28bb-4cb2-baa5-7375191d8172.iso.', 'MessageArgs': ['https://10.0.98.217:6183/redfish/boot-719a983b-28bb-4cb2-baa5-7375191d8172.iso'], 'MessageArgs': 1, 'MessageId': 'IDRAC.2.2.RAC0720', 'RelatedProperties': ['#/Image'], 'RelatedProperties': 1, 'Resolution': 'Retry the operation.', 'Severity': 'Informational'}]. According to the above error https://10.0.98.217:6183/redfish/boot-719a983b-28bb-4cb2-baa5-7375191d8172.iso is attemped to be mounted. I get "The requested URL was not found on this server." for this URL. From a quick test, there seems to be IP (icmp at least) connectivity from the BMC to the Ironic IP. he issue was related to firmware . Once the firmware was updated - the issue went away. Closing as not a bug. Thanks. re-opened switch it to DOC-BUG @sasha: Can you provide the firmware level that worked for the ACM documentation known issue? The firmware version that worked for me: 5.00.20.10 In general it would be a good idea to remind users to use the latest firmware. G2Bsync 1071316755 comment cadawson Thu, 17 Mar 2022 19:56:08 UTC G2Bsync Added content to ensure the latest firmware version of the bare metal host at: https://access.redhat.com/documentation/en-us/red_hat_advanced_cluster_management_for_kubernetes/2.4/html/clusters/managing-your-clusters#creating-a-cluster-on-bare-metal. This issue can be closed. Thanks! |
Version: 4.10.0-rc.0 Steps to reproduce: 1. Deploy non-platform hub cluster IPv4/connected. 2. Try to deploy spoke SNO cluster with it Result: The BMH fails to provision. [root@sealusa34 ~]# oc get bmh NAME STATE CONSUMER ONLINE ERROR AGE master-1-0 registering true 11s [root@sealusa34 ~]# oc get bmh NAME STATE CONSUMER ONLINE ERROR AGE master-1-0 available true 13s [root@sealusa34 ~]# oc get bmh NAME STATE CONSUMER ONLINE ERROR AGE master-1-0 provisioning true 14s [root@sealusa34 ~]# oc get bmh NAME STATE CONSUMER ONLINE ERROR AGE master-1-0 provisioning true provisioning error 25s [root@sealusa34 ~]# oc --kubeconfig ~/kubeconfig-rhos describe bmh -n qe1 master-1-0 Name: master-1-0 Namespace: qe1 Labels: infraenvs.agent-install.openshift.io=qe1 Annotations: bmac.agent-install.openshift.io/hostname: master-1-0 bmac.agent-install.openshift.io/role: master inspect.metal3.io: disabled API Version: metal3.io/v1alpha1 Kind: BareMetalHost Metadata: Creation Timestamp: 2022-02-14T19:22:02Z Finalizers: baremetalhost.metal3.io Generation: 2 Managed Fields: API Version: metal3.io/v1alpha1 Fields Type: FieldsV1 fieldsV1: f:metadata: f:annotations: .: f:bmac.agent-install.openshift.io/hostname: f:bmac.agent-install.openshift.io/role: f:inspect.metal3.io: f:labels: .: f:infraenvs.agent-install.openshift.io: f:spec: .: f:automatedCleaningMode: f:bmc: .: f:address: f:credentialsName: f:disableCertificateVerification: f:bootMACAddress: f:online: f:rootDeviceHints: .: f:deviceName: Manager: kubectl-create Operation: Update Time: 2022-02-14T19:22:02Z API Version: metal3.io/v1alpha1 Fields Type: FieldsV1 fieldsV1: f:spec: f:image: .: f:format: f:url: Manager: assisted-service Operation: Update Time: 2022-02-14T19:22:15Z API Version: metal3.io/v1alpha1 Fields Type: FieldsV1 fieldsV1: f:status: f:provisioning: f:raid: .: f:hardwareRAIDVolumes: f:softwareRAIDVolumes: f:rootDeviceHints: .: f:deviceName: Manager: baremetal-operator Operation: Update Time: 2022-02-14T19:22:15Z API Version: metal3.io/v1alpha1 Fields Type: FieldsV1 fieldsV1: f:status: f:errorCount: f:errorMessage: f:errorType: f:lastUpdated: f:operationHistory: f:provision: f:start: f:operationalStatus: f:provisioning: f:state: Manager: baremetal-operator Operation: Update Subresource: status Time: 2022-02-14T19:22:26Z Resource Version: 616297 UID: a489cfd1-fdf3-448f-87be-3dc620c30b40 Spec: Automated Cleaning Mode: disabled Bmc: Address: idrac-virtualmedia://10.19.133.14/redfish/v1/Systems/System.Embedded.1 Credentials Name: bmc-secret1 Disable Certificate Verification: true Boot MAC Address: 98:03:9b:61:7c:81 Image: Format: live-iso URL: https://assisted-image-service-rhacm.apps.rhos-qe.e2e.bos.redhat.com/images/d2da59f6-1908-42fe-bac2-a371f19d2fbd?api_key=eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbmZyYV9lbnZfaWQiOiJkMmRhNTlmNi0xOTA4LTQyZmUtYmFjMi1hMzcxZjE5ZDJmYmQifQ.6nqgvUsqph4CbsGO4FP9Eg4TztngEoYqz6PiTz_3zd1OB7UV1dZgsXPp1iyaPoKQ77TS3Ao5ihj7C9PA_H2S_w&arch=x86_64&type=minimal-iso&version=4.10 Online: true Root Device Hints: Device Name: /dev/sda Status: Error Count: 1 Error Message: Image provisioning failed: Deploy step deploy.deploy failed with BadRequestError: HTTP POST https://10.19.133.14/redfish/v1/Managers/iDRAC.Embedded.1/VirtualMedia/CD/Actions/VirtualMedia.InsertMedia returned code 400. Base.1.7.GeneralError: A general error has occurred. See ExtendedInfo for more information Extended information: [{'Message': 'Unable to mount remote share https://10.0.98.217:6183/redfish/boot-719a983b-28bb-4cb2-baa5-7375191d8172.iso.', 'MessageArgs': ['https://10.0.98.217:6183/redfish/boot-719a983b-28bb-4cb2-baa5-7375191d8172.iso'], 'MessageArgs': 1, 'MessageId': 'IDRAC.2.2.RAC0720', 'RelatedProperties': ['#/Image'], 'RelatedProperties': 1, 'Resolution': 'Retry the operation.', 'Severity': 'Informational'}]. Error Type: provisioning error Good Credentials: Credentials: Name: bmc-secret1 Namespace: qe1 Credentials Version: 615592 Hardware Profile: unknown Last Updated: 2022-02-14T19:22:26Z Operation History: Deprovision: End: <nil> Start: <nil> Inspect: End: 2022-02-14T19:22:15Z Start: 2022-02-14T19:22:15Z Provision: End: <nil> Start: 2022-02-14T19:22:15Z Register: End: 2022-02-14T19:22:15Z Start: 2022-02-14T19:22:02Z Operational Status: error Powered On: false Provisioning: ID: 719a983b-28bb-4cb2-baa5-7375191d8172 Boot Mode: UEFI Image: URL: Raid: Hardware RAID Volumes: <nil> Software RAID Volumes: Root Device Hints: Device Name: /dev/sda State: provisioning Tried Credentials: Credentials: Name: bmc-secret1 Namespace: qe1 Credentials Version: 615592 Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal BMCAccessValidated 52s metal3-baremetal-controller Verified access to BMC Normal InspectionSkipped 51s metal3-baremetal-controller disabled by annotation Normal ProfileSet 51s metal3-baremetal-controller Hardware profile set: unknown Normal ProvisioningStarted 50s metal3-baremetal-controller Image provisioning started for https://assisted-image-service-rhacm.apps.rhos-qe.e2e.bos.redhat.com/images/d2da59f6-1908-42fe-bac2-a371f19d2fbd?api_key=eyJhbGciOiJFUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbmZyYV9lbnZfaWQiOiJkMmRhNTlmNi0xOTA4LTQyZmUtYmFjMi1hMzcxZjE5ZDJmYmQifQ.6nqgvUsqph4CbsGO4FP9Eg4TztngEoYqz6PiTz_3zd1OB7UV1dZgsXPp1iyaPoKQ77TS3Ao5ihj7C9PA_H2S_w&arch=x86_64&type=minimal-iso&version=4.10 Normal ProvisioningError 40s metal3-baremetal-controller Image provisioning failed: Deploy step deploy.deploy failed with BadRequestError: HTTP POST https://10.19.133.14/redfish/v1/Managers/iDRAC.Embedded.1/VirtualMedia/CD/Actions/VirtualMedia.InsertMedia returned code 400. Base.1.7.GeneralError: A general error has occurred. See ExtendedInfo for more information Extended information: [{'Message': 'Unable to mount remote share https://10.0.98.217:6183/redfish/boot-719a983b-28bb-4cb2-baa5-7375191d8172.iso.', 'MessageArgs': ['https://10.0.98.217:6183/redfish/boot-719a983b-28bb-4cb2-baa5-7375191d8172.iso'], 'MessageArgs': 1, 'MessageId': 'IDRAC.2.2.RAC0720', 'RelatedProperties': ['#/Image'], 'RelatedProperties': 1, 'Resolution': 'Retry the operation.', 'Severity': 'Informational'}].