Bug 1311465

Summary: HotPlugDisk fails with "Bad volume specification" error
Product: Red Hat Enterprise Virtualization Manager Reporter: Amit Aviram <aaviram>
Component: ovirt-engineAssignee: Amit Aviram <aaviram>
Status: CLOSED INSUFFICIENT_DATA QA Contact: Aharon Canan <acanan>
Severity: high Docs Contact:
Priority: medium    
Version: 3.5.7CC: acanan, amureini, dev-unix-virtualization, gklein, lsurette, rbalakri, Rhev-m-bugs, tnisan, yeylon, ykaul, ylavi
Target Milestone: ovirt-3.6.5   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-03-21 12:20:00 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Storage RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
VDSM & Engine logs none

Description Amit Aviram 2016-02-24 10:12:45 UTC 
Created attachment 1130162 [details]
VDSM & Engine logs

Description of problem:
This bug was introduced by dev-unix-virtualization, in Bug 1249717.

Quoting from comment 9 in Bug 1249717:
Hi,
We recently hit this issue. RHEVM version is 3.5.7. We are trying to activate the disk and getting below response. I have attached the VDSM and Engine logs.

484 20c 02/17 20:03:02 108261 CVLibCurl::CVLibCurlSendHttpReq() - curl-err:[No error] http-resp:[400] url:[https://172.16.61.116/api/vms/2CBCD16F-6BC8-40FA-9722-291164CFD7B6/disks/023a8251-4109-493c-a572-ae0684b0a07b/activate] server-resp:[<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<action>
    <async>false</async>
    <detach>false</detach>
    <status>
        <state>failed</state>
    </status>
    <fault>
        <reason>Operation Failed</reason>
        <detail>[Unexpected exception]</detail>
    </fault>
</action>
] resp-size:[299]
 

Version-Release number of selected component (if applicable):
3.5.7
Comment 1 Amit Aviram 2016-02-24 10:20:09 UTC 
dev-unix-virtualization@commvault, can you please add the following info, if you have it?

How reproducible:


Steps to Reproduce:
1.
2.
3.

Thank you!
Comment 3 Amit Aviram 2016-02-24 13:24:08 UTC 
The problem in this flow is that preparing the volume path before plugging the disk fails on timeout. 
So we need to do two things here:

1. Understand what causes the timeout, and fix it if it's a bug.
2. Add a proper error message in case of prepare volume path timeout
Comment 4 Amit Aviram 2016-02-25 12:20:30 UTC 
dev-unix-virtualization@commvault, please provide full engine+vdsm logs. 
Looking at the engine's log- The error we encounter happens also at 2016-02-17 13:33:21, 2016-02-16 16:13:09, 2016-02-16 14:26:28, and maybe before.

Note, that this is not directly related to your hotplug failure, but something in the system which is faulted and makes the hotplug fail among other actions you are performing.
Comment 5 Amit Aviram 2016-02-25 15:35:07 UTC 
Seems like this is a scale issue. please also provide psql dump, to see how many items this domain contains. 
Did you try to configure VDSM to run with a single core, using the VDSM's cpu_affinity configuration? it can possibly resolve scale issues in case your host is heavily loaded.
Comment 6 Amit Aviram 2016-03-02 09:21:40 UTC 
dev-unix-virtualization@commvault, Can you please also elaborate on the environment you are using? is your storage/connectivity heavily loaded?
Comment 7 Amit Aviram 2016-03-09 13:39:00 UTC 
As the error message in this flow is vague, BUG 1316128 opened to make better error messages that explain such cases more gracefully in vm related flows like hotplug/ unplug.
Comment 8 Yaniv Lavi 2016-03-21 12:20:00 UTC 
Please reopen if you can provide the needed info.
Comment 9 Red Hat Bugzilla 2023-09-14 03:18:26 UTC 
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 1000 days