Bug 1271704 - RHEV-H upgrade from 3.5.4 to 3.5.5 failed, because vdsm not stopped
RHEV-H upgrade from 3.5.4 to 3.5.5 failed, because vdsm not stopped
Product: vdsm
Classification: oVirt
Component: Core (Show other bugs)
All Linux
urgent Severity high (vote)
: ---
: ---
Assigned To: Dan Kenigsberg
Aharon Canan
: 1271706 (view as bug list)
Depends On:
  Show dependency treegraph
Reported: 2015-10-14 10:08 EDT by Artyom
Modified: 2016-02-10 15:20 EST (History)
6 users (show)

See Also:
Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
Last Closed: 2015-11-23 08:36:02 EST
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
Verified Versions:
Category: ---
oVirt Team: SLA
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---
rule-engine: planning_ack?
rule-engine: devel_ack?
rule-engine: testing_ack?

Attachments (Terms of Use)
sos report (6.17 MB, application/x-xz)
2015-10-14 10:08 EDT, Artyom
no flags Details

  None (edit)
Description Artyom 2015-10-14 10:08:22 EDT
Created attachment 1082836 [details]
sos report

Description of problem:
RHEV-H upgrade from 3.5.4 to 3.5.5 failed, because vdsm not stopped

Version-Release number of selected component (if applicable):
Red Hat Enterprise Virtualization Hypervisor release 7.1 (20150911.0.el7ev)

How reproducible:

Steps to Reproduce:
1. Install rhev-hypervisor7-7.1-20150911.0.el7ev(https://brewweb.devel.redhat.com/buildinfo?buildID=456370) on two hosts
2. Deploy hosted-engine on both environments(not sure if it connect)
3. Put host without engine vm to maintenance, and try to upgrade host to rhev-hypervisor7-7.1-20151013.0.el7ev(https://brewweb.devel.redhat.com/buildinfo?buildID=460832)

Actual results:
Upgrade fail with error message under ovirt-node-upgrade.log
2015-10-14 07:42:39,705 - DEBUG    - ovirt-node-upgrade - Failed to stop vdsdm: Error:  ServiceOperationError: _systemctlStop failed
Job for vdsmd.service canceled.

2015-10-14 07:42:39,705 - ERROR    - ovirt-node-upgrade - Error: Upgrade Failed: Command Failed: '('/usr/libexec/ovirt-node/hooks/pre-upgrade/01-vdsm',)' [u'/usr/libexec/ovirt-node/hooks/pre-upgrade/01-vdsm: Stopping vdsmd to upgrade']
Traceback (most recent call last):
  File "/usr/sbin/ovirt-node-upgrade", line 365, in run
  File "/usr/sbin/ovirt-node-upgrade", line 197, in _run_hooks
  File "/usr/sbin/ovirt-node-upgrade", line 145, in _system
    raise RuntimeError("Command Failed: '%s' %s" % (command, output))
RuntimeError: Command Failed: '('/usr/libexec/ovirt-node/hooks/pre-upgrade/01-vdsm',)' [u'/usr/libexec/ovirt-node/hooks/pre-upgrade/01-vdsm: Stopping vdsmd to upgrade']

Expected results:
Upgrade succeed

Additional info:
The same problem exist in RHEV-H 6.7
Comment 1 Oved Ourfali 2015-10-15 00:58:08 EDT
*** Bug 1271706 has been marked as a duplicate of this bug. ***
Comment 2 Oved Ourfali 2015-10-15 03:08:57 EDT
After discussing offline with Fabian, moving to SLA for examination.
Comment 3 Fabian Deutsch 2015-11-23 06:57:11 EST
Raising the priority

Can someone tell from the vdsm logs what failed while shutting down vdsm?
Comment 4 Fabian Deutsch 2015-11-23 08:08:02 EST
Raising the priority even more, because it's blocking the RHEV-M upgrade flow.
Comment 5 Doron Fediuck 2015-11-23 08:36:02 EST
Currently we have 3.5.7 in the works and no similar reports.
Please re-open if you can reproduce on 3.5.7.

Note You need to log in before you can comment on or make changes to this bug.