Bug 1180377

Summary: [3.5_7.0] configure kdump fail via nfs
Product: Red Hat Enterprise Virtualization Manager Reporter: haiyang,dong <hadong>
Component: ovirt-nodeAssignee: Fabian Deutsch <fdeutsch>
Status: CLOSED CURRENTRELEASE QA Contact: Virtualization Bugs <virt-bugs>
Severity: high Docs Contact:
Priority: high    
Version: 3.5.0CC: cshao, ecohen, gklein, gouyang, hadong, huiwa, iheim, leiwang, lsurette, rbarry, ycui, ylavi
Target Milestone: ---Keywords: TestOnly
Target Release: 3.5.1   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: node
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Cause: Configuring KDump to use an NFS target Consequence: The NFS target was not used correctly in case of a coredump Fix: Result: Now the NSF target can be used again
Story Points: ---
Clone Of: Environment:
Last Closed: 2015-03-10 14:35:26 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Node RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
attached var logs for rhev-hypervisor7-7.0-20150106.0.el7ev
none
attached sosreport logs for rhev-hypervisor7-7.0-20150106.0.el7ev none

Description haiyang,dong 2015-01-09 03:23:48 UTC
Created attachment 978010 [details]
attached var logs for rhev-hypervisor7-7.0-20150106.0.el7ev

Description of problem:
After configured network,configure kdump by using nfs
but configre kdump fail by using remote kdump server nfs.

Version-Release number of selected component (if applicable):
rhev-hypervisor7-7.0-20150106.0.el7ev
ovirt-node-3.1.0-0.40.20150105git69f34a6.el7.noarch

How reproducible:
100%

Steps to Reproduce:
1.Install rhev-hypervisor7-7.0-20150106.0.el7ev
2.Configure network.
3.Configure kdump by using NFS under Kernel Dump Page.
4.Check kdump status

Actual results:
1. kdump fail to work by using remote kdump server NFS
2. After apply it,Pop:"KDump configuration failed, location unreachable. Previous configuration was restored".

Expected results:
kdump can work by using remote kdump server nfs.

Additional info:
some log info from ovirt-node.log
----------------
2015-01-09 02:59:37,097       INFO Failure while restarting kdump: Command '['service', 'kdump', 'restart']' returned non-zero exit status 1
2015-01-09 02:59:56,543       INFO Captured nothing
2015-01-09 02:59:56,544      ERROR '<type 'exceptions.RuntimeError'>' on transaction '<Transaction elements='[<BackupKdumpConfig 'Backing up config files'>, <WipeKdumpConfig 'Removing set kdump options'>, <MountNFS 'Mounting NFS volume for kdump configuration'>, <CreateNfsKdumpConfig 'Creating kdump NFS config'>, <RestartKdumpService 'Restarting kdump service'>]' title='Updating kdump related configuration' at 0x418a410>': KDump configuration failed, location unreachable. Previous configuration was restored. - KDump configuration failed, location unreachable. Previous configuration was restored.
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/ovirt/node/utils/console.py", line 136, in __run_transaction
  File "/usr/lib/python2.7/site-packages/ovirt/node/config/defaults.py", line 1264, in commit
RuntimeError: KDump configuration failed, location unreachable. Previous configuration was restored.
2015-01-09 02:59:56,546      ERROR Exception while configuring kdump
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/ovirt/node/setup/core/kdump_page.py", line 184, in on_merge
  File "/usr/lib/python2.7/site-packages/ovirt/node/utils/console.py", line 111, in run
  File "/usr/lib/python2.7/site-packages/ovirt/node/utils/console.py", line 136, in __run_transaction
  File "/usr/lib/python2.7/site-packages/ovirt/node/config/defaults.py", line 1264, in commit
RuntimeError: KDump configuration failed, location unreachable. Previous configuration was restored.
2015-01-09 02:59:56,557       INFO Changes were merged successfully

Comment 1 haiyang,dong 2015-01-09 03:26:30 UTC
Created attachment 978013 [details]
attached sosreport logs for rhev-hypervisor7-7.0-20150106.0.el7ev

Comment 2 Yaniv Lavi 2015-01-12 14:48:16 UTC
Moving to 3.5.1, since we will focus on getting local kdump to work on RHEV-H 7.
Adding flag to add release note on this for 3.5.0.

Comment 4 Fabian Deutsch 2015-03-03 09:41:03 UTC
Does this bug still exist on the 3.5-7.1 build?

Comment 5 haiyang,dong 2015-03-03 10:15:52 UTC
(In reply to Fabian Deutsch from comment #4)
> Does this bug still exist on the 3.5-7.1 build?

Test version:
ovirt-node-3.2.1-7.el7.noarch
rhev-hypervisor7-7.1-20150226.0.iso

Test Steps:
1.Install rhev-hypervisor7-7.1-20150226.0.iso
2.Configure network.
3.Configure kdump by using NFS under Kernel Dump Page.
4.Check kdump status

Test results:
1. kdump fail to work by using remote kdump server NFS
2. After apply it,Pop:"KDump configuration failed, location unreachable. Previous configuration was restored".

Some logs from ovirt-node.log
-------------
2015-03-03 10:10:11,933    WARNING File "/etc/fstab" had already been persisted
2015-03-03 10:10:11,937       INFO Captured nothing
2015-03-03 10:10:12,156       INFO Captured nothing
2015-03-03 10:10:14,776       INFO Failure while restarting kdump: Command '['kdumpctl', 'restart']' returned non-zero exit status 1
2015-03-03 10:10:47,234       INFO Captured nothing
2015-03-03 10:10:47,236      ERROR '<type 'exceptions.RuntimeError'>' on transaction '<Transaction elements='[<BackupKdumpConfig 'Backing up config files'>, <WipeKdumpConfig 'Removing set kdump options'>, <MountNFS 'Mounting NFS volume for kdump configuration'>, <CreateNfsKdumpConfig 'Creating kdump NFS config'>, <RestartKdumpService 'Restarting kdump service'>]' title='Updating kdump related configuration' at 0x2b97fd0>': KDump configuration failed, location unreachable. Previous configuration was restored. - KDump configuration failed, location unreachable. Previous configuration was restored.
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/ovirt/node/utils/console.py", line 136, in __run_transaction
  File "/usr/lib/python2.7/site-packages/ovirt/node/config/defaults.py", line 1275, in commit
RuntimeError: KDump configuration failed, location unreachable. Previous configuration was restored.
2015-03-03 10:10:47,240      ERROR Exception while configuring kdump
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/ovirt/node/setup/core/kdump_page.py", line 184, in on_merge
  File "/usr/lib/python2.7/site-packages/ovirt/node/utils/console.py", line 111, in run
  File "/usr/lib/python2.7/site-packages/ovirt/node/utils/console.py", line 136, in __run_transaction
  File "/usr/lib/python2.7/site-packages/ovirt/node/config/defaults.py", line 1275, in commit
RuntimeError: KDump configuration failed, location unreachable. Previous configuration was restored.
2015-03-03 10:10:47,279       INFO Changes were merged successfully
~

Comment 6 Ying Cui 2015-03-03 11:07:10 UTC
patches are already merged in current node 3.5 branch, according to comment 5, need to set ASSIGNED, not modified.

Comment 7 Ryan Barry 2015-03-03 16:16:10 UTC
I can't reproduce this. It works for me on the latest 7.0 image and 7.1 image. Can you please check permissions and logs on your NFS server?

Comment 8 haiyang,dong 2015-03-04 03:38:11 UTC
(In reply to Ryan Barry from comment #7)
> I can't reproduce this. It works for me on the latest 7.0 image and 7.1
> image. Can you please check permissions and logs on your NFS server?

you are right, after reset my nfs server, It works well now.

Test version:
rhev-hypervisor7-7.1-20150226.0.iso
rhev-hypervisor7-7.0-20150127.0.iso

Test Steps:
1.Install rhev-hypervisor7-7.1-20150226.0.iso and rhev-hypervisor7-7.0-20150127.0.iso
2.Configure network.
3.Configure kdump by using NFS under Kernel Dump Page.
4.Check kdump status

Test results:
kdump can work by using remote kdump server nfs.

so this bug has been fixed in rhevh 7.0 and 7.1 build, change the status into "VERIFIED".