Created attachment 960460 [details] rhev-h and engine logs Description of problem: RHEV-H host> [setup networks] > if attaching network to NIC on host via setup networks window, pressing 'ok' and then trying to remove this network from host(unattach from NIC) you get an error: 'Error while executing action Setup Networks: Unexpected exception' Operation canceled.. Version-Release number of selected component (if applicable): 3.5.0-0.20.el6ev How reproducible: always Steps to Reproduce: 1. install rhev-h host in your setup 2. attach network to NIC on host via [setup networks] and press 'ok' 3. try to unattach network from NIC via [setup networks] Actual results: Fail to unattach network with error:'Error while executing action Setup Networks: Unexpected exception' Operation canceled.. Expected results: should work as expected
Created attachment 960461 [details] screenshot
- virsh -r net-list Name State Autostart Persistent -------------------------------------------------- ;vdsmdummy; active no no vdsm-rhevm active yes yes - brctl show bridge name bridge id STP enabled interfaces ;vdsmdummy; 8000.000000000000 no net10 8000.00145edd0890 no eth3.165 rhevm 8000.00145edd088e no eth2 As you can see network(net10) was removed from virsh list, but not from brctl show.
On the relevant host we see kernel: supervdsmServer[16180]: segfault at 40201f48 ip 00007f6f5e2cbe94 sp 00007f6f4f1718a0 error 4 in libaugeas.so.0.16.0[7f6f5e2c5000+4b000] which might be related.
Host has libvirt-0.10.2-46.el6_6.1.x86_64 vdsm-4.16.7.4-1.el6ev.x86_64 augeas-libs-1.0.0-7.el6.x86_64
(In reply to Dan Kenigsberg from comment #4) > Host has > > libvirt-0.10.2-46.el6_6.1.x86_64 > vdsm-4.16.7.4-1.el6ev.x86_64 > augeas-libs-1.0.0-7.el6.x86_64 (In reply to Dan Kenigsberg from comment #3) > On the relevant host we see > > kernel: supervdsmServer[16180]: segfault at 40201f48 ip 00007f6f5e2cbe94 sp > 00007f6f4f1718a0 error 4 in libaugeas.so.0.16.0[7f6f5e2c5000+4b000] > > which might be related. Could you provide a core, or reproducer on el6 please?
The problem is actually in a ctypes call in the ovirtnode module. The this bug needs to be modified and a new bug needs to be opened to reflect that but I don't know exactly what the process is. This is the stack trace from the effected host: (The numbered stack frames are the frames that occur after the most recent python stack call) #0 api_entry (aug=0x6c1b5820) at augeas.c:398 #1 0x00007fd983be9721 in aug_set (aug=0x6c1b5820, path=0x7fd9782d65f4 "/augeas/save/copy_if_rename_fails", value=0x7fd993594054 "") at augeas.c:909 #2 0x00007fd98515bdac in ffi_call_unix64 () at src/x86/unix64.S:75 #3 0x00007fd98515bb34 in ffi_call (cif=0x7fd9819bf9c0, fn=0x7fd983be9700 <aug_set>, rvalue=<value optimized out>, avalue=<value optimized out>) at src/x86/ffi64.c:430 #4 0x00007fd98536f074 in _call_function_pointer (pProc=0x7fd983be9700 <aug_set>, argtuple=0x7fd9819bf8a0, flags=4353, argtypes=<value optimized out>, restype=0x1cbe6f0, checker=0x0) at /usr/src/debug/Python-2.6.6/Modules/_ctypes/callproc.c:816 #5 _CallProc (pProc=0x7fd983be9700 <aug_set>, argtuple=0x7fd9819bf8a0, flags=4353, argtypes=<value optimized out>, restype=0x1cbe6f0, checker=0x0) at /usr/src/debug/Python-2.6.6/Modules/_ctypes/callproc.c:1163 #6 0x00007fd9853683a2 in CFuncPtr_call (self=<value optimized out>, inargs=<value optimized out>, kwds=0x0) at /usr/src/debug/Python-2.6.6/Modules/_ctypes/_ctypes.c:3860 #7 0x00007fd993027c63 in PyObject_Call (func=0x7fd96c04e940, arg=<value optimized out>, kw=<value optimized out>) at Objects/abstract.c:2492 /usr/lib/python2.6/site-packages/augeas.py (129): set /usr/lib/python2.6/site-packages/ovirtnode/ovirtfunctions.py (20): <module> /usr/lib/python2.6/site-packages/ovirtnode/ovirtfunctions.py (20): <module> /usr/lib/python2.6/site-packages/ovirtnode/ovirtfunctions.py (20): <module> /usr/lib/python2.6/site-packages/ovirt/node/utils/fs/__init__.py (644): delete /usr/lib/python2.6/site-packages/ovirt/node/utils/fs/__init__.py (644): delete /usr/share/vdsm/network/configurators/ifcfg.py (274): _removeFile /usr/share/vdsm/network/configurators/ifcfg.py (274): _removeFile /usr/share/vdsm/network/configurators/ifcfg.py (228): _removeSourceRouteFile /usr/share/vdsm/network/configurators/ifcfg.py (228): _removeSourceRouteFile /usr/share/vdsm/network/configurators/ifcfg.py (246): removeSourceRoute /usr/share/vdsm/network/configurators/ifcfg.py (246): removeSourceRoute /usr/share/vdsm/network/sourceroute.py (90): remove /usr/share/vdsm/network/configurators/__init__.py (131): _removeSourceRoute /usr/share/vdsm/network/configurators/ifcfg.py (159): removeBridge /usr/share/vdsm/network/configurators/ifcfg.py (159): removeBridge /usr/share/vdsm/network/models.py (171): remove /usr/share/vdsm/network/api.py (405): delNetwork /usr/share/vdsm/network/api.py (405): delNetwork /usr/share/vdsm/network/api.py (206): wrapped /usr/share/vdsm/network/api.py (206): wrapped /usr/share/vdsm/network/api.py (569): setupNetworks /usr/share/vdsm/network/api.py (569): setupNetworks /usr/share/vdsm/supervdsmServer (222): setupNetworks /usr/share/vdsm/supervdsmServer (222): setupNetworks /usr/share/vdsm/supervdsmServer (99): wrapper /usr/share/vdsm/supervdsmServer (99): wrapper /usr/lib64/python2.6/multiprocessing/managers.py (199): serve_client /usr/lib64/python2.6/multiprocessing/managers.py (391): accept_connection /usr/lib64/python2.6/multiprocessing/managers.py (391): accept_connection /usr/lib64/python2.6/multiprocessing/managers.py (165): handle_request /usr/lib64/python2.6/multiprocessing/managers.py (165): handle_request /usr/lib64/python2.6/threading.py (481): run /usr/lib64/python2.6/threading.py (513): __bootstrap_inner /usr/lib64/python2.6/threading.py (490): __bootstrap /usr/lib64/python2.6/threading.py (490): __bootstrap
Can't reproduce on standard rhel 6.6 server
Followed Fabian steps as he asked: (This will basically replace the current augeas.py with the most recent one) 1. Login to RHEV-H 2. Drop to shell by pressing F2 in the setup 3. mount -o remount,rw / 4. cd /usr/lib/python-2.6/site-packages/ 5. rm augeas.pyc 6. curl -O https://raw.githubusercontent.com/hercules-team/python-augeas/master/augeas.py 7. mount -o remount,ro / 8. Restart supervdsmd / vdsmd (!!!) (other daemons you know need python-augeas) 9. Do your testing After this steps i managed to remove network from NIC.
I could reproduce it in the follow version: rhevh-6.6-20141119.0.el6ev.iso ovirt-node-3.1.0-0.27.20141119git24e087e.el6.noarch Red Hat Enterprise Virtualization Manager Version: 3.5.0-0.21.el6ev
Test version: rhev-hypervisor6-6.6-20141218.0.iso(ovirt-node-3.1.0-0.37.20141218gitcf277e1.el6.noarch) rhev-hypervisor7-7.0-20141218.0.iso(ovirt-node-3.1.0-0.37.20141218gitcf277e1.el7.noarch) Test steps: 1. install rhev-h host in your setup 2. attach network to NIC on host via [setup networks] and press 'ok' 3. try to unattach network from NIC via [setup networks] Test result: unattach network from NIC success after attaching via setup networks,no exception error was thrown. so this bug has been fixed, change it into "verified".
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://rhn.redhat.com/errata/RHEA-2015-0160.html