Bug 1386420
| Summary: | Nova fails to open console.log file at repeated host evacuation | |||
|---|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | Marian Krcmarik <mkrcmari> | |
| Component: | openstack-nova | Assignee: | Stephen Finucane <stephenfin> | |
| Status: | CLOSED ERRATA | QA Contact: | Joe H. Rahme <jhakimra> | |
| Severity: | medium | Docs Contact: | ||
| Priority: | unspecified | |||
| Version: | 10.0 (Newton) | CC: | acanan, awaugama, berrange, bhaubeck, cshastri, dasmith, eglynn, gpaterno, ipetrova, jhakimra, jjoyce, jschluet, j_t_williams, kchamart, kumar.abhinav, mbooth, mburns, mschuppe, pablo.iranzo, rbergami, rscarazz, sbauza, sferdjao, sgordon, srevivo, stephenfin, vromanso | |
| Target Milestone: | z4 | Keywords: | Reopened, Triaged, ZStream | |
| Target Release: | 10.0 (Newton) | |||
| Hardware: | Unspecified | |||
| OS: | Unspecified | |||
| Whiteboard: | ||||
| Fixed In Version: | openstack-nova-14.0.7-9.el7ost | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | ||
| Clone Of: | ||||
| : | 1491767 (view as bug list) | Environment: | ||
| Last Closed: | 2017-09-14 13:21:58 UTC | Type: | Bug | |
| Regression: | --- | Mount Type: | --- | |
| Documentation: | --- | CRM: | ||
| Verified Versions: | Category: | --- | ||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | ||
| Cloudforms Team: | --- | Target Upstream Version: | ||
| Embargoed: | ||||
| Bug Depends On: | ||||
| Bug Blocks: | 1335596, 1356451, 1491767 | |||
|
Description
Marian Krcmarik
2016-10-18 22:01:27 UTC
noticed that a patch was proposed to master from the launchpad bug https://review.openstack.org/#/c/392643/ Hi Stephen. I see you wrote the upstream Ocata patch from c#1: https://review.openstack.org/#/c/392643/ Any plans on backporting it to downstream Newton? It's just a simple exception that should do the trick, right? Any considerations that we're missing here? Hey Stephen.
Could please comment on this at least (we had the customer perform a small test for us):
1) take note of the user and group ownership of the console.log file.
[root@cpt4 ~]# ls -l /var/lib/nova/instances/982a36e1-a913-456e-a6f5-cf2930a32d3a/console.log
-rw-r--r--. 1 qemu qemu 19229 Mar 23 17:02 /var/lib/nova/instances/982a36e1-a913-456e-a6f5-cf2930a32d3a/console.log
2) evacuate the instance from Compute A to Compute B.
Instance evacuated from cpt4 to cpt7
3) once Compute A running again, check the user and group ownership of the console.log file once more (they should be the same, if not let me know).
[root@cpt4 ~]# ls -l /var/lib/nova/instances/982a36e1-a913-456e-a6f5-cf2930a32d3a/console.log
-rw-r--r--. 1 root root 19229 Mar 23 17:02 /var/lib/nova/instances/982a36e1-a913-456e-a6f5-cf2930a32d3a/console.log
[root@cpt7 ~]# ls -l /var/lib/nova/instances/982a36e1-a913-456e-a6f5-cf2930a32d3a/console.log
-rw-r--r--. 1 qemu qemu 19157 Mar 23 17:10 /var/lib/nova/instances/982a36e1-a913-456e-a6f5-cf2930a32d3a/console.log
4) attempt to evacuate the instance from Compute B to Compute A (it should fail).
the evacuation fails
[Errno 13] Permission denied: '/var/lib/nova/instances/982a36e1-a913-456e-a6f5-cf2930a32d3a/console.log
5) change the user and group ownership of the console.log file on Compute A from qemu:qemu to nova:nova.
I changed user and group ownership of the console.log on cpt4 from root:root to qemu:qemu and the evacuation fails
then I changed user and group ownership of the console.log on cpt4 from root:root to nova:nova and the evacuation succeded
6) attempt to evacuate the instance from Compute B to Compute A once again (it should succeed).
The evacuation succeded with console.log ownership nova:nova
(In reply to Irina Petrova from comment #2) > Hi Stephen. I see you wrote the upstream Ocata patch from c#1: > https://review.openstack.org/#/c/392643/ > > Any plans on backporting it to downstream Newton? It's just a simple > exception that should do the trick, right? Any considerations that we're > missing here? Apologies for the delay - I'd waiting for the backported fix to OSP 10 to merge [1] and should have updated as such. The downstream-only backport change has since been abandoned as the patch has been backported upstream [2]. This means it should be included as part of a rebase in the near future. I'm changing this to POST while we wait for an internal build. [1] https://code.engineering.redhat.com/gerrit/#/c/102808/ [2] https://review.openstack.org/#/c/454593/ *** Bug 1422154 has been marked as a duplicate of this bug. *** Verified as a medium severity bug. Feel free to reopen the ticket if you find any issue with it. Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2017:2652 I just encountered the same exact error in an environment with openstack-nova-14.0.8-2.el7ost.noarch. I took the sosreports from all the nodes here [1]. Problem happened doing the same exact test Marian wrote on the bug description. [1] http://file.rdu.redhat.com/~rscarazz/BZ1386420/ (In reply to Raoul Scarazzini from comment #40) > I just encountered the same exact error in an environment with > openstack-nova-14.0.8-2.el7ost.noarch. > I took the sosreports from all the nodes here [1]. Problem happened doing > the same exact test Marian wrote on the bug description. > > [1] http://file.rdu.redhat.com/~rscarazz/BZ1386420/ Please do not reopen bugs that are closed errata. You can either clone into a new bug or file a clean new bug. The release process doesn't allow re-using bugs once they're closed errata. I'm the one who suggested reopening the ticket if there was an issue (in comment #37). I was under the impression that it was the proper workflow. My bad. Sorry for the confusion. I'm the one who suggested reopening the ticket if there was an issue (in comment #37). I was under the impression that it was the proper workflow. My bad. Sorry for the confusion. Cloned here: https://bugzilla.redhat.com/show_bug.cgi?id=1491767 Lesson learned for the future. *** Bug 1441368 has been marked as a duplicate of this bug. *** Which version of python-nova package is the fix delivered? I have python-nova-14.0.8-2 installed and the driver.py file checking for EACCESS, yet the upstream code checks for EPERM? Which is correct?
Upstream code:
except IOError as ex:
if ex.errno != errno.EPERM:
raise
LOG.debug('Console file already exists: %s.', console_file)
This was resolved in upstream commit 3072b0afbc1, which has been pulled in as downstream commit 9d299ae50ea. I guess we need to wait for the next point release? |