Bug 1340832

Summary: Serial ports lost after hard-reboot
Product: Red Hat OpenStack Reporter: Sahid Ferdjaoui <sferdjao>
Component: openstack-novaAssignee: Sahid Ferdjaoui <sferdjao>
Status: CLOSED ERRATA QA Contact: Prasanth Anbalagan <panbalag>
Severity: high Docs Contact:
Priority: high    
Version: 7.0 (Kilo)CC: berrange, dasmith, dmaley, eglynn, hmatsumo, kchamart, panbalag, sbauza, sferdjao, sgordon, srevivo, vromanso, ykawada
Target Milestone: asyncKeywords: Regression, ZStream
Target Release: ---   
Hardware: All   
OS: All   
Whiteboard:
Fixed In Version: openstack-nova-2015.1.4-5.el7ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of:
: 1341606 (view as bug list) Environment:
Last Closed: 2016-06-23 17:37:35 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1313171, 1341606, 1341612    

Description Sahid Ferdjaoui 2016-05-30 11:28:02 UTC 
After I executed "nova reboot --hard <vm>", I could not access to the vm's serial-console.

The problem is able to be recovered by re-executing "nova reboot --hard <vm>".
And evey time I execute the command, the accessiblity to serial console is changed alternately.

 1. Get Serial Console             => I can access it.
 2. After 1st "nova reboot --hard" => I cannot access it.
 3. After 2nd "nova reboot --hard" => I can access it.
 4. After 3rd "nova reboot --hard" => I cannot access it.
Comment 7 Prasanth Anbalagan 2016-06-23 12:34:17 UTC 
Verified as follows,


**********
VERSION
**********

[root@rhos-compute-node-02 ~(keystone_admin)]# yum list installed | grep openstack-nova
openstack-nova-api.noarch                  2015.1.4-7.el7ost       @RH7-RHOS-7.0
openstack-nova-cert.noarch                 2015.1.4-7.el7ost       @RH7-RHOS-7.0
openstack-nova-common.noarch               2015.1.4-7.el7ost       @RH7-RHOS-7.0
openstack-nova-conductor.noarch            2015.1.4-7.el7ost       @RH7-RHOS-7.0
openstack-nova-console.noarch              2015.1.4-7.el7ost       @RH7-RHOS-7.0
openstack-nova-novncproxy.noarch           2015.1.4-7.el7ost       @RH7-RHOS-7.0
openstack-nova-scheduler.noarch            2015.1.4-7.el7ost       @RH7-RHOS-7.0
[root@rhos-compute-node-02 ~(keystone_admin)]# 

*******
LOGS
*******

[root@rhos-compute-node-02 ~(keystone_admin)]# nova get-serial-console vm1
+--------+-----------------------------------------------------------------+
| Type   | Url                                                             |
+--------+-----------------------------------------------------------------+
| serial | ws://10.8.0.50:6083/?token=156f31f5-9dac-4236-a8ed-c186fdda4b92 |
+--------+-----------------------------------------------------------------+
[root@rhos-compute-node-02 ~(keystone_admin)]# 
[root@rhos-compute-node-02 ~(keystone_admin)]# nova reboot --hard vm1
[root@rhos-compute-node-02 ~(keystone_admin)]# nova list
+--------------------------------------+------+-------------+---------------------+-------------+---------------------+
| ID                                   | Name | Status      | Task State          | Power State | Networks            |
+--------------------------------------+------+-------------+---------------------+-------------+---------------------+
| c16e753b-68f8-41e2-b9ff-2baaf5a05200 | vm1  | HARD_REBOOT | reboot_pending_hard | Running     | public=172.24.4.227 |
| 0ff9ef1b-56b7-4d08-aff4-87ff26f8430f | vm2  | ACTIVE      | -                   | Running     | public=172.24.4.228 |
+--------------------------------------+------+-------------+---------------------+-------------+---------------------+
[root@rhos-compute-node-02 ~(keystone_admin)]# nova list
+--------------------------------------+------+--------+------------+-------------+---------------------+
| ID                                   | Name | Status | Task State | Power State | Networks            |
+--------------------------------------+------+--------+------------+-------------+---------------------+
| c16e753b-68f8-41e2-b9ff-2baaf5a05200 | vm1  | ACTIVE | -          | Running     | public=172.24.4.227 |
| 0ff9ef1b-56b7-4d08-aff4-87ff26f8430f | vm2  | ACTIVE | -          | Running     | public=172.24.4.228 |
+--------------------------------------+------+--------+------------+-------------+---------------------+
[root@rhos-compute-node-02 ~(keystone_admin)]# nova get-serial-console vm1
+--------+-----------------------------------------------------------------+
| Type   | Url                                                             |
+--------+-----------------------------------------------------------------+
| serial | ws://10.8.0.50:6083/?token=65914d98-e7a7-4df7-b31d-ef0c25f4be20 |
+--------+-----------------------------------------------------------------+
[root@rhos-compute-node-02 ~(keystone_admin)]# 
[root@rhos-compute-node-02 ~(keystone_admin)]# nova reboot --hard vm1
[root@rhos-compute-node-02 ~(keystone_admin)]# nova list
+--------------------------------------+------+-------------+----------------+-------------+---------------------+
| ID                                   | Name | Status      | Task State     | Power State | Networks            |
+--------------------------------------+------+-------------+----------------+-------------+---------------------+
| c16e753b-68f8-41e2-b9ff-2baaf5a05200 | vm1  | HARD_REBOOT | rebooting_hard | Running     | public=172.24.4.227 |
| 0ff9ef1b-56b7-4d08-aff4-87ff26f8430f | vm2  | ACTIVE      | -              | Running     | public=172.24.4.228 |
+--------------------------------------+------+-------------+----------------+-------------+---------------------+
[root@rhos-compute-node-02 ~(keystone_admin)]# 
[root@rhos-compute-node-02 ~(keystone_admin)]# nova list
+--------------------------------------+------+--------+------------+-------------+---------------------+
| ID                                   | Name | Status | Task State | Power State | Networks            |
+--------------------------------------+------+--------+------------+-------------+---------------------+
| c16e753b-68f8-41e2-b9ff-2baaf5a05200 | vm1  | ACTIVE | -          | Running     | public=172.24.4.227 |
| 0ff9ef1b-56b7-4d08-aff4-87ff26f8430f | vm2  | ACTIVE | -          | Running     | public=172.24.4.228 |
+--------------------------------------+------+--------+------------+-------------+---------------------+
[root@rhos-compute-node-02 ~(keystone_admin)]# 
[root@rhos-compute-node-02 ~(keystone_admin)]# nova get-serial-console vm1
+--------+-----------------------------------------------------------------+
| Type   | Url                                                             |
+--------+-----------------------------------------------------------------+
| serial | ws://10.8.0.50:6083/?token=280a390f-ae1d-4543-9939-963653a06dfc |
+--------+-----------------------------------------------------------------+
[root@rhos-compute-node-02 ~(keystone_admin)]# 
[root@rhos-compute-node-02 ~(keystone_admin)]# 
[root@rhos-compute-node-02 ~(keystone_admin)]# nova reboot --hard vm1
[root@rhos-compute-node-02 ~(keystone_admin)]# 
[root@rhos-compute-node-02 ~(keystone_admin)]# nova list
+--------------------------------------+------+-------------+---------------------+-------------+---------------------+
| ID                                   | Name | Status      | Task State          | Power State | Networks            |
+--------------------------------------+------+-------------+---------------------+-------------+---------------------+
| c16e753b-68f8-41e2-b9ff-2baaf5a05200 | vm1  | HARD_REBOOT | reboot_started_hard | Running     | public=172.24.4.227 |
| 0ff9ef1b-56b7-4d08-aff4-87ff26f8430f | vm2  | ACTIVE      | -                   | Running     | public=172.24.4.228 |
+--------------------------------------+------+-------------+---------------------+-------------+---------------------+
[root@rhos-compute-node-02 ~(keystone_admin)]# 
[root@rhos-compute-node-02 ~(keystone_admin)]# nova list
+--------------------------------------+------+--------+------------+-------------+---------------------+
| ID                                   | Name | Status | Task State | Power State | Networks            |
+--------------------------------------+------+--------+------------+-------------+---------------------+
| c16e753b-68f8-41e2-b9ff-2baaf5a05200 | vm1  | ACTIVE | -          | Running     | public=172.24.4.227 |
| 0ff9ef1b-56b7-4d08-aff4-87ff26f8430f | vm2  | ACTIVE | -          | Running     | public=172.24.4.228 |
+--------------------------------------+------+--------+------------+-------------+---------------------+
[root@rhos-compute-node-02 ~(keystone_admin)]# nova get-serial-console vm1
+--------+-----------------------------------------------------------------+
| Type   | Url                                                             |
+--------+-----------------------------------------------------------------+
| serial | ws://10.8.0.50:6083/?token=597dc533-5d58-49d0-abc1-29591cab2dce |
+--------+-----------------------------------------------------------------+
[root@rhos-compute-node-02 ~(keystone_admin)]#
Comment 9 errata-xmlrpc 2016-06-23 17:37:35 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:1313