Bug 1340470 - Booting instance in nova with pci passthrough will sometimes fail because VF has already been assigned
Summary: Booting instance in nova with pci passthrough will sometimes fail because VF ...
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-nova
Version: 8.0 (Liberty)
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: async
: 8.0 (Liberty)
Assignee: Lee Yarwood
QA Contact: Prasanth Anbalagan
URL:
Whiteboard:
Depends On: 1217493
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-05-27 13:32 UTC by Lee Yarwood
Modified: 2019-11-14 08:11 UTC (History)
23 users (show)

Fixed In Version: openstack-nova-12.0.3-7.el7ost
Doc Type: If docs needed, set a value
Doc Text:
Clone Of: 1217493
Environment:
Last Closed: 2016-06-29 14:43:39 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHBA-2016:1355 0 normal SHIPPED_LIVE openstack-nova bug fix advisory 2016-06-29 18:37:58 UTC

Comment 2 Prasanth Anbalagan 2016-06-15 18:59:31 UTC
Verified as follows - Used "modprobe igb max_vfs=2" and since the setup had 2 port nic card, there were a total of 4VFs available. The flavor was set up as  "pci_pass_test:1". We were able to create 4 instances successfully (as expected).

********
VERSION
********

[root@serverB ~(keystone_admin)]# yum list installed | grep openstack-nova
openstack-nova-api.noarch            1:12.0.3-11.el7ost      @rhelosp-8.0-puddle
openstack-nova-cert.noarch           1:12.0.3-11.el7ost      @rhelosp-8.0-puddle
openstack-nova-common.noarch         1:12.0.3-11.el7ost      @rhelosp-8.0-puddle
openstack-nova-compute.noarch        1:12.0.3-11.el7ost      @rhelosp-8.0-puddle
openstack-nova-conductor.noarch      1:12.0.3-11.el7ost      @rhelosp-8.0-puddle
openstack-nova-console.noarch        1:12.0.3-11.el7ost      @rhelosp-8.0-puddle
openstack-nova-novncproxy.noarch     1:12.0.3-11.el7ost      @rhelosp-8.0-puddle
openstack-nova-scheduler.noarch      1:12.0.3-11.el7ost      @rhelosp-8.0-puddle
[root@serverB ~(keystone_admin)]# 

********
LOGS
********

[root@serverB ~(keystone_admin)]# nova flavor-create pci-pass 100 512 5 1
+-----+----------+-----------+------+-----------+------+-------+-------------+-----------+
| ID  | Name     | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public |
+-----+----------+-----------+------+-----------+------+-------+-------------+-----------+
| 100 | pci-pass | 512       | 5    | 0         |      | 1     | 1.0         | True      |
+-----+----------+-----------+------+-----------+------+-------+-------------+-----------+
[root@serverB ~(keystone_admin)]# nova flavor-key pci-pass set pci_passthrough:alias=pci_pass_test:1
[root@serverB ~(keystone_admin)]# nova flavor-show pci-pass
+----------------------------+----------------------------------------------+
| Property                   | Value                                        |
+----------------------------+----------------------------------------------+
| OS-FLV-DISABLED:disabled   | False                                        |
| OS-FLV-EXT-DATA:ephemeral  | 0                                            |
| disk                       | 5                                            |
| extra_specs                | {"pci_passthrough:alias": "pci_pass_test:1"} |
| id                         | 100                                          |
| name                       | pci-pass                                     |
| os-flavor-access:is_public | True                                         |
| ram                        | 512                                          |
| rxtx_factor                | 1.0                                          |
| swap                       |                                              |
| vcpus                      | 1                                            |
+----------------------------+----------------------------------------------+

[root@serverB ~(keystone_admin)]# nova boot --flavor pci-pass --image cirros  vm_pci0
+--------------------------------------+-----------------------------------------------+
| Property                             | Value                                         |
+--------------------------------------+-----------------------------------------------+
| OS-DCF:diskConfig                    | MANUAL                                        |
| OS-EXT-AZ:availability_zone          |                                               |
| OS-EXT-SRV-ATTR:host                 | -                                             |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | -                                             |
| OS-EXT-SRV-ATTR:instance_name        | instance-00000002                             |
| OS-EXT-STS:power_state               | 0                                             |
| OS-EXT-STS:task_state                | scheduling                                    |
| OS-EXT-STS:vm_state                  | building                                      |
| OS-SRV-USG:launched_at               | -                                             |
| OS-SRV-USG:terminated_at             | -                                             |
| accessIPv4                           |                                               |
| accessIPv6                           |                                               |
| adminPass                            | 7oHAcrQ3XvM8                                  |
| config_drive                         |                                               |
| created                              | 2016-06-15T18:56:10Z                          |
| flavor                               | pci-pass (100)                                |
| hostId                               |                                               |
| id                                   | 810f843a-b17c-4f16-8e12-736740624674          |
| image                                | cirros (ece62687-86e3-4ece-9aa8-f0afc14ab5f9) |
| key_name                             | -                                             |
| metadata                             | {}                                            |
| name                                 | vm_pci0                                       |
| os-extended-volumes:volumes_attached | []                                            |
| progress                             | 0                                             |
| security_groups                      | default                                       |
| status                               | BUILD                                         |
| tenant_id                            | 86a34ac799c948a78a786804567130ec              |
| updated                              | 2016-06-15T18:56:10Z                          |
| user_id                              | 89ec2a8c63e04c09a0955aa751a5afc1              |
+--------------------------------------+-----------------------------------------------+
[root@serverB ~(keystone_admin)]# nova list
+--------------------------------------+---------+--------+------------+-------------+---------------------+
| ID                                   | Name    | Status | Task State | Power State | Networks            |
+--------------------------------------+---------+--------+------------+-------------+---------------------+
| 810f843a-b17c-4f16-8e12-736740624674 | vm_pci0 | BUILD  | spawning   | NOSTATE     | public=172.24.4.228 |
+--------------------------------------+---------+--------+------------+-------------+---------------------+
[root@serverB ~(keystone_admin)]# nova list
+--------------------------------------+---------+--------+------------+-------------+---------------------+
| ID                                   | Name    | Status | Task State | Power State | Networks            |
+--------------------------------------+---------+--------+------------+-------------+---------------------+
| 810f843a-b17c-4f16-8e12-736740624674 | vm_pci0 | ACTIVE | -          | Running     | public=172.24.4.228 |
+--------------------------------------+---------+--------+------------+-------------+---------------------+
[root@serverB ~(keystone_admin)]# nova boot --flavor pci-pass --image cirros  vm_pci1
+--------------------------------------+-----------------------------------------------+
| Property                             | Value                                         |
+--------------------------------------+-----------------------------------------------+
| OS-DCF:diskConfig                    | MANUAL                                        |
| OS-EXT-AZ:availability_zone          |                                               |
| OS-EXT-SRV-ATTR:host                 | -                                             |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | -                                             |
| OS-EXT-SRV-ATTR:instance_name        | instance-00000003                             |
| OS-EXT-STS:power_state               | 0                                             |
| OS-EXT-STS:task_state                | scheduling                                    |
| OS-EXT-STS:vm_state                  | building                                      |
| OS-SRV-USG:launched_at               | -                                             |
| OS-SRV-USG:terminated_at             | -                                             |
| accessIPv4                           |                                               |
| accessIPv6                           |                                               |
| adminPass                            | 7wdB2z8vSX5E                                  |
| config_drive                         |                                               |
| created                              | 2016-06-15T18:56:54Z                          |
| flavor                               | pci-pass (100)                                |
| hostId                               |                                               |
| id                                   | b047b0ed-7b2c-46ea-ae34-7c4f69bd2673          |
| image                                | cirros (ece62687-86e3-4ece-9aa8-f0afc14ab5f9) |
| key_name                             | -                                             |
| metadata                             | {}                                            |
| name                                 | vm_pci1                                       |
| os-extended-volumes:volumes_attached | []                                            |
| progress                             | 0                                             |
| security_groups                      | default                                       |
| status                               | BUILD                                         |
| tenant_id                            | 86a34ac799c948a78a786804567130ec              |
| updated                              | 2016-06-15T18:56:54Z                          |
| user_id                              | 89ec2a8c63e04c09a0955aa751a5afc1              |
+--------------------------------------+-----------------------------------------------+
[root@serverB ~(keystone_admin)]# nova boot --flavor pci-pass --image cirros  vm_pci2
+--------------------------------------+-----------------------------------------------+
| Property                             | Value                                         |
+--------------------------------------+-----------------------------------------------+
| OS-DCF:diskConfig                    | MANUAL                                        |
| OS-EXT-AZ:availability_zone          |                                               |
| OS-EXT-SRV-ATTR:host                 | -                                             |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | -                                             |
| OS-EXT-SRV-ATTR:instance_name        | instance-00000004                             |
| OS-EXT-STS:power_state               | 0                                             |
| OS-EXT-STS:task_state                | scheduling                                    |
| OS-EXT-STS:vm_state                  | building                                      |
| OS-SRV-USG:launched_at               | -                                             |
| OS-SRV-USG:terminated_at             | -                                             |
| accessIPv4                           |                                               |
| accessIPv6                           |                                               |
| adminPass                            | qbSeDr68S75m                                  |
| config_drive                         |                                               |
| created                              | 2016-06-15T18:57:02Z                          |
| flavor                               | pci-pass (100)                                |
| hostId                               |                                               |
| id                                   | f721f64e-4983-499d-b113-03f35b65f6b4          |
| image                                | cirros (ece62687-86e3-4ece-9aa8-f0afc14ab5f9) |
| key_name                             | -                                             |
| metadata                             | {}                                            |
| name                                 | vm_pci2                                       |
| os-extended-volumes:volumes_attached | []                                            |
| progress                             | 0                                             |
| security_groups                      | default                                       |
| status                               | BUILD                                         |
| tenant_id                            | 86a34ac799c948a78a786804567130ec              |
| updated                              | 2016-06-15T18:57:02Z                          |
| user_id                              | 89ec2a8c63e04c09a0955aa751a5afc1              |
+--------------------------------------+-----------------------------------------------+
[root@serverB ~(keystone_admin)]# nova boot --flavor pci-pass --image cirros  vm_pci3
+--------------------------------------+-----------------------------------------------+
| Property                             | Value                                         |
+--------------------------------------+-----------------------------------------------+
| OS-DCF:diskConfig                    | MANUAL                                        |
| OS-EXT-AZ:availability_zone          |                                               |
| OS-EXT-SRV-ATTR:host                 | -                                             |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | -                                             |
| OS-EXT-SRV-ATTR:instance_name        | instance-00000005                             |
| OS-EXT-STS:power_state               | 0                                             |
| OS-EXT-STS:task_state                | scheduling                                    |
| OS-EXT-STS:vm_state                  | building                                      |
| OS-SRV-USG:launched_at               | -                                             |
| OS-SRV-USG:terminated_at             | -                                             |
| accessIPv4                           |                                               |
| accessIPv6                           |                                               |
| adminPass                            | Couabt6Xg6yS                                  |
| config_drive                         |                                               |
| created                              | 2016-06-15T18:57:08Z                          |
| flavor                               | pci-pass (100)                                |
| hostId                               |                                               |
| id                                   | f942a9e1-9d07-4f33-9401-cb4f43fd758b          |
| image                                | cirros (ece62687-86e3-4ece-9aa8-f0afc14ab5f9) |
| key_name                             | -                                             |
| metadata                             | {}                                            |
| name                                 | vm_pci3                                       |
| os-extended-volumes:volumes_attached | []                                            |
| progress                             | 0                                             |
| security_groups                      | default                                       |
| status                               | BUILD                                         |
| tenant_id                            | 86a34ac799c948a78a786804567130ec              |
| updated                              | 2016-06-15T18:57:08Z                          |
| user_id                              | 89ec2a8c63e04c09a0955aa751a5afc1              |
+--------------------------------------+-----------------------------------------------+
[root@serverB ~(keystone_admin)]# nova list
+--------------------------------------+---------+--------+------------+-------------+---------------------+
| ID                                   | Name    | Status | Task State | Power State | Networks            |
+--------------------------------------+---------+--------+------------+-------------+---------------------+
| 810f843a-b17c-4f16-8e12-736740624674 | vm_pci0 | ACTIVE | -          | Running     | public=172.24.4.228 |
| b047b0ed-7b2c-46ea-ae34-7c4f69bd2673 | vm_pci1 | ACTIVE | -          | Running     | public=172.24.4.229 |
| f721f64e-4983-499d-b113-03f35b65f6b4 | vm_pci2 | ACTIVE | -          | Running     | public=172.24.4.230 |
| f942a9e1-9d07-4f33-9401-cb4f43fd758b | vm_pci3 | BUILD  | spawning   | NOSTATE     | public=172.24.4.231 |
+--------------------------------------+---------+--------+------------+-------------+---------------------+
[root@serverB ~(keystone_admin)]# nova list
+--------------------------------------+---------+--------+------------+-------------+---------------------+
| ID                                   | Name    | Status | Task State | Power State | Networks            |
+--------------------------------------+---------+--------+------------+-------------+---------------------+
| 810f843a-b17c-4f16-8e12-736740624674 | vm_pci0 | ACTIVE | -          | Running     | public=172.24.4.228 |
| b047b0ed-7b2c-46ea-ae34-7c4f69bd2673 | vm_pci1 | ACTIVE | -          | Running     | public=172.24.4.229 |
| f721f64e-4983-499d-b113-03f35b65f6b4 | vm_pci2 | ACTIVE | -          | Running     | public=172.24.4.230 |
| f942a9e1-9d07-4f33-9401-cb4f43fd758b | vm_pci3 | ACTIVE | -          | Running     | public=172.24.4.231 |
+--------------------------------------+---------+--------+------------+-------------+---------------------+

Comment 4 errata-xmlrpc 2016-06-29 14:43:39 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:1355


Note You need to log in before you can comment on or make changes to this bug.