Bug 1340470
| Summary: | Booting instance in nova with pci passthrough will sometimes fail because VF has already been assigned | ||
|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | Lee Yarwood <lyarwood> |
| Component: | openstack-nova | Assignee: | Lee Yarwood <lyarwood> |
| Status: | CLOSED ERRATA | QA Contact: | Prasanth Anbalagan <panbalag> |
| Severity: | high | Docs Contact: | |
| Priority: | high | ||
| Version: | 8.0 (Liberty) | CC: | alex.williamson, berrange, bschmaus, clincoln, dasmith, dhill, eglynn, jhoffer, jmelvin, jraju, kchamart, knoel, mschuppe, nlevinki, sbauza, sclewis, scorcora, sferdjao, sgordon, srevivo, stoner, tbonds, vromanso |
| Target Milestone: | async | Keywords: | ZStream |
| Target Release: | 8.0 (Liberty) | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | openstack-nova-12.0.3-7.el7ost | Doc Type: | If docs needed, set a value |
| Doc Text: | Story Points: | --- | |
| Clone Of: | 1217493 | Environment: | |
| Last Closed: | 2016-06-29 14:43:39 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
| Bug Depends On: | 1217493 | ||
| Bug Blocks: | |||
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2016:1355 |
Verified as follows - Used "modprobe igb max_vfs=2" and since the setup had 2 port nic card, there were a total of 4VFs available. The flavor was set up as "pci_pass_test:1". We were able to create 4 instances successfully (as expected). ******** VERSION ******** [root@serverB ~(keystone_admin)]# yum list installed | grep openstack-nova openstack-nova-api.noarch 1:12.0.3-11.el7ost @rhelosp-8.0-puddle openstack-nova-cert.noarch 1:12.0.3-11.el7ost @rhelosp-8.0-puddle openstack-nova-common.noarch 1:12.0.3-11.el7ost @rhelosp-8.0-puddle openstack-nova-compute.noarch 1:12.0.3-11.el7ost @rhelosp-8.0-puddle openstack-nova-conductor.noarch 1:12.0.3-11.el7ost @rhelosp-8.0-puddle openstack-nova-console.noarch 1:12.0.3-11.el7ost @rhelosp-8.0-puddle openstack-nova-novncproxy.noarch 1:12.0.3-11.el7ost @rhelosp-8.0-puddle openstack-nova-scheduler.noarch 1:12.0.3-11.el7ost @rhelosp-8.0-puddle [root@serverB ~(keystone_admin)]# ******** LOGS ******** [root@serverB ~(keystone_admin)]# nova flavor-create pci-pass 100 512 5 1 +-----+----------+-----------+------+-----------+------+-------+-------------+-----------+ | ID | Name | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public | +-----+----------+-----------+------+-----------+------+-------+-------------+-----------+ | 100 | pci-pass | 512 | 5 | 0 | | 1 | 1.0 | True | +-----+----------+-----------+------+-----------+------+-------+-------------+-----------+ [root@serverB ~(keystone_admin)]# nova flavor-key pci-pass set pci_passthrough:alias=pci_pass_test:1 [root@serverB ~(keystone_admin)]# nova flavor-show pci-pass +----------------------------+----------------------------------------------+ | Property | Value | +----------------------------+----------------------------------------------+ | OS-FLV-DISABLED:disabled | False | | OS-FLV-EXT-DATA:ephemeral | 0 | | disk | 5 | | extra_specs | {"pci_passthrough:alias": "pci_pass_test:1"} | | id | 100 | | name | pci-pass | | os-flavor-access:is_public | True | | ram | 512 | | rxtx_factor | 1.0 | | swap | | | vcpus | 1 | +----------------------------+----------------------------------------------+ [root@serverB ~(keystone_admin)]# nova boot --flavor pci-pass --image cirros vm_pci0 +--------------------------------------+-----------------------------------------------+ | Property | Value | +--------------------------------------+-----------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | - | | OS-EXT-SRV-ATTR:hypervisor_hostname | - | | OS-EXT-SRV-ATTR:instance_name | instance-00000002 | | OS-EXT-STS:power_state | 0 | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | - | | OS-SRV-USG:terminated_at | - | | accessIPv4 | | | accessIPv6 | | | adminPass | 7oHAcrQ3XvM8 | | config_drive | | | created | 2016-06-15T18:56:10Z | | flavor | pci-pass (100) | | hostId | | | id | 810f843a-b17c-4f16-8e12-736740624674 | | image | cirros (ece62687-86e3-4ece-9aa8-f0afc14ab5f9) | | key_name | - | | metadata | {} | | name | vm_pci0 | | os-extended-volumes:volumes_attached | [] | | progress | 0 | | security_groups | default | | status | BUILD | | tenant_id | 86a34ac799c948a78a786804567130ec | | updated | 2016-06-15T18:56:10Z | | user_id | 89ec2a8c63e04c09a0955aa751a5afc1 | +--------------------------------------+-----------------------------------------------+ [root@serverB ~(keystone_admin)]# nova list +--------------------------------------+---------+--------+------------+-------------+---------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+---------+--------+------------+-------------+---------------------+ | 810f843a-b17c-4f16-8e12-736740624674 | vm_pci0 | BUILD | spawning | NOSTATE | public=172.24.4.228 | +--------------------------------------+---------+--------+------------+-------------+---------------------+ [root@serverB ~(keystone_admin)]# nova list +--------------------------------------+---------+--------+------------+-------------+---------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+---------+--------+------------+-------------+---------------------+ | 810f843a-b17c-4f16-8e12-736740624674 | vm_pci0 | ACTIVE | - | Running | public=172.24.4.228 | +--------------------------------------+---------+--------+------------+-------------+---------------------+ [root@serverB ~(keystone_admin)]# nova boot --flavor pci-pass --image cirros vm_pci1 +--------------------------------------+-----------------------------------------------+ | Property | Value | +--------------------------------------+-----------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | - | | OS-EXT-SRV-ATTR:hypervisor_hostname | - | | OS-EXT-SRV-ATTR:instance_name | instance-00000003 | | OS-EXT-STS:power_state | 0 | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | - | | OS-SRV-USG:terminated_at | - | | accessIPv4 | | | accessIPv6 | | | adminPass | 7wdB2z8vSX5E | | config_drive | | | created | 2016-06-15T18:56:54Z | | flavor | pci-pass (100) | | hostId | | | id | b047b0ed-7b2c-46ea-ae34-7c4f69bd2673 | | image | cirros (ece62687-86e3-4ece-9aa8-f0afc14ab5f9) | | key_name | - | | metadata | {} | | name | vm_pci1 | | os-extended-volumes:volumes_attached | [] | | progress | 0 | | security_groups | default | | status | BUILD | | tenant_id | 86a34ac799c948a78a786804567130ec | | updated | 2016-06-15T18:56:54Z | | user_id | 89ec2a8c63e04c09a0955aa751a5afc1 | +--------------------------------------+-----------------------------------------------+ [root@serverB ~(keystone_admin)]# nova boot --flavor pci-pass --image cirros vm_pci2 +--------------------------------------+-----------------------------------------------+ | Property | Value | +--------------------------------------+-----------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | - | | OS-EXT-SRV-ATTR:hypervisor_hostname | - | | OS-EXT-SRV-ATTR:instance_name | instance-00000004 | | OS-EXT-STS:power_state | 0 | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | - | | OS-SRV-USG:terminated_at | - | | accessIPv4 | | | accessIPv6 | | | adminPass | qbSeDr68S75m | | config_drive | | | created | 2016-06-15T18:57:02Z | | flavor | pci-pass (100) | | hostId | | | id | f721f64e-4983-499d-b113-03f35b65f6b4 | | image | cirros (ece62687-86e3-4ece-9aa8-f0afc14ab5f9) | | key_name | - | | metadata | {} | | name | vm_pci2 | | os-extended-volumes:volumes_attached | [] | | progress | 0 | | security_groups | default | | status | BUILD | | tenant_id | 86a34ac799c948a78a786804567130ec | | updated | 2016-06-15T18:57:02Z | | user_id | 89ec2a8c63e04c09a0955aa751a5afc1 | +--------------------------------------+-----------------------------------------------+ [root@serverB ~(keystone_admin)]# nova boot --flavor pci-pass --image cirros vm_pci3 +--------------------------------------+-----------------------------------------------+ | Property | Value | +--------------------------------------+-----------------------------------------------+ | OS-DCF:diskConfig | MANUAL | | OS-EXT-AZ:availability_zone | | | OS-EXT-SRV-ATTR:host | - | | OS-EXT-SRV-ATTR:hypervisor_hostname | - | | OS-EXT-SRV-ATTR:instance_name | instance-00000005 | | OS-EXT-STS:power_state | 0 | | OS-EXT-STS:task_state | scheduling | | OS-EXT-STS:vm_state | building | | OS-SRV-USG:launched_at | - | | OS-SRV-USG:terminated_at | - | | accessIPv4 | | | accessIPv6 | | | adminPass | Couabt6Xg6yS | | config_drive | | | created | 2016-06-15T18:57:08Z | | flavor | pci-pass (100) | | hostId | | | id | f942a9e1-9d07-4f33-9401-cb4f43fd758b | | image | cirros (ece62687-86e3-4ece-9aa8-f0afc14ab5f9) | | key_name | - | | metadata | {} | | name | vm_pci3 | | os-extended-volumes:volumes_attached | [] | | progress | 0 | | security_groups | default | | status | BUILD | | tenant_id | 86a34ac799c948a78a786804567130ec | | updated | 2016-06-15T18:57:08Z | | user_id | 89ec2a8c63e04c09a0955aa751a5afc1 | +--------------------------------------+-----------------------------------------------+ [root@serverB ~(keystone_admin)]# nova list +--------------------------------------+---------+--------+------------+-------------+---------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+---------+--------+------------+-------------+---------------------+ | 810f843a-b17c-4f16-8e12-736740624674 | vm_pci0 | ACTIVE | - | Running | public=172.24.4.228 | | b047b0ed-7b2c-46ea-ae34-7c4f69bd2673 | vm_pci1 | ACTIVE | - | Running | public=172.24.4.229 | | f721f64e-4983-499d-b113-03f35b65f6b4 | vm_pci2 | ACTIVE | - | Running | public=172.24.4.230 | | f942a9e1-9d07-4f33-9401-cb4f43fd758b | vm_pci3 | BUILD | spawning | NOSTATE | public=172.24.4.231 | +--------------------------------------+---------+--------+------------+-------------+---------------------+ [root@serverB ~(keystone_admin)]# nova list +--------------------------------------+---------+--------+------------+-------------+---------------------+ | ID | Name | Status | Task State | Power State | Networks | +--------------------------------------+---------+--------+------------+-------------+---------------------+ | 810f843a-b17c-4f16-8e12-736740624674 | vm_pci0 | ACTIVE | - | Running | public=172.24.4.228 | | b047b0ed-7b2c-46ea-ae34-7c4f69bd2673 | vm_pci1 | ACTIVE | - | Running | public=172.24.4.229 | | f721f64e-4983-499d-b113-03f35b65f6b4 | vm_pci2 | ACTIVE | - | Running | public=172.24.4.230 | | f942a9e1-9d07-4f33-9401-cb4f43fd758b | vm_pci3 | ACTIVE | - | Running | public=172.24.4.231 | +--------------------------------------+---------+--------+------------+-------------+---------------------+