Bug 1434452 - CPU limit too small for large images
Summary: CPU limit too small for large images
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-cinder
Version: 10.0 (Newton)
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: z3
: 10.0 (Newton)
Assignee: Eric Harney
QA Contact: Tzach Shefi
URL:
Whiteboard:
Depends On: 1437959
Blocks:
TreeView+ depends on / blocked
 
Reported: 2017-03-21 14:17 UTC by Eric Harney
Modified: 2017-06-28 15:38 UTC (History)
3 users (show)

Fixed In Version: openstack-cinder-9.1.3-1.el7ost
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2017-06-28 15:38:16 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Launchpad 1646181 0 None None None 2017-03-21 14:19:01 UTC
OpenStack gerrit 444913 0 None None None 2017-03-21 14:18:20 UTC
Red Hat Product Errata RHBA-2017:1591 0 normal SHIPPED_LIVE openstack-cinder bug fix advisory 2017-06-28 19:14:07 UTC

Description Eric Harney 2017-03-21 14:17:43 UTC
Description of problem:
When deploying large images, particularly from NFS backends, the cpu limit for qemu-img may be hit, causing image->volume operations to fail.

This has only been reported on NFS backends, but may affect others as well.

The fix is a simple change to increase the cpu limit for the qemu-img process.

Reported against RDO in bug 1430756.

Comment 1 Tzach Shefi 2017-05-03 09:10:23 UTC
Eric, 

When we mention NFS as backend-> deploying large images, particularly from NFS backends.  

NFS as backend for Cinder/Glance or Nova? 

LP link mentions NFS shared storage, looks like it's NFS as Nova backend. 

Then again why would we need a Cinder fix for this, meaning we probably need Cinder or Glance with NFS backend for verification, correct? 

Same question holds true for bz 1430756

Comment 2 Eric Harney 2017-05-03 18:47:24 UTC
(In reply to Tzach Shefi from comment #1)
> NFS as backend for Cinder/Glance or Nova? 

The test here is just for a Cinder NFS backend.

Comment 3 Tzach Shefi 2017-05-04 08:46:53 UTC
Verified on:
openstack-cinder-9.1.3-4.el7ost.noarch
Fix is incorporated ->  cpu_time=8,

Created a large snapshot 22G (40G disk) 

# glance image-show 3ce20a98-dd47-4ffb-a45a-1b037f7a027d
+------------------+--------------------------------------+
| Property         | Value                                |
+------------------+--------------------------------------+
| container_format | bare                                 |
| disk_format      | qcow2                                |
| id               | 3ce20a98-dd47-4ffb-a45a-1b037f7a027d |
..
| name             | Snap22G                              |
| size             | 22672113664 


Used ^ image to create an LVM backed Cinder volume, works fine. 
#cinder create 40 --image 3ce20a98-dd47-4ffb-a45a-1b037f7a027d --name LVM_Backed_vol

It took a good few minutes but eventually completed fine. 

# cinder list
+--------------------------------------+-----------+----------------+------+-------------+----------+-------------+
| ID                                   | Status    | Name           | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-----------+----------------+------+-------------+----------+-------------+
| cea43e9b-d8c9-47c4-beca-8beb6a277d1a | available | LVM_Backed_vol | 40   | iscsi       | true     |             |


Used same image with NFS Cinder backend:
# cinder create 40 --image 3ce20a98-dd47-4ffb-a45a-1b037f7a027d --name NFS_Backed_vol --volume_type nfs

Again took a while but completed successfully as expected. 
Created a third NFS_Backed_vol2 volume (nfs) just to be sure also created successfully. 

[root@cougar09 ~(keystone_admin)]# cinder list
+--------------------------------------+-----------+-----------------+------+-------------+----------+-------------+
| ID                                   | Status    | Name            | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-----------+-----------------+------+-------------+----------+-------------+
| 20b92766-50ca-4105-93bc-ae83c8726341 | available | NFS_Backed_vol2 | 40   | nfs         | true     |             |
| ca525a5f-0019-4053-8935-a5d441d85014 | available | NFS_Backed_vol  | 40   | nfs         | true     |             |
| cea43e9b-d8c9-47c4-beca-8beb6a277d1a | available | LVM_Backed_vol  | 40   | iscsi       | true     |             |
+--------------------------------------+-----------+-----------------+------+-------------+----------+-------------+



Waiting for ON_QA status to officially close as verified.

Comment 5 Tzach Shefi 2017-05-24 14:17:20 UTC
Any idea why this didn't reach ON_QA state yet? 

Fix was already introduced (and verified #3) in 9.1.3. 
I just installed a 9.1.4 build today figured this would hit ON_QA so that I could officially verify.

Comment 6 Tzach Shefi 2017-05-25 07:14:53 UTC
Verified, see #3.

Comment 8 errata-xmlrpc 2017-06-28 15:38:16 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2017:1591


Note You need to log in before you can comment on or make changes to this bug.