Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1113124

Summary: [Scale] - Adding a disk to NFS storage takes too long
Product: Red Hat Enterprise Virtualization Manager Reporter: Eldad Marciano <emarcian>
Component: vdsmAssignee: Tal Nisan <tnisan>
Status: CLOSED INSUFFICIENT_DATA QA Contact: Aharon Canan <acanan>
Severity: high Docs Contact:
Priority: unspecified    
Version: 3.4.0CC: amureini, bazulay, emarcian, iheim, lpeer, scohen, tnisan, yeylon
Target Milestone: ---Keywords: Triaged
Target Release: 3.5.0Flags: amureini: needinfo+
Hardware: x86_64   
OS: Linux   
Whiteboard: storage
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2014-07-30 13:55:19 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Storage RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
engine log
none
vdsm log none

Description Eldad Marciano 2014-06-25 13:18:39 UTC 
Description of problem:
attaching disk to NFS storage taking too long (~8 min) under scale setup

Host Definition:
4 CPU (2 core 1 thread)
6GB RAM
mount to NFS
network 1gb isolated.

Engine Definition
-530 hosts
-1600 vms
-2 clusters
-2 storage domain

24 cores 6 cores, 2 threads
NFS storage


by the logs attaching disk to storage taking 8 min:
2014-06-24 15:46:50,168 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp-/127.0.0.1:8702-63) [3e84b057] Correlation ID: 6869e8d7, Job ID: 862cf695-2b7e-44d0-802b-841ab2121769, Call Stack: null, Custom Event ID: -1, Message: Add-Disk operation of fake_39_Disk1 was initiated on VM fake_14 by admin.
2014-06-24 15:52:39,756 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-4-thread-44) Correlation ID: 6869e8d7, Job ID: 862cf695-2b7e-44d0-802b-841ab2121769, Call Stack: null, Custom Event ID: -1, Message: The disk fake_39_Disk1 was successfully added to VM fake_14.

Version-Release number of selected component (if applicable):
engine  3.4.0-0.22.el6ev
vdsm vdsm-4.14.7-3.el6ev.x86_64

How reproducible:
90%

Steps to Reproduce:
1.scale setup
2.ramp up hosts creation using rest api via jmeter
3.attaching disk taking too long

Actual results:
attaching disk taking too long

Expected results:
faster disk creation as it works without scale.

Additional info:
Comment 1 Eldad Marciano 2014-06-25 13:26:20 UTC 
Created attachment 912103 [details]
engine log
Comment 2 Eldad Marciano 2014-06-25 13:34:29 UTC 
Created attachment 912105 [details]
vdsm log
Comment 3 Allon Mureinik 2014-06-25 14:26:18 UTC 
The attached logs start on 25/06, and the problem seems to have occurred on 24/06 - please attach the correct logs.
Comment 4 Allon Mureinik 2014-07-30 13:55:19 UTC 
(In reply to Allon Mureinik from comment #3)
> The attached logs start on 25/06, and the problem seems to have occurred on
> 24/06 - please attach the correct logs.
Still waiting.
I'm closing as INSUFFICIENT_DATA - if you reproduce this, please re-open the bug with the correct logs.